TechQA.

Question

How can I know if spark application/job is idle/waiting for resources?

score 33 · Answer 1 · 2024-03-25T13:10:08.717000

0

Answer

33

Views

How can I know if spark application/job is idle/waiting for resources?

33 views Asked by Giovanna Bueno At 25 March 2024 at 13:10

score 134 · Answer 2 · 2023-12-10T09:27:22.803000

Spark, Connect, could not cache persist jdbc_relation

134 views Asked by gavrmike At 10 December 2023 at 09:27

score 352 · Answer 3 · 2023-10-18T09:36:33.577000

Is any solution related to SparkConnectGrpcException?

352 views Asked by saravanan kumar At 18 October 2023 at 09:36

score 33 · Answer 4 · 2023-10-09T10:52:21.317000

Is there any way to set spark applicationId format

33 views Asked by cpawali At 09 October 2023 at 10:52

score 147 · Answer 5 · 2023-09-30T11:45:45.320000

Java 8 compatible no error given spark version needed

147 views Asked by Beytullah Gönülal At 30 September 2023 at 11:45

score 22 · Answer 6 · 2023-08-08T18:18:01.857000

Is it Possible to Choose Spark Executor Location

22 views Asked by sem At 08 August 2023 at 18:18

score 314 · Answer 7 · 2023-08-07T12:03:22.970000

Spark executors exiting frequently and Initial job has not accepted any resources

314 views Asked by MagentaPink At 07 August 2023 at 12:03

score 220 · Answer 8 · 2023-07-24T13:04:22.783000

Connecting to Spark Standalone cluster from Airflow

220 views Asked by Yash Agrawal At 24 July 2023 at 13:04

score 100 · Answer 9 · 2023-05-19T13:10:55.677000

Define specific spark executors per worker on a Spark cluster of 3 worker nodes

100 views Asked by Andreas Lampropoulos At 19 May 2023 at 13:10

score 1032 · Answer 10 · 2022-12-13T09:52:03.073000

Is writing to database done by driver or executor in spark cluster

1k views Asked by Saranraj K At 13 December 2022 at 09:52

score 1458 · Answer 11 · 2022-11-25T06:31:02.717000

Hadoop 3 gcs-connector doesn't work properly with latest version of spark 3 standalone mode

1.4k views Asked by Bogdan Senyshyn At 25 November 2022 at 06:31

score 114 · Answer 12 · 2022-09-10T12:33:45.983000

Spark driver / executors in docker containers with port translation

114 views Asked by francotirador At 10 September 2022 at 12:33

score 1263 · Answer 13 · 2022-07-25T07:40:27.320000

spark scala: Performance degrade with simple UDF over large number of columns

1.2k views Asked by Quiescent At 25 July 2022 at 07:40

score 1075 · Answer 14 · 2022-07-24T06:02:56.423000

Spark not giving equal tasks to all executors

1k views Asked by best wishes At 24 July 2022 at 06:02

score 169 · Answer 15 · 2022-07-14T07:16:56.480000

how to change spark worker URL change in master UI?

169 views Asked by Vivek Trivedi At 14 July 2022 at 07:16

score 556 · Answer 16 · 2022-05-30T11:59:02.890000

spark Local mode vs standalone cluster in term of cores and threads usage

556 views Asked by ab cosmoweb At 30 May 2022 at 11:59

score 256 · Answer 17 · 2022-05-25T09:07:40.730000

how to fix error in lunching pyspark standalone mode

256 views Asked by ab cosmoweb At 25 May 2022 at 09:07

score 430 · Answer 18 · 2022-03-20T06:04:55.223000

ERROR StandaloneSchedulerBackend: Application has been killed. Reason: All masters are unresponsive! Giving up. - Spark standalone cluster

430 views Asked by user18036040 At 20 March 2022 at 06:04

score 551 · Answer 19 · 2022-02-25T16:14:19.413000

What is Spark default username and password for a standalong installation?

551 views Asked by Dhiman Deb At 25 February 2022 at 16:14

score 155 · Answer 20 · 2021-12-26T07:41:42.167000

How to get result from Spark after submitting a job via REST API?

155 views Asked by MegaOwIer At 26 December 2021 at 07:41

TechQA.

List Question

How can I know if spark application/job is idle/waiting for resources?

Spark, Connect, could not cache persist jdbc_relation

Is any solution related to SparkConnectGrpcException?

Is there any way to set spark applicationId format

Java 8 compatible no error given spark version needed

Is it Possible to Choose Spark Executor Location

Spark executors exiting frequently and Initial job has not accepted any resources

Connecting to Spark Standalone cluster from Airflow

Define specific spark executors per worker on a Spark cluster of 3 worker nodes

Is writing to database done by driver or executor in spark cluster

Hadoop 3 gcs-connector doesn't work properly with latest version of spark 3 standalone mode

Spark driver / executors in docker containers with port translation

spark scala: Performance degrade with simple UDF over large number of columns

Spark not giving equal tasks to all executors

how to change spark worker URL change in master UI?

spark Local mode vs standalone cluster in term of cores and threads usage

how to fix error in lunching pyspark standalone mode

ERROR StandaloneSchedulerBackend: Application has been killed. Reason: All masters are unresponsive! Giving up. - Spark standalone cluster

What is Spark default username and password for a standalong installation?

How to get result from Spark after submitting a job via REST API?

Popular Questions

Trending Questions