TechQA.

Question

Group by then filter logic for dataset in scala using spark 1.x

score 76 · Answer 1 · 2023-11-09T20:11:21.497000

0

Answer

76

Views

Group by then filter logic for dataset in scala using spark 1.x

76 views Asked by user1570345 At 09 November 2023 at 20:11

score 304 · Answer 2 · 2020-08-19T12:07:34.090000

Convert a (String, List[(String, String)]) to JSON object

304 views Asked by chris At 19 August 2020 at 12:07

score 506 · Answer 3 · 2020-08-11T12:41:41.620000

How to add double quotes to the string?

506 views Asked by xin At 11 August 2020 at 12:41

score 59 · Answer 4 · 2020-02-27T13:26:23.887000

How to display mismatched report with a label in spark 1.6 - scala except function?

59 views Asked by voidpro At 27 February 2020 at 13:26

score 503 · Answer 5 · 2019-09-26T21:51:27.347000

Repartition() causes spark job to fail

503 views Asked by Bob At 26 September 2019 at 21:51

score 120 · Answer 6 · 2019-09-20T14:45:49.163000

Delete Unicode value in output of Spark 1.6 using Scala

120 views Asked by Sophie Dinka At 20 September 2019 at 14:45

score 45 · Answer 7 · 2019-09-20T10:11:06.103000

Reading Encoded value in spark 1.6 throwing Error

45 views Asked by Sophie Dinka At 20 September 2019 at 10:11

score 187 · Answer 8 · 2019-09-20T06:07:19.610000

Saving output of spark to csv in spark 1.6

187 views Asked by Sophie Dinka At 20 September 2019 at 06:07

score 99 · Answer 9 · 2019-09-19T18:25:22.137000

UDF in Spark 1.6 Reassignment to val error

99 views Asked by Sophie Dinka At 19 September 2019 at 18:25

score 3948 · Answer 10 · 2019-06-24T10:47:06.647000

How to list All Databases using HiveContext in PySpark 1.6

3.9k views Asked by Ashish Kumar Singh At 24 June 2019 at 10:47

score 1249 · Answer 11 · 2019-02-14T17:04:39.853000

Iterating over a grouped dataset in Spark 1.6

1.2k views Asked by Havnar At 14 February 2019 at 17:04

score 848 · Answer 12 · 2019-02-14T05:43:19.123000

Pyspark - DataFrame persist() errors out java.lang.OutOfMemoryError: GC overhead limit exceeded

848 views Asked by Sam At 14 February 2019 at 05:43

score 185 · Answer 13 · 2019-02-01T19:36:39.070000

Spark Program twice as slow in Spark 2.2 than Spark 1.6

185 views Asked by Doug T At 01 February 2019 at 19:36

score 1120 · Answer 14 · 2018-12-19T16:48:22.717000

cast method results in null values in java spark

1.1k views Asked by humblecoder At 19 December 2018 at 16:48

score 517 · Answer 15 · 2018-10-12T01:02:49.193000

How to split the input data into several files based of date field in pyspark?

517 views Asked by Bob At 12 October 2018 at 01:02

score 11306 · Answer 16 · 2018-10-08T14:54:17.863000

How to read a CSV file with commas within a field using pyspark?

11.3k views Asked by Bob At 08 October 2018 at 14:54

score 5179 · Answer 17 · 2018-08-27T05:15:46.037000

Why does persist(StorageLevel.MEMORY_AND_DISK) give different results than cache() with HBase?

5.1k views Asked by Dasarathy D R At 27 August 2018 at 05:15

score 176 · Answer 18 · 2018-07-19T09:47:41.443000

Spark 1.6 - Overwrite directory with avro files failing using dataframes

176 views Asked by Mnav505 At 19 July 2018 at 09:47

score 1153 · Answer 19 · 2018-07-18T15:17:54.133000

Spark Streaming 1.6 + Kafka: Too many batches in "queued" status

1.1k views Asked by Jorge Cespedes At 18 July 2018 at 15:17

score 3694 · Answer 20 · 2018-07-06T10:54:40.407000

How to drop duplicates considering only subset of columns?

3.6k views Asked by Naveen Yadav At 06 July 2018 at 10:54

TechQA.

List Question

Group by then filter logic for dataset in scala using spark 1.x

Convert a (String, List[(String, String)]) to JSON object

How to add double quotes to the string?

How to display mismatched report with a label in spark 1.6 - scala except function?

Repartition() causes spark job to fail

Delete Unicode value in output of Spark 1.6 using Scala

Reading Encoded value in spark 1.6 throwing Error

Saving output of spark to csv in spark 1.6

UDF in Spark 1.6 Reassignment to val error

How to list All Databases using HiveContext in PySpark 1.6

Iterating over a grouped dataset in Spark 1.6

Pyspark - DataFrame persist() errors out java.lang.OutOfMemoryError: GC overhead limit exceeded

Spark Program twice as slow in Spark 2.2 than Spark 1.6

cast method results in null values in java spark

How to split the input data into several files based of date field in pyspark?

How to read a CSV file with commas within a field using pyspark?

Why does persist(StorageLevel.MEMORY_AND_DISK) give different results than cache() with HBase?

Spark 1.6 - Overwrite directory with avro files failing using dataframes

Spark Streaming 1.6 + Kafka: Too many batches in "queued" status

How to drop duplicates considering only subset of columns?

Popular Questions

Trending Questions