I am new to Spark and need some guidance on the below issue - Whenever I am trying to create a SparkSession object using a SparkConf object I am getting the below error -
AttributeError: 'SparkConf' object has no attribute '_get_object_id'
I am using Spark 2.3 with Python 3.7 in local mode .
I have read some of the solutions available in internet but none of them has resolved my issue .
Even when I am trying to create the SparkSession object directly i.e. without explicit SparkConf object , then also I am getting the same error -
ss=SparkSession.builder.master("local").getOrCreate() AttributeError: 'SparkConf' object has no attribute '_get_object_id'