What is the latest Spark-Redis connector version we can install in databricks cluster?

317 views Asked by At

What is the latest spark-redis version we can install in databricks cluster ?

I will be using python/pyspark to write the dataframe to redis.

My Databricks runtime :10.2 (includes Apache Spark 3.2.0, Scala 2.12)

In Databricks, we can see only spark-redis 2.3.0 version in maven (install library-->maven-->search packages-->redis.

Databricks-Cluster-Library

Below is a screenshot from spark-redis github documentation.

spark-redis version in github documentation

0

There are 0 answers