SparkNLP Text classification using BertSentenceEmbeddings

Question

I am struggling with implementing classification usecase using the BertSentenceEmbeddings in python. Mostly I get classNotFoundError and I think I am unable to figure out the right versions of libraries (spark-nlp, pyspark). I followed most of options suggested on web but had no luck.

Any suggestions/tutorial would be the great help. Thanks.

Here's my notebook.

Answer 1

This tutorial helped me solve this error.

Thank you Maziyar for the help on Spark-NLP slack.