How to integrate Intellij and Databricks, like when using the jdwp with a regular Spark cluster?

56 views Asked by At

I have been looking online for awhile, but have found nothing, thus this question. I would like to be able to debug my Apache Spark code (written in Scala) remotely on Databricks, similar to the way it can be done on regular Spark clusters using the Java Debug Wire Protocol (or jdwp). Is this possible at all? Can it, perhaps, be done using the Databrick Labs dbx tool? Or just by using a host and port number (and, possibly as well, a Databricks token) with said jdwp?

Any response will be greatly aprreciated.

Thanks in advance.

0

There are 0 answers