An output folder called "output.json" exists on the HDFS and it contains the following files
|- _SUCCESS
\- part-r-00000-3c9a6268-ff29-4a76-8d74-8c867e7f0f0f.json
Sometimes it contains more "part-*" files.
What is the right way to read from this folder? I am guessing it should be something like
read("path/to/output.json") // and rest should be taken care off
Note: The HDFS resides on a remote server