How can we load an s3 directory with 1000s of part files in neo4j

260 views Asked by At

I have seen this article about loading a single file from s3 in neo4j. But, if I have the data in multiple part files (usually, in case of large datasets), how can we efficiently load this into a neo4j db?

1

There are 1 answers

2
cybersam On

If you want to import a large amount of CSV data (possibly from a large number of files) into a previously unused neo4j DB, you should consider using the import command of the neo4j-admin tool.

You will need to use presigned URLs for all the CSV files, or you can first download all the files from S3.

The import command is very powerful but also takes some effort to configure properly (and may require you to modify your CSV files), so you should carefully read the documentation.