How can I migrate data from one HDFS cluster to another over the network?

70 views Asked by At

What options do I have for reliably migrating data from one (small) HDFS cluster to another completely separate installation?

I have a network connection between clusters (this question is not a duplicate)

1

There are 1 answers

1
Kumar On

You can do this using distcp command which is available in Hadoop.

Check the below link to know about more

DistCp

Example

hadoop distcp hdfs://nn1:8020/foo/a hdfs://nn1:8020/foo/b