How to give multiple input paths to gora avrostore in giraph (or) how to make giraph read multiple input files

107 views Asked by At

How do I make giraph read data from multiple input paths. I am using this in gora.properties

gora.datastore.default = org.apache.gora.avro.store.Avrostore gora.avrostore.input.path=file:///path/to/file1.avro,file:///path/to/file2.avro

But it gives this error Input path does not exist: file:/path/to/file1.avro,file:/path/to/file2.avro

1

There are 1 answers

0
Alfonso Nishikawa On

Short answer: sorry, but seems not possible.

Long answer:

I don't use Giraph, but I know that Gora does not support multiple paths in AvroStore.

For that necessity, Giraph should be the one implementing that feature creating 2 DataStore connections (one per each file), but I guess it does not do that (or does it?).

The other approach would be to improve AvroStore to support several files in the configuration, but as far as I know, you are the first to think about it. Maybe you would want to make that improvement... :)