When mounted an s3 bucket under alluxio://s3/, the bucket already has objects. However, when I get the directory list (either by alluxio fs ls or ls the fuse-mounted directory or on the web ui) i see no files. When I write a new file or read an already existing object via Alluxio, it appears in the dir list. Is there a way I can have Alluxio show all the not-yet-accessed files in the directory? (rather than only showing files after writing or accessing them)
How can I have Alluxio show all the not-yet-accessed files in the directory?
88 views Asked by ChanChan Mao At
1
a simple way is to run
bin/alluxio fs loadMetadata /s3to force refresh the Alluxio directory. There are other ways to trigger it, checkout “How to Trigger Metadata Sync” section in this latest blog: https://www.alluxio.io/blog/metadata-synchronization-in-alluxio-design-implementation-and-optimization/