Can AZCopy perform the copy starting from the most recent files and folders

1k views Asked by At

Hi all hope everyone is safe.

I'm migrating a Windows Application that contain 1.8 Million files and folders of images and other non-DB dependency files from our On-Prem DataCenter to an Azure VM. The application can tolerate missing images (it displays an X in their place), and I plan to use AZCopy to copy these files to the blob, however I noticed that AZCopy has its own way of choosing what files and folders to start with. Is there a way to let AZCopy start with the most recent files and folders? If that is possible, then I can do the cut-off as soon as AZCopy copies the last few days instead of waiting for the whole copy to be completed. So instead of few days downtime, it would be only few hours.

Thanks

1

There are 1 answers

0
SumanthMarigowda-MSFT On

We have a way to filter to files after a point in time but not before.

Thank you for this suggestion. We are going add this in our backlog. Include-before shouldn't take too much work, since the foundation is already there.

As a suggestion in the meantime, and, this is not the most amazing workaround ever, but however it could potentially mark files after the time with a certain windows attribute that

  • Isn't on the other files
  • Won't affect your workload

Then, filter out the attribute. Unfortunately, all of the file attributes we can filter by do something.

// Available attributes (SMB) include:
// R = Read-only files
// A = Files ready for archiving
// S = System files
// H = Hidden files
// C = Compressed files
// N = Normal files
// E = Encrypted files
// T = Temporary files
// O = Offline files
// I = Non-indexed files
// Reference for File Attribute Constants:
// https://learn.microsoft.com/en-us/windows/win32/fileio/file-attribute-constants