I use fsspec which uses in-built capabilities of paramiko but could not really find a way how we can paginate the response.
Is there a way to have that functionality over here?
The use-case is like every directory has 100000 files and listing all of these separately in memory is a bad-idea I suppose.
There is a sftp.listdir_iter but do we have that capability in fsspec?