Sorting dataset along axis with dask

144 views Asked by At

I want to sort dataset (netcdf file) along time dimension for each year and then average them. Problem is that dask only supports 'topk' sorting, which consumes all the memory if include whole range of values. Xarray only supports sorting of 1D arrays. Numpy sort does the job but it also consumes memory. Is there any way to sort whole large dataset across some axis with dask to reduce memory footprint?

0

There are 0 answers