Extension to the HDF5 chunks API #309
Labels
enhancement
New feature or request
netCDF read
Relating to reading netCDF datasets
netCDF write
Relating to writing netCDF datasets
performance
Relating to speed and memory performance
Currently (
v1.11.1.0
), the treatment of HDF5 chunking is a bit inadequate:A more comprehensive and flexible API is needed:
cfdm.write
should chunk by default, and have a keywork argument (hdf5_chunks
) to configure the default chunking.cfdm.read
should, by default, store HDF5 chunking on the returned data, so that it will be used when when writing out to a new netCDF4 file.f.nc_set_hdf_chunksizes({'T': 12})
f.nc_set_hdf_chunksizes("8 MiB")
PR to follow.
The text was updated successfully, but these errors were encountered: