Code

Zarr improvements#88

Code

Merged

lbesnard merged 19 commits intomainaodn/aodn_cloud_optimised:mainfrom ZarrImprovementsaodn/aodn_cloud_optimised:ZarrImprovementsCopy head branch name to clipboardOct 23, 2024

+1,615-1,316

Commits

Commits on Oct 16, 2024

• Fix: add zarr safe chunks

  lbesnard

  committed
  c886529

  Copy full SHA for c886529

• zarr: refactor class

  lbesnard

  committed
  68d0174

  Copy full SHA for 68d0174

Commits on Oct 17, 2024

• Fix: refactor some zarr functions + add missing code to handle parts of a batch which needs to be overwritten but some other parts need to be appended

  lbesnard

  committed
  d976c34

  Copy full SHA for d976c34

• Fix: add the dask config to its correct location, just before creating the coiled cluster

  lbesnard

  committed
  e61109b

  Copy full SHA for e61109b

Commits on Oct 22, 2024

• Fix: add sort by time to ds for queries

  lbesnard

  committed
  927c290

  Copy full SHA for 927c290

• Fix: set client mode to local when client can not create a remote cluster

  lbesnard

  committed
  5ea7f96

  Copy full SHA for 5ea7f96

• Feat: refactor many function. more checks on corrupted dataset...

  lbesnard

  committed
  22c46a4

  Copy full SHA for 22c46a4

Commits on Oct 23, 2024

• Fix: add vmin=0 to colorbar

  lbesnard

  committed
  24f1bb2

  Copy full SHA for 24f1bb2

• Feat: add doc about debugging

  lbesnard

  committed
  b8c38fe

  Copy full SHA for b8c38fe

• Fix: more work on zarr handler. remove map_blocks as caused data corruption. Add ds.chunks(chunk=auto) when possible. refactor... many little bug fixes

  lbesnard

  committed
  dc5e1c0

  Copy full SHA for dc5e1c0

• Fix: Improve config to process ramssa gamssa

  lbesnard

  committed
  6312890

  Copy full SHA for 6312890

• Fix: improve srs configuration

  lbesnard

  committed
  90ef43e

  Copy full SHA for 90ef43e

• Fix: improve srs configuration

  lbesnard

  committed
  4b397cb

  Copy full SHA for 4b397cb

• Fix: avoid running poetry-lock in github action

  lbesnard

  committed
  a85d718

  Copy full SHA for a85d718

• Update poetry pre-commit

  lbesnard

  committed
  6560883

  Copy full SHA for 6560883

• Update poetry pre-commit

  lbesnard

  committed
  5335f1b

  Copy full SHA for 5335f1b

• Update poetry pre-commit

  lbesnard

  committed
  dcb99ea

  Copy full SHA for dcb99ea

• Update requirements

  lbesnard

  committed
  a28b935

  Copy full SHA for a28b935

• update env for python < 3.13

  lbesnard

  committed
  76648c7

  Copy full SHA for 76648c7