New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Optimize concatenation to existing zarr file #4

Open

4 tasks

rileyhales opened this issue Apr 8, 2024 · 0 comments

Assignees

Contributor

rileyhales commented Apr 8, 2024 •

edited by RickytheGuy

Loading

Optimization opportunities

Computations

round new rapid results to 3 decimal places
replace <0 values with 0
perform 1 concatenation regardless of number of incremental rapid runs performed. Concatenate the multiple outputs before concatenating them onto the locally stored zarr.

Downloads

if multiple era5 files were downloaded because they span multiple months, concatenate them all before uploading so that fewer incremental rapid runs and concatenation steps need to be run.

rileyhales assigned RickytheGuy

RickytheGuy added a commit that referenced this issue


          addresses #4

654f703

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment