Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Feature/update example data code #339

Merged
merged 40 commits into from
Jan 10, 2024
Merged
Show file tree
Hide file tree
Changes from 23 commits
Commits
Show all changes
40 commits
Select commit Hold shift + click to select a range
c1912b3
dummy data recipes moved to example data
vgro Oct 23, 2023
5162fad
docs further updated, tests breaking
vgro Oct 24, 2023
4b837cb
timeindex in climate dummy fixed
vgro Oct 24, 2023
94d8776
Merge branch 'develop' into feature/update_example_data_code
jacobcook1995 Dec 1, 2023
70231d2
Merge branch 'develop' into feature/update_example_data_code
jacobcook1995 Dec 5, 2023
c853ef5
Merge branch 'feature/plants_model' into feature/update_example_data_…
davidorme Dec 6, 2023
8943a9d
Restructure of example_data directory and script updates
davidorme Dec 6, 2023
2330780
Restructure of example_data directory and script updates
davidorme Dec 6, 2023
8f95122
Merge branch 'feature/plants_model' into feature/update_example_data_…
davidorme Dec 8, 2023
393e71f
Failed to name elevation variable
davidorme Dec 8, 2023
40897d0
Regenerate up to date example data
davidorme Dec 8, 2023
81045f3
Reconfigure input data paths in example config
davidorme Dec 8, 2023
563f1a9
resolve relative paths to normalise in config
davidorme Dec 8, 2023
2895bf3
Update test to use new example data dir structure
davidorme Dec 8, 2023
118e611
Remove data files in root of example_data
davidorme Dec 8, 2023
e8688e8
Updating docs and tidying example config
davidorme Dec 8, 2023
1cbed61
Updating example docs
davidorme Dec 8, 2023
d74141b
Better method naming in Config, improved config filepath resolution
davidorme Dec 11, 2023
a561dc9
Doc update for new example data structure
davidorme Dec 11, 2023
51e6d93
Broken paths to climate example data code
davidorme Dec 11, 2023
23c72e8
Let pathlib handle cross OS path comparisons
davidorme Dec 11, 2023
d65dc56
Minor rewording
davidorme Dec 12, 2023
d6c60be
Minor wording tweaks
davidorme Dec 12, 2023
35dafff
Merge branch 'develop' into feature/update_example_data_code
davidorme Dec 13, 2023
2a170ec
Updating dask to hopefully fix occasional vr_run stall
jacobcook1995 Dec 13, 2023
fda9d14
Update docs/source/virtual_rainforest/example_data.md
davidorme Dec 14, 2023
96b4b1c
Update docs/source/virtual_rainforest/example_data.md
davidorme Dec 14, 2023
ee562f4
Update docs/source/virtual_rainforest/example_data.md
davidorme Dec 14, 2023
42682a7
Update docs/source/virtual_rainforest/example_data.md
davidorme Dec 14, 2023
b72a866
Merge branch 'develop' into feature/update_example_data_code
jacobcook1995 Jan 2, 2024
e39db23
pyupgrade from 3.9 to 3.10
davidorme Jan 3, 2024
a8cb086
Remove 3.9 from CI process
davidorme Jan 3, 2024
b152555
Resolving issue with badly declared new type
davidorme Jan 3, 2024
03e7cd2
TypeAlias didn't quite work
davidorme Jan 3, 2024
8fcc1f0
Updating python versions support in pyproject.toml
davidorme Jan 4, 2024
2650769
Updating doc package versions in pyproject.toml
davidorme Jan 4, 2024
344d547
'Solving' some doc build issues
davidorme Jan 4, 2024
e7f4264
Merge branch 'feature/update_example_data_code' of https://github.com…
davidorme Jan 4, 2024
db62621
Merge branch '324-consider-dropping-python-39' into feature/update_ex…
davidorme Jan 4, 2024
d3c682d
Update example_data.md
vgro Jan 10, 2024
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
43 changes: 26 additions & 17 deletions docs/source/data_recipes/CDS_toolbox_template.md
Original file line number Diff line number Diff line change
Expand Up @@ -22,9 +22,11 @@ of the Virtual Rainforest. This document describes how to download climate data
the Copernicus [Climate Data Store](https://cds.climate.copernicus.eu/) (CDS) and basic
pre-processing options using the
[CDS toolbox](https://cds.climate.copernicus.eu/cdsapp#!/toolbox).
At present, the pre-processing does not include scaling or topographic adjustment.
You need to create a user account to access all data and functionalities.

NOTE: You need to create a user account to access all data and functionalities.
```{note}
At present, the pre-processing does not include scaling or topographic adjustment.
```

## Climate input variables

Expand All @@ -33,7 +35,7 @@ variables (or derivatives) at each time step (default: monthly means):

* Air temperature (typically 2m; mean, minimum, and maximum)
* Air humidity (typically 2m; relative or specific humidity)
* Air pressure (typically mean sealevel or surface pressure)
* Air pressure (typically mean sea level or surface pressure)
* Wind speed (typically 10m)
* Precipitation

Expand Down Expand Up @@ -63,12 +65,15 @@ simulations:

ERA5-Land is a reanalysis dataset providing a consistent view of the evolution of land
variables over several decades at an enhanced resolution compared to ERA5 (0.1 x 0.1
deg resolution).
deg).

The full documentation and download link can be accessed
[here for hourly data](https://cds.climate.copernicus.eu/cdsapp#!/dataset/reanalysis-era5-land?tab=overview)
and [here for monthly data](https://cds.climate.copernicus.eu/cdsapp#!/dataset/reanalysis-era5-land-monthly-means?tab=overview)

Example code to manipulate downloaded ERA5-Land data as used in the `vr_run` example
is available [here](../../../virtual_rainforest/example_data/generation_scripts/climate_example_data.py).

* WFDE5

This global dataset provides bias-corrected reconstruction of near-surface
Expand All @@ -77,7 +82,9 @@ simulations:
available in hourly and daily time steps for the period 1979-2019 in 0.5 x 0.5 deg
resolution.

The full documentation and download link can be accessed [here](https://cds.climate.copernicus.eu/cdsapp#!/dataset/derived-near-surface-meteorological-variables?tab=overview).
The full documentation and download link can be accessed
[here](https://cds.climate.copernicus.eu/cdsapp#!/dataset/derived-near-surface-meteorological-variables?tab=overview)
.

* CORDEX-SEA

Expand All @@ -90,15 +97,15 @@ simulations:

The full documentation and download link can be accessed [here](https://cds.climate.copernicus.eu/cdsapp#!/dataset/projections-cordex-domains-single-levels?tab=overview).

* Atmospheric CO2
* Atmospheric $\ce{CO_{2}}$

Observed global CO2 levels (Mauna Loa, NOAA/GML) are available in monthly or annual
resolution (1958 - present) [here](https://gml.noaa.gov/ccgg/trends/graph.html).
Monthly data derived from satellite observation (2002 - present) is available
Observed global $\ce{CO_{2}}$ levels (Mauna Loa, NOAA/GML) are available in monthly or
annual resolution (1958 - present) [here](https://gml.noaa.gov/ccgg/trends/graph.html)
. Monthly data derived from satellite observation (2002 - present) is available
[here](https://cds.climate.copernicus.eu/cdsapp#!/dataset/satellite-carbon-dioxide?tab=overview)
. Alternatively, reconstructed gridded monthly CO2 data for the historical period
(1953 - 2013) and future CMIP6 scenarios (2015 - 2150) can be downloaded
[here](https://zenodo.org/record/5021361){cite:p}`cheng_wei_global_2021`.
. Alternatively, reconstructed gridded monthly $\ce{CO_{2}}$ data for the historical
period (1953 - 2013) and future CMIP6 scenarios (2015 - 2150) can be downloaded
[here](https://zenodo.org/record/5021361) {cite:p}`cheng_wei_global_2021`.

## Step-by-step example

Expand All @@ -109,7 +116,7 @@ data, navigate to the tab 'Download Data'.
### Selection

This is an example of a selection of tabs to download historical '2m air temperature'
from the CORDEX-SEA:
from the CORDEX-SEA (you can download multiple variables and years in one request):

* Domain (South-East Asia),
* Experiment (here: 'historical', RCPs available)
Expand All @@ -121,10 +128,12 @@ from the CORDEX-SEA:
* Ensemble member (r1i1p1)
* Start year and End year (here: 2001-2005)

Once you selected the data, you can either download the dataset for further processing,
[see here](./ERA5_preprocessing_example.md) an example of how to manipulate ERA5 data
using xarray, or click on 'show Toolbox request' at the bottom of the page, copy the
code, and open the CDS toolbox editor.
Once you selected the data, you can either download the dataset for further processing
or click on 'show Toolbox request' at the bottom of the page, copy the code, and open
the CDS toolbox editor.

The code to manipulate climate data as used in the `vr_run` example is available
[here](../../../virtual_rainforest/example_data/generation_scripts/climate_example_data.py).

### Toolbox template CORDEX-SEA

Expand Down
215 changes: 0 additions & 215 deletions docs/source/data_recipes/ERA5_preprocessing_example.md

This file was deleted.

Loading
Loading