Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Nimrod file format #3647

Merged
merged 49 commits into from
Jun 4, 2020
Merged
Show file tree
Hide file tree
Changes from 10 commits
Commits
Show all changes
49 commits
Select commit Hold shift + click to select a range
edd35fa
Attempt to copy in changes developed locally to the nimrod file forma…
MoseleyS Jan 24, 2020
c7cac57
Updates unit-test results
MoseleyS Jan 27, 2020
d7e6b1d
Fixes precision of data and coords. Updates existing unit-tests.
MoseleyS Jan 27, 2020
a428a0b
Updates existing unit-tests.
MoseleyS Jan 27, 2020
f16fb3a
Removes trailing whitespace.
MoseleyS Jan 28, 2020
22f2fcc
Improves accuracy and precision of meta-data handling and known excep…
MoseleyS Jan 30, 2020
f21d26d
Stickler issues solved.
MoseleyS Jan 30, 2020
7dd34b2
Updates iris-test-data commit reference.
MoseleyS Jan 30, 2020
96125f4
Adds whats-new entry
MoseleyS Jan 31, 2020
62e56b1
Improves handling of Nimrod-format files as seen from Radarnet.
MoseleyS Feb 17, 2020
8a9c905
Corrects indentation for Stickler Bot.
MoseleyS Feb 17, 2020
1e9b922
Updates handling of specific attributes.
MoseleyS Feb 18, 2020
1e4eb58
Tries changing the source of the iris-test data.
MoseleyS Feb 18, 2020
28cf783
Adds decorator to skip data tests when TEST_MINIMAL=True.
MoseleyS Feb 18, 2020
c97d048
Removes unnecessary test.
MoseleyS Feb 21, 2020
ae1d3a1
Corrects crs origin information in some old Nimrod files.
MoseleyS Feb 21, 2020
f7c4ae9
Blacker than the ace of spades.
MoseleyS Feb 24, 2020
ed451e5
As the crs origin information in some old Nimrod files has been corre…
MoseleyS Mar 6, 2020
f5e22e6
Improves regex syntax to make Stickler happy.
MoseleyS Mar 6, 2020
2aca4c5
Adds missing blank line for black.
MoseleyS Mar 6, 2020
0ce9af1
Updates result for broken test
MoseleyS Apr 23, 2020
8c36555
Reorders how units are handled following a bug investigation
MoseleyS Apr 23, 2020
79e5d6e
Removes unused import
MoseleyS Apr 23, 2020
f97d4e0
Corrects data checksum following unit conversion fix. Points to lates…
MoseleyS May 13, 2020
57fd2ad
Updates test-data reference following merging of nimrod-data PR.
MoseleyS May 18, 2020
674c828
Responds to first review
MoseleyS May 18, 2020
f52edb0
Ran black (I forgot - boo hoo)
MoseleyS May 18, 2020
6d03439
Responses to second review
MoseleyS May 21, 2020
0913e4b
Simplifies dtype setting
MoseleyS May 22, 2020
35ef718
Improves matching of mean and spread in title to be case insensitive
MoseleyS May 22, 2020
dcdfcd7
Removes bespoke MOGREPS-UK identifier but continues to remove realiza…
MoseleyS May 22, 2020
2e3079f
Adds references for ellipsoids
MoseleyS May 22, 2020
ac1bf9e
Removes unnecessary test in soil_type_coord
MoseleyS May 22, 2020
f7aec62
Added element information to header lists
MoseleyS May 22, 2020
8d8feab
Second review:
MoseleyS May 22, 2020
bf68e4c
Second review:
MoseleyS May 22, 2020
60ed07e
Second review:
MoseleyS May 22, 2020
f95a8f1
Second review:
MoseleyS May 22, 2020
f2a5dc6
Second review:
MoseleyS May 22, 2020
66079d8
Adding unit tests for unit function
fionaRust May 26, 2020
00dfa35
Merge pull request #1 from fionaRust/nimrod_file_format
MoseleyS May 26, 2020
0178eeb
Removed unnecessary dictionaries from name function
fionaRust May 26, 2020
761d2d1
Merge pull request #2 from fionaRust/nimrod_file_format
MoseleyS May 26, 2020
454d57a
Improved comments for second review
MoseleyS May 28, 2020
ffca927
Merge branch 'nimrod_file_format' of github.com:MoseleyS/iris into ni…
MoseleyS May 28, 2020
e6f70e0
Adds kwarg to allow user to skip known meta-data inconsistencies.
MoseleyS May 28, 2020
a1519b3
Adds test for kwarg to allow user to skip known meta-data inconsisten…
MoseleyS May 28, 2020
e8c983b
Dials back a couple of bits of functionality:
MoseleyS May 28, 2020
3a117ce
Blacker code
MoseleyS May 28, 2020
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
2 changes: 1 addition & 1 deletion .travis.yml
Original file line number Diff line number Diff line change
Expand Up @@ -28,7 +28,7 @@ git:

install:
- >
export IRIS_TEST_DATA_REF="1696ac3a823a06b95f430670f285ee97671d2cf2";
export IRIS_TEST_DATA_REF="06e3c7d289d4ae177539e71134a2a6f6a1bc8117";
export IRIS_TEST_DATA_SUFFIX=$(echo "${IRIS_TEST_DATA_REF}" | sed "s/^v//");

# Install miniconda
Expand Down
Original file line number Diff line number Diff line change
@@ -0,0 +1,3 @@
* The :class:`~iris.fileformats.nimrod` provides richer meta-data translation
when loading Nimrod-format data into cubes. This covers most known operational
use-cases.
123 changes: 87 additions & 36 deletions lib/iris/fileformats/nimrod.py
Original file line number Diff line number Diff line change
Expand Up @@ -48,7 +48,7 @@
"proj_biaxial_ellipsoid",
"ensemble_member",
"spare1",
"spare2",
"averagingtype",
)


Expand All @@ -70,6 +70,8 @@
"true_origin_easting",
"true_origin_northing",
"tm_meridian_scaling",
"threshold_value_alt",
"threshold_value",
)


Expand All @@ -87,46 +89,95 @@
"sat_space_count",
"ducting_index",
"elevation_angle",
'neighbourhood_radius',
'threshold_vicinity_radius',
'recursive_filter_alpha',
'threshold_fuzziness',
'threshold_duration_fuzziness',
'data_header_float32_05',
'data_header_float32_06',
'data_header_float32_07',
'data_header_float32_08',
'data_header_float32_09',
'data_header_float32_10',
'data_header_float32_11',
'data_header_float32_12',
'data_header_float32_13',
'data_header_float32_14',
'data_header_float32_15',
'data_header_float32_16',
'data_header_float32_17',
'data_header_float32_18',
'data_header_float32_19',
'data_header_float32_20',
'data_header_float32_21',
'data_header_float32_22',
'data_header_float32_23',
'data_header_float32_24',
'data_header_float32_25',
'data_header_float32_26',
'data_header_float32_27',
'data_header_float32_28',
'data_header_float32_29',
'data_header_float32_30',
'data_header_float32_31',
'data_header_float32_32',
)


# data specific header (int16) elements
data_header_int16s = (
"radar_num",
"radars_bitmask",
"more_radars_bitmask",
"clutter_map_num",
"calibration_type",
"bright_band_height",
"bright_band_intensity",
"bright_band_test1",
"bright_band_test2",
"infill_flag",
"stop_elevation",
"int16_vertical_coord",
"int16_reference_vertical_coord",
"int16_y_origin",
"int16_row_step",
"int16_x_origin",
"int16_column_step",
"int16_float32_mdi",
"int16_data_scaling",
"int16_data_offset",
"int16_x_offset",
"int16_y_offset",
"int16_true_origin_latitude",
"int16_true_origin_longitude",
"int16_tl_y",
"int16_tl_x",
"int16_tr_y",
"int16_ty_x",
"int16_br_y",
"int16_br_x",
"int16_bl_y",
"int16_bl_x",
"sensor_id",
"meteosat_id",
"alphas_available",
"threshold_type",
"probability_method",
"recursive_filter_iterations",
"member_count",
"probability_period_of_event",
"data_header_int16_05",
"soil_type",
"radiation_code",
"data_header_int16_08",
"data_header_int16_09",
"data_header_int16_10",
"data_header_int16_11",
"data_header_int16_12",
"data_header_int16_13",
"data_header_int16_14",
"data_header_int16_15",
"data_header_int16_16",
"data_header_int16_17",
"data_header_int16_18",
"data_header_int16_19",
"data_header_int16_20",
"data_header_int16_21",
"data_header_int16_22",
"data_header_int16_23",
"data_header_int16_24",
"data_header_int16_25",
"data_header_int16_26",
"data_header_int16_27",
"data_header_int16_28",
"data_header_int16_29",
"data_header_int16_30",
"data_header_int16_31",
"data_header_int16_32",
"data_header_int16_33",
"data_header_int16_34",
"data_header_int16_35",
"data_header_int16_36",
"data_header_int16_37",
"data_header_int16_38",
"data_header_int16_39",
"data_header_int16_40",
"data_header_int16_41",
"data_header_int16_42",
"data_header_int16_43",
"data_header_int16_44",
"data_header_int16_45",
"data_header_int16_46",
"data_header_int16_47",
"data_header_int16_48",
"data_header_int16_49",
"period_seconds",
)


Expand Down
Loading