Ioda-converter for the [3D]-RTMA/URMA SATMAR BUFR Data

[PraveenKumar-NOAA]

Description

• Write a Python converter for the SATMAR BUFR DUMP that converts a BUFR file into an IODA file for the following subset(s):

| NC031001 | A61230 | 031-001 OCEANOGRAPHIC - BATHYTHERMAL |
| NC031002 | A61231 | 031-002 OCEANOGRAPHIC - TESAC |
| NC031003 | A61232 | 031-003 OCEANOGRAPHIC - TRACKOB |
| NC031004 | A50233 | 031-004 OCEANOGRAPHIC - AXBT |
| NC031005 | A50255 | 031-005 OCEANOGRAPHIC - SUBSURFACE FLOAT PROFILES (BUFR |
| NC031006 | A50180 | 031-006 OCEANOGRAPHIC - XBT/XCTD (TESAC) PROFILES (BUFR |
| NC031007 | A50181 | 031-007 OCEANOGRAPHIC - ALONG TRACK OBSERVATION (BUFR) |
| NC031008 | A50182 | 031-008 OCEANOGRAPHIC - MARINE MAMMAL PROFILES (BUFR) |
| NC031011 | A61240 | 031-011 NLSA ERS-2 ALTIMETER SSHA HIGH-RES REGIONAL |
| NC031012 | A61241 | 031-012 NLSA TOPEX ALTIMETER SSHA HIGH-RES REGIONAL |
| NC031013 | A61242 | 031-013 NLSA TOPEX ALTIMETER SSHA LOW-RES GLOBAL |
| NC031014 | A61243 | 031-014 NLSA GFO ALTIMETER SSHA HIGH-RES REGIONAL |
| NC031101 | A61235 | 031-101 NAVOCEANO ALPS ERS-2 ALTIMETER SSHA HI-RES GBL |
| NC031102 | A61236 | 031-102 NAVOCEANO ALPS GFO ALTIMETER SSHA HI-RES GBL |
| NC031103 | A61237 | 031-103 NAVOCEANO ALPS TOPEX ALTIMETER SSHA HI-RES GBL |
| NC031104 | A61238 | 031-104 NAVOCEANO ALPS JASON-1 ALTIMETR SSHA HI-RES GBL |
| NC031105 | A61239 | 031-105 NAVOCEANO GFO NAVY-IGDR ALTIMETER WIND/WAVE |
| NC031106 | A61165 | 031-106 CNES/AVISO JASON-1 IGDR ALTIMETER WIND/WAVE |
| NC031107 | A61164 | 031-107 NAVOCEANO GFO ALTIMETER WIND/WAVE FAST DELIVERY |
| NC031108 | A61159 | 031-108 NAVOCEANO ENVISAT ALTIMETR WIND/WAVE F DELIVERY |
| NC031109 | A61158 | 031-109 NAVOCEANO ALPS ENVISAT ALTIMTER SSHA HI-RES GBL |
| NC031110 | A61157 | 031-110 NAVOCEANO JASON-1 ALTMR WIND/WAVE FAST DELIVERY |
| NC031111 | A61138 | 031-111 CNES/NESDIS JASON-2 OGDR ALTMR WND/WAV H-RS GBL |
| NC031112 | A61115 | 031-112 NAVOCEANO ALPS JASON-2 OGDR ALTM SSHA H-RES GBL |
| NC031113 | A61116 | 031-113 NAVOCEANO ALPS JASON-2 IGDR ALTM SSHA H-RES GBL |
| NC031114 | A61117 | 031-114 NAVOCEANO JASON-2 ALTMR WIND/WAVE FAST DELIVERY |
| NC031115 | A61112 | 031-115 CNES/NESDIS JASON-2 OGDR ALTM SSHA W/W H-RS GBL |
| NC031116 | A61132 | 031-116 AVISO SSALTO/DUACS ENVISAT NRT ALTM SLA H-R GBL |
| NC031117 | A61065 | 031-117 NAVOCEANO ALPS CRYOSAT-2 IGDR ALTM SSHA H-R GBL |
| NC031118 | A61074 | 031-118 NAVOCEANO ALPS SARAL/ATK OGDR ALTM SSHA H-R GBL |
| NC031119 | A61075 | 031-119 NAVOCEANO ALPS SARAL/ATK IGDR ALTM SSHA H-R GBL |
| NC031120 | A61076 | 031-120 NAVOCEANO CRYOSAT-2 ALTMR WND/WAV FAST DELIVERY |
| NC031121 | A61091 | 031-121 NAVOCEANO SARAL/ATK ALTMR WND/WAV FAST DELIVERY |
| NC031122 | A61106 | 031-122 CNES SARAL/ALTK OGDR ALTM SSHA W/W H-RS GBL |
| NC031123 | A61107 | 031-123 CNES CRYOSAT-2 OGDR ALTM SSHA W/W H-RS GBL |
| NC031124 | A61108 | 031-124 CNES/NESDIS JASON-3 OGDR ALTM SSHA W/W H-RS GBL |
| NC031125 | A61031 | 031-125 NAVOCEANO ALPS JASON-3 OGDR ALTM SSHA H-RES GBL |
| NC031126 | A61032 | 031-126 NAVOCEANO ALPS JASON-3 IGDR ALTM SSHA H-RES GBL |
| NC031127 | A61033 | 031-127 NAVOCEANO JASON-3 ALTMR WIND/WAVE FAST DELIVERY |
| NC031128 | A61034 | 031-128 NAVOCEANO SENTINEL 3A NRT ALTM SSHA HI-RES GBL |
| NC031129 | A61035 | 031-129 NAVOCEANO SENTINEL 3A STC ALTM SSHA HI-RES GBL |
| NC031130 | A61008 | 031-130 NAVOCEANO SENTINEL 3A ALTM WND/WAV FAST DELIVER |
| NC031131 | A62010 | 031-131 NAVOCEANO SENTINEL 3B NRT ALTM SSHA HI-RES GBL |
| NC031132 | A62011 | 031-132 NAVOCEANO SENTINEL 3B STC ALTM SSHA HI-RES GBL |
| NC031133 | A60009 | 031-133 NAVOCEANO SENTINEL 3B ALTM WND/WAV FAST DELIVER |
| NC031134 | A60012 | 031-134 CNES SENTINEL 3A OGDR ALTM SSHA W/W H-RS GBL |
| NC031135 | A60013 | 031-135 CNES SENTINEL 3B OGDR ALTM SSHA W/W H-RS GBL |
| NC031136 | A60014 | 031-136 NAVOCEANO ALPS CRYOSAT-2 OGDR ALTM SSHA H-R GBL |
| NC031137 | A60015 | 031-137 NAVOCEANO SENTINEL 6A NRT ALTM SSHA HI-RES GBL |
| NC031138 | A60016 | 031-138 NAVOCEANO SENTINEL 6A STC ALTM SSHA HI-RES GBL |
| NC031139 | A60017 | 031-139 NAVOCEANO SENTINEL 6A ALTM WND/WAV FAST DELIVER |

• Identify all the subsets in SATMAR data
• Extract the BUFR table
• Create a list of BUFR Mnemonics/queries
• Write a YAML converter
• Write a Python converter
• Use YAML/ Python API to convert a BUFR file into an IODA-formatted netCDF file
• Ioda obs validation using ioda-validate.x
• Perform validation for the observations using the input BUFR and output IODA file

Requirements

• All important mnemonics required by the RRFS/ [3D]-RTMA users need to be known.

Acceptance Criteria (Definition of Done)

• It will be finished when all files have been checked and tests have passed.

Dependencies

• bufr2ioda.x

[PraveenKumar-NOAA]

The initial version of the IODA-converters YAML has been completed, and validation of the output IODA observations has been carried out using the NC031124/WSPA (wind speed data from the altimeter).

BUFR Plot:

IODA Plot:

[PraveenKumar-NOAA]

Validation of the output IODA observations for the brightness Temperature.

BUFR Plot:

IODA Plot:

[PraveenKumar-NOAA]

@MatthewMorris-NOAA, the YAML converter for the [3D]-URMA data is ready. However, there are numerous subsets within this data type, and I'm unsure which specific subsets or mnemonics are of interest to users. If you let me know which mnemonics you'd like to include, I can add them to the converter. Otherwise, the converter is ready with mnemonics for pressure, temperature, height, wind, etc.

Also, please review the validation plots, and I’ll submit a PR once you're satisfied with them.

[MatthewMorris-NOAA]

@PraveenKumar-NOAA The validation plots look reasonable to me. Admittedly, I'm not very familiar with the SATMAR data, so I'm unsure how to answer your questions regarding mnemonics. Perhaps we could have a quick meeting next week to discuss? Thanks!