Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

GFSv16.3.18 - increase wait time for UKmet data in WAFS blending job #2923

Closed
KateFriedman-NOAA opened this issue Sep 16, 2024 · 6 comments
Closed
Assignees
Labels
production update Processing update in production

Comments

@KateFriedman-NOAA
Copy link
Member

Description

From RFC memo:

RFC 13236 - On WCOSS2, upgrade the GFS to v16.3.18. The
jgfs_atmos_wafs_blending_0p25 jobs have been unable to consistently send out
blended (UKMet and GFS) products due to late arriving data from UKMet. This
upgrade changes the maximum wait time for UKmet input data from 900 seconds
to 1500 seconds so the jobs can process more late arriving data. To be
implemented on Cactus and Dogwood on September 17 from 1330Z to 1430Z.

Target version

v16.3.18

Expected workflow changes

Update WAFS job script and GFS version

@KateFriedman-NOAA KateFriedman-NOAA added the production update Processing update in production label Sep 16, 2024
@KateFriedman-NOAA KateFriedman-NOAA self-assigned this Sep 16, 2024
@KateFriedman-NOAA
Copy link
Member Author

Actual diffs:

kate.friedman@clogin05:/lfs/h1/ops/para/packages/gfs.v16.3.18> diff ../../../prod/packages/gfs.v16.3.17/jobs/JGFS_ATMOS_WAFS_BLENDING_0P25 jobs/JGFS_ATMOS_WAFS_BLENDING_0P25
54a55
> 
95,97c96,97
< # export SLEEP_TIME=300   # changed to 60 to avoid hitting wall_clock when miss umket wafs files ... 
< # JY -0129: export SLEEP_TIME=600
< export SLEEP_TIME=900
---
> # Increase SLEEP_TIME from 900 for late UKMET data.
> export SLEEP_TIME=1500
kate.friedman@clogin05:/lfs/h1/ops/para/packages/gfs.v16.3.18> diff ../../../prod/packages/gfs.v16.3.17/scripts/exgfs_atmos_wafs_blending_0p25.sh scripts/exgfs_atmos_wafs_blending_0p25.sh
73c73,74
<           echo "UK WAFS GRIB2 file  $COMINuk/EGRR_WAFS_0p25_*_unblended_${PDY}_${cyc}z_t${ffhr}.grib2  not found"
---
>           echo "UK WAFS GRIB2 file  $COMINuk/EGRR_WAFS_0p25_*_unblended_${PDY}_${cyc}z_t${ffhr}.grib2  not found" 
>           echo "One or more UK WAFS GRIB2 file  $COMINuk/EGRR_WAFS_0p25_*_unblended_${PDY}_${cyc}z_t${ffhr}.grib2 not found. Skipping f${ffhr}..."  >> UK_missing
154c155
<              export maillist=${maillist:-'[email protected],[email protected]'}
---
>              export maillist=${maillist:-'[email protected],[email protected],[email protected]'}
163c164
<              cat $COMOUT/${RUN}.t${cyc}z.wafs_blend_0p25_usonly.emailbody | mail.py -s "$subject" $maillist -v
---
> #             cat $COMOUT/${RUN}.t${cyc}z.wafs_blend_0p25_usonly.emailbody | mail.py -s "$subject" $maillist -v
294a296,314
> 
> if [ -s UK_missing ]; then
>   if [ $envir != prod ]; then
>      export maillist='[email protected]'
>   fi
>   export maillist=${maillist:-'[email protected],[email protected],[email protected]'}
>   export subject="WARNING! No UK WAFS GRIB2 0P25 file for WAFS blending, $PDY t${cyc}z $job"
>   echo "*************************************************************" > mailmsg
>   echo "*** WARNING! No UK WAFS GRIB2 0P25 file for WAFS blending ***" >> mailmsg
>   echo "*************************************************************" >> mailmsg
>   echo >> mailmsg
>   echo "Send alert message to AWC ...... " >> mailmsg
>   echo >> mailmsg
>   cat UK_missing >> mailmsg
>   cat mailmsg > $COMOUT/${RUN}.t${cyc}z.wafs_blend_0p25_usonly.emailbody
>   cat $COMOUT/${RUN}.t${cyc}z.wafs_blend_0p25_usonly.emailbody | mail.py -s "$subject" $maillis
> t -v
> 
> fi

@KateFriedman-NOAA
Copy link
Member Author

@YaliMao-NOAA Would you mind cutting me a WAFS tag with the above edits before making a tag for the separation?

KateFriedman-NOAA added a commit to KateFriedman-NOAA/global-workflow that referenced this issue Sep 16, 2024
Also update gfs_ver to v16.3.18

Refs NOAA-EMC#2923
@KateFriedman-NOAA
Copy link
Member Author

@YaliMao-NOAA To help not slow down the release tag for the WAFS separation, I went ahead and made a fork branch with the wait time changes, sent a PR into the WAFS implementation branch, and cut a new tag (gfs_wafs.v6.3.3). I will now use this new tag in the release branch for this issue so it's documented fully.

KateFriedman-NOAA added a commit to KateFriedman-NOAA/global-workflow that referenced this issue Sep 16, 2024
KateFriedman-NOAA added a commit that referenced this issue Sep 16, 2024
… blending job (#2924)

Update the wait time for UKMet data in the scripts for the WAFS blending_0p25 job.
Error handling is also updated for late arriving UKMet data. 
Changes were provided by NCO. A new tag was made in the WAFS repo.

Refs #2923
@YaliMao-NOAA
Copy link
Contributor

@KateFriedman-NOAA Sorry I was editing WAFS release note and didn't catch your messages promptly. I saw you already created a new tag. Thank you!

KateFriedman-NOAA added a commit that referenced this issue Sep 17, 2024
…ing_0p25 job (#2933)

The GFS is updated to v16.3.18 in operations to update the wait time for
UKMet data in the WAFS blending_0p25 job. Error handling is also updated
for late arriving UKMet data. Changes were provided by NCO. A new tag
was made in the WAFS repo.

Refs #2923
@KateFriedman-NOAA
Copy link
Member Author

Tag cut and released: https://github.com/NOAA-EMC/global-workflow/releases/tag/gfs.v16.3.18

Announced to users. Closing issue as complete.

@KateFriedman-NOAA
Copy link
Member Author

This change in ops resolved Bugzilla 1593

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
production update Processing update in production
Projects
None yet
Development

No branches or pull requests

2 participants