Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Bugfixes for RRTMGP #1751

Conversation

dustinswales
Copy link
Collaborator

@dustinswales dustinswales commented May 11, 2023

Description

Top of commit queue on: TBD

Input data additions/changes

  • No changes are expected to input data.
  • There will be new input data.
  • Input data will be updated.

Anticipated changes to regression tests:

  • No changes are expected to any regression test.
  • Changes are expected to the following tests:

Subcomponents involved:

  • AQM
  • CDEPS
  • CICE
  • CMEPS
  • CMakeModules
  • FV3
  • GOCART
  • HYCOM
  • MOM6
  • NOAHMP
  • WW3
  • stochastic_physics
  • none

Combined with PR's (If Applicable):

Commit Queue Checklist:

  • Link PR's from all sub-components involved
  • Confirm reviews completed in sub-component PR's
  • Add all appropriate labels to this PR.
  • Run full RT suite on either Hera/Cheyenne with both Intel/GNU compilers
  • Add list of any failed regression tests to "Anticipated changes to regression tests" section.

Linked PR's and Issues:

NOAA-EMC #655
Fix to allow for threading in RRTMGP #70
Addresses UWM:ccpp-physics Issue #59

Testing Day Checklist:

  • This PR is up-to-date with the top of all sub-component repositories except for those sub-components which are the subject of this PR.
  • Move new/updated input data on RDHPCS Hera and propagate input data changes to all supported systems.

Testing Log (for CM's):

  • RDHPCS
    • Intel
      • Hera
      • Orion
      • Jet
      • Gaea
      • Cheyenne
    • GNU
      • Hera
      • Cheyenne
  • WCOSS2
    • Dogwood/Cactus
    • Acorn
  • CI
    • Completed
  • opnReqTest
    • N/A
    • Log attached to comment

@FernandoAndrade-NOAA
Copy link
Collaborator

Hi @dustinswales, could you sync with develop, link the FV3 sub PR, and provide any Hera intel/gnu or Cheyenne intel/gnu logs?

@dustinswales
Copy link
Collaborator Author

Hi @dustinswales, could you sync with develop, link the FV3 sub PR, and provide any Hera intel/gnu or Cheyenne intel/gnu logs?

Done. (No logs, I wiped them when updating, but tested on Cheyenne Intel)

@jkbk2004 jkbk2004 mentioned this pull request Jun 2, 2023
35 tasks
@FernandoAndrade-NOAA
Copy link
Collaborator

@dustinswales, #1743 was merged in, could you resync with develop and resolve conflicts? We can get started with jenkins-ci and ORTs following that.

@FernandoAndrade-NOAA FernandoAndrade-NOAA added the Baseline Updates Current baselines will be updated. label Jun 6, 2023
@FernandoAndrade-NOAA
Copy link
Collaborator

Hi @dustinswales, just checking in if you're ready to sync and resolve conflicts in order to proceed with testing this PR

@dustinswales
Copy link
Collaborator Author

@FernandoAndrade-NOAA sorry for the delay. I will sync in the coming hour

@zach1221 zach1221 added jenkins-ci Jenkins CI: ORT build/test on docker container Ready for Commit Queue The PR is ready for the Commit Queue. All checkboxes in PR template have been checked. labels Jun 7, 2023
This reverts commit 0f12deb.
@jkbk2004
Copy link
Collaborator

jkbk2004 commented Jun 7, 2023

Looks like all code changes only for check error messages. No baseline change and all tests pass on cheyenne. @dustinswales can we confirm?

@jkbk2004 jkbk2004 removed the Baseline Updates Current baselines will be updated. label Jun 7, 2023
@DeniseWorthen
Copy link
Collaborator

@jkbk2004 Were the RTs ever run for this PR? It seems that you are finding no change in baseline, but there was an expected change (in the PR description) that the control_p8_rrtmgp test would change. We don't know if it should or not because the pre-commit logs don't seem to have been posted.

@jkbk2004
Copy link
Collaborator

jkbk2004 commented Jun 7, 2023

Yeah, we need @dustinswales to confirm.

@dustinswales
Copy link
Collaborator Author

@jkbk2004 @DeniseWorthen
The RTs haven’t been run yet. I synced last week, and again last night. I thought that @FernandoAndrade-NOAA was initiating the testing?
(I’m not sure where that Cheyenne log came from in ea795b7)

@DeniseWorthen
Copy link
Collaborator

@dustinswales Thanks....I think my confusion is that you listed in the description that the baseline would change for control_p8_rrtmgp. Do you know for sure that is expected?

@dustinswales
Copy link
Collaborator Author

@DeniseWorthen Yes, the control_p8_rrtmgp should need new baselines, but now I'm nervous and rechecking on Cheyenne.

@dustinswales
Copy link
Collaborator Author

@DeniseWorthen @jkbk2004 I looks like I was mistaken. I just reran on Cheyenne and the baselines didn't change for the RRTMGP test, /glade/work/dswales/UFS/RRTMGP/ufs-weather-model/tests/logs/RegressionTests_cheyenne.log.

@FernandoAndrade-NOAA
Copy link
Collaborator

Attached are the jenkins ci logs from earlier, ORTs passed. @dustinswales I'd like to double check with you whether there are any baseline changes expected, including the control_p8_rrtmgp? Just making sure before I start up the full RTs. Thank you.
ufs-weather-model » ort-docker-pipeline » PR-1751 #1 Console [Jenkins].pdf

@jkbk2004
Copy link
Collaborator

jkbk2004 commented Jun 7, 2023

@BrianCurtis-NOAA FYI: on-going this pr with no baseline change

@dustinswales
Copy link
Collaborator Author

Attached are the jenkins ci logs from earlier, ORTs passed. @dustinswales I'd like to double check with you whether there are any baseline changes expected, including the control_p8_rrtmgp? Just making sure before I start up the full RTs. Thank you. ufs-weather-model » ort-docker-pipeline » PR-1751 #1 Console [Jenkins].pdf

@FernandoAndrade-NOAA Correct. No baseline changes.

@FernandoAndrade-NOAA FernandoAndrade-NOAA added the No Baseline Change No Baseline Change label Jun 7, 2023
@FernandoAndrade-NOAA FernandoAndrade-NOAA added hera-RT Run Hera regression testing cheyenne-RT labels Jun 7, 2023
@zach1221 zach1221 removed cheyenne-RT hera-RT Run Hera regression testing labels Jun 7, 2023
@FernandoAndrade-NOAA
Copy link
Collaborator

Sub FV3 PR #655 has been merged in. Please go ahead and update hash and gitmodules

@jkbk2004 jkbk2004 requested a review from zach1221 June 8, 2023 18:04
@FernandoAndrade-NOAA FernandoAndrade-NOAA merged commit 2f71156 into ufs-community:develop Jun 8, 2023
@dustinswales dustinswales deleted the bugfix_rrtmgp_threading branch January 6, 2025 22:24
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
jenkins-ci Jenkins CI: ORT build/test on docker container No Baseline Change No Baseline Change Ready for Commit Queue The PR is ready for the Commit Queue. All checkboxes in PR template have been checked.
Projects
None yet
Development

Successfully merging this pull request may close these issues.

7 participants