Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Remove PIO as part of S2S model build in CMEPS and use hpc-stack #199

Merged
merged 5 commits into from
Sep 30, 2020
Merged

Remove PIO as part of S2S model build in CMEPS and use hpc-stack #199

merged 5 commits into from
Sep 30, 2020

Conversation

aerorahul
Copy link
Contributor

@aerorahul aerorahul commented Sep 28, 2020

Description of changes

This PR:

  • loads the module pio/2.5.1 from hpc-stack
  • removes the building of Parallel IO within CMEPS

Specific notes

Issues Fixed (include github issue #):
closes #197

Are changes expected to change answers?

  • bit for bit (yes/no)
  • more substantial (yes/no)

Specific changes:

  • changes in module files: YES

Testing performed:

  • machines:
  • details:

Hashes used for testing:

Co-authored by:

Associated PRs:

CMEPS PR #16
#199

@JessicaMeixner-NOAA
Copy link
Collaborator

@arunchawla-NOAA didn't you request that PIO was built internally to CMEPS and not as an external library for ease of code delivery, as @rsdunlapiv mentioned in the issue #197

@arunchawla-NOAA
Copy link
Collaborator

Yes, we initially planned to have pio built as part of the model, but since pio is going to be used in multiple softwares we will get it installed as a library and have it included in WCOSS and RDHPCS

@junwang-noaa
Copy link
Collaborator

@aerorahul, we just had an s2s commit, would you please merge with the latest s2s, then we can run RT?

@aerorahul aerorahul marked this pull request as ready for review September 29, 2020 18:44
@binli2337
Copy link
Collaborator

@aerorahul, The regression tests have been run on Hera, Orion and WCOSS Dell 3. The log files are located at /scratch1/NCEPDEV/nems/Bin.Li/S2S/update/log_files_PR199.

@aerorahul
Copy link
Contributor Author

@aerorahul, The regression tests have been run on Hera, Orion and WCOSS Dell 3. The log files are located at /scratch1/NCEPDEV/nems/Bin.Li/S2S/update/log_files_PR199.

@binli2337
I cannot copy Orion logs.

1001 hfe01 ~ $ l /scratch1/NCEPDEV/nems/Bin.Li/S2S/update/log_files_PR199/*_orion.intel.log
total 20032
-rw-r----- 1 Bin.Li nems 6656036 Sep 30 06:33 Compile_orion.intel.log
-rw-r----- 1 Bin.Li nems   34686 Sep 30 06:33 RegressionTests_orion.intel.log

@binli2337
Copy link
Collaborator

@aerorahul Please try again. Thanks!

@aerorahul
Copy link
Contributor Author

@aerorahul Please try again. Thanks!

that worked. thanks @binli2337
Logs have been updated.

@binli2337 binli2337 merged commit 17b9668 into ufs-community:develop Sep 30, 2020
@@ -16,8 +16,8 @@
branch = master
[submodule "CMEPS"]
path = CMEPS
url = https://github.com/NOAA-EMC/CMEPS.git
branch = emc/develop
url = https://github.com/aerorahul/CMEPS.git
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Sorry if I missed something, is it intentional to point to @aerorahul's CMEPS repo in the merged version of the code?

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

No. not intentional.

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

There is a PR in CMEPS. NOAA-EMC/CMEPS#16
Are they waiting for that one to merge?
I don't know how this works across repos.

Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

sorry I missed that merge. It is ready now.

Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Usually it works the other way round, from bottom (innermost nested submodule) to top. Someone merges cmeps, you update your submodule pointer in your ufs-s2s-model PR to point back to the (now merged) official cmeps repo, then merge ufs-s2s-model.

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@climbfuji
What do you want me to do now?
Should I open another PR in ufs-s2s-model with the updated .gitmodules and the submodule pointer?

Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@aerorahul Please submit a new PR. Thanks!

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

New PR issued. See #205

@aerorahul aerorahul deleted the feature/no-pio branch October 1, 2020 13:21
MinsukJi-NOAA pushed a commit to MinsukJi-NOAA/ufs-s2s-model that referenced this pull request Oct 7, 2020
* Use hpc-stack libraries in ufs-s2s-model (ufs-community#191)

* Update .gitmodules and submodule pointer for fv3atm for PR ufs-community#157 (RRTMG cloud overlap method update) (ufs-community#193)

* Bugfix/wave1dtest (ufs-community#195)

* fix MOM6 input template used by the cpld_fv3_ccpp_384_mom6_cice_cmeps_ww3_1d_bmark_rt test

* Remove PIO as part of S2S model build in CMEPS and use hpc-stack (ufs-community#199)

* update CMEPS submodule pointer (ufs-community#205)

* Merge with upstream and fix conflicts

Co-authored-by: BinLi-NOAA <[email protected]>
Co-authored-by: Dom Heinzeller <[email protected]>
Co-authored-by: Denise Worthen <[email protected]>
Co-authored-by: Rahul Mahajan <[email protected]>
ShanSunNOAA pushed a commit to ShanSunNOAA/ufs-s2s-model that referenced this pull request Oct 28, 2020
* update to latest WW3, 
* update to latest NEMS and stochastic physics branches
* point to new baseline in rt.sh
* wcoss_dell_p3 log, wcoss_cray log, hera.intel log,* orion.intel log
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Load PIO as an external dependency.
7 participants