Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

New Driver script and intel config file for PR testing #2606

Merged
merged 1 commit into from
Apr 26, 2018

Conversation

prwolfe
Copy link
Contributor

@prwolfe prwolfe commented Apr 20, 2018

@trilinos/framework

Motivation and Context

Note that this will not yet enable the intel build as
the autotester does not yet have the configuration. It
just provides the files needed.

Related Issues

How Has This Been Tested?

I set up an autotesterinstance pointed at my fork and created a PR from this branch to develop on my fork. The results can be seen at prwolfe#2 and https://testing-vm.sandia.gov/cdash/index.php?project=Trilinos&filtercombine=and&filtercombine=and&filtercombine=and&filtercombine=and&filtercombine=and&filtercombine=and&filtercount=2&showfilters=1&filtercombine=and&field1=buildname&compare1=63&value1=PR-2-test&field2=buildstarttime&compare2=84&value2=NOW

@prwolfe prwolfe added the Framework tasks Framework tasks (used internally by Framework team) label Apr 20, 2018
@trilinos-autotester
Copy link
Contributor

Status Flag 'Pre-Test Inspection' - Auto Inspected - Inspection Is Not Necessary for this Pull Request.

@trilinos-autotester
Copy link
Contributor

Status Flag 'Pull Request AutoTester' - Testing Jenkins Projects:

Pull Request Auto Testing STARTING (click to expand)

Build Information

Test Name: Trilinos_pullrequest_gcc_4.9.3

  • Build Num: 526
  • Status: STARTED

Jenkins Parameters

Parameter Name Value
COMPILER_MODULE sems-gcc/4.9.3
JENKINS_BUILD_TYPE Release
JENKINS_COMM_TYPE MPI
JENKINS_DO_COMPLEX OFF
JENKINS_JOB_TYPE Experimental
MPI_MODULE sems-openmpi/1.8.7
PULLREQUESTNUM 2606
TEST_REPO_ALIAS TRILINOS
TRILINOS_SOURCE_BRANCH issue2463
TRILINOS_SOURCE_REPO https://github.com/prwolfe/Trilinos
TRILINOS_SOURCE_SHA a0b3bfd
TRILINOS_TARGET_BRANCH develop
TRILINOS_TARGET_REPO https://github.com/trilinos/Trilinos
TRILINOS_TARGET_SHA bcadfc6

Build Information

Test Name: Trilinos_pullrequest_gcc_4.8.4

  • Build Num: 243
  • Status: STARTED

Jenkins Parameters

Parameter Name Value
COMPILER_MODULE sems-gcc/4.8.4
JENKINS_BUILD_TYPE Release
JENKINS_COMM_TYPE MPI
JENKINS_DO_COMPLEX OFF
JENKINS_JOB_TYPE Experimental
MPI_MODULE sems-openmpi/1.8.7
PULLREQUESTNUM 2606
TEST_REPO_ALIAS TRILINOS
TRILINOS_SOURCE_BRANCH issue2463
TRILINOS_SOURCE_REPO https://github.com/prwolfe/Trilinos
TRILINOS_SOURCE_SHA a0b3bfd
TRILINOS_TARGET_BRANCH develop
TRILINOS_TARGET_REPO https://github.com/trilinos/Trilinos
TRILINOS_TARGET_SHA bcadfc6

Using Repos:

Repo: TRILINOS (prwolfe/Trilinos)
  • Branch: issue2463
  • SHA: a0b3bfd
  • Mode: TEST_REPO

Pull Request Author: prwolfe

Copy link
Member

@bartlettroscoe bartlettroscoe left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Why is the SCOTCH TPL not being enabled?

@trilinos-autotester
Copy link
Contributor

Status Flag 'Pull Request AutoTester' - Jenkins Testing: all Jobs PASSED

Pull Request Auto Testing has PASSED (click to expand)

Build Information

Test Name: Trilinos_pullrequest_gcc_4.9.3

  • Build Num: 526
  • Status: PASSED

Jenkins Parameters

Parameter Name Value
COMPILER_MODULE sems-gcc/4.9.3
JENKINS_BUILD_TYPE Release
JENKINS_COMM_TYPE MPI
JENKINS_DO_COMPLEX OFF
JENKINS_JOB_TYPE Experimental
MPI_MODULE sems-openmpi/1.8.7
PULLREQUESTNUM 2606
TEST_REPO_ALIAS TRILINOS
TRILINOS_SOURCE_BRANCH issue2463
TRILINOS_SOURCE_REPO https://github.com/prwolfe/Trilinos
TRILINOS_SOURCE_SHA a0b3bfd
TRILINOS_TARGET_BRANCH develop
TRILINOS_TARGET_REPO https://github.com/trilinos/Trilinos
TRILINOS_TARGET_SHA bcadfc6

Build Information

Test Name: Trilinos_pullrequest_gcc_4.8.4

  • Build Num: 243
  • Status: PASSED

Jenkins Parameters

Parameter Name Value
COMPILER_MODULE sems-gcc/4.8.4
JENKINS_BUILD_TYPE Release
JENKINS_COMM_TYPE MPI
JENKINS_DO_COMPLEX OFF
JENKINS_JOB_TYPE Experimental
MPI_MODULE sems-openmpi/1.8.7
PULLREQUESTNUM 2606
TEST_REPO_ALIAS TRILINOS
TRILINOS_SOURCE_BRANCH issue2463
TRILINOS_SOURCE_REPO https://github.com/prwolfe/Trilinos
TRILINOS_SOURCE_SHA a0b3bfd
TRILINOS_TARGET_BRANCH develop
TRILINOS_TARGET_REPO https://github.com/trilinos/Trilinos
TRILINOS_TARGET_SHA bcadfc6


CDash Test Results for PR# 2606.

@trilinos-autotester
Copy link
Contributor

Status Flag 'Pre-Merge Inspection' - - This Pull Request Requires Inspection... The code must be inspected by a member of the Team before Testing/Merging
THE LAST COMMIT TO THIS PULL REQUEST HAS BEEN REVIEWED, BUT NOT ACCEPTED OR REQUIRES CHANGES

@trilinos-autotester
Copy link
Contributor

All Jobs Finished; status = PASSED, However Inspection must be performed before merge can occur...

2 similar comments
@trilinos-autotester
Copy link
Contributor

All Jobs Finished; status = PASSED, However Inspection must be performed before merge can occur...

@trilinos-autotester
Copy link
Contributor

All Jobs Finished; status = PASSED, However Inspection must be performed before merge can occur...

@prwolfe
Copy link
Contributor Author

prwolfe commented Apr 23, 2018

@bartlettroscoe I did not see your request for scotch before I set this up. Sierra could use that as well, but since it doesn't run in the gcc PR builds I think we should have that as a follow-on discussion.

Copy link
Member

@jwillenbring jwillenbring left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

The PullRequestLinuxIntelTestingSettings.cmake file and PullRequestLinuxGCCTestingSettings.cmake files are identical. It seems we should have a single file and call it PullRequestLinuxTestingSettings.cmake. We may need a separate one for CUDA possibly, but we could start for now with a single file at least. If we can have a common file for all or most builds, that would be positive.

In the two remaining files there are references to gcc/GCC that should be changed to Intel.

Correction: The driver file just needs to point to the single combined file. There are not other references to GCC that need to be changed.

@bartlettroscoe
Copy link
Member

I think there needs to be a different *.cmake file for each specific build in order to allow setting targeted test disables for those builds. You have to be able to (temporarily) disable a test if needed. For example, it looks like the Intel 17.0.1 build needs some cleaning up (see #2463 (comment)). There would be almost no clean ATDM Trilinos builds if we required fixing every test before the build was promoted.

@trilinos-autotester
Copy link
Contributor

All Jobs Finished; status = PASSED, However Inspection must be performed before merge can occur...

@prwolfe
Copy link
Contributor Author

prwolfe commented Apr 24, 2018

@bartlettroscoe That is in fact a good part of why I had a second file. And those failures are why I didn't send in a pull request to enable this yet. All of those tests should be easy to clean up except possibly the kokkos one, so I would favor fixing rather than disabling.

@bartlettroscoe
Copy link
Member

@prwolfe, having a separate file for each build is good. Duplicating every var is not good. A system of *.cmake fragment files and includes, like demonstrated in the files:

Those outer files (which are just a few lines long) could be copied to GCC-4.8.4-PullRequestBuild.cmake and Intel-17.0.1-PullRequestBuild.cmake, respectively, and that should do it. Then you could add any extra tweaks you needed.

@trilinos-autotester
Copy link
Contributor

Status Flag 'Pre-Test Inspection' - Auto Inspected - Inspection Is Not Necessary for this Pull Request.

@trilinos-autotester
Copy link
Contributor

Status Flag 'Pull Request AutoTester' - Testing Jenkins Projects:

Pull Request Auto Testing STARTING (click to expand)

Build Information

Test Name: Trilinos_pullrequest_gcc_4.9.3

  • Build Num: 565
  • Status: STARTED

Jenkins Parameters

Parameter Name Value
COMPILER_MODULE sems-gcc/4.9.3
JENKINS_BUILD_TYPE Release
JENKINS_COMM_TYPE MPI
JENKINS_DO_COMPLEX OFF
JENKINS_JOB_TYPE Experimental
MPI_MODULE sems-openmpi/1.8.7
PULLREQUESTNUM 2606
TEST_REPO_ALIAS TRILINOS
TRILINOS_SOURCE_BRANCH issue2463
TRILINOS_SOURCE_REPO https://github.com/prwolfe/Trilinos
TRILINOS_SOURCE_SHA 9803a09
TRILINOS_TARGET_BRANCH develop
TRILINOS_TARGET_REPO https://github.com/trilinos/Trilinos
TRILINOS_TARGET_SHA 1b19c57

Build Information

Test Name: Trilinos_pullrequest_gcc_4.8.4

  • Build Num: 282
  • Status: STARTED

Jenkins Parameters

Parameter Name Value
COMPILER_MODULE sems-gcc/4.8.4
JENKINS_BUILD_TYPE Release
JENKINS_COMM_TYPE MPI
JENKINS_DO_COMPLEX OFF
JENKINS_JOB_TYPE Experimental
MPI_MODULE sems-openmpi/1.8.7
PULLREQUESTNUM 2606
TEST_REPO_ALIAS TRILINOS
TRILINOS_SOURCE_BRANCH issue2463
TRILINOS_SOURCE_REPO https://github.com/prwolfe/Trilinos
TRILINOS_SOURCE_SHA 9803a09
TRILINOS_TARGET_BRANCH develop
TRILINOS_TARGET_REPO https://github.com/trilinos/Trilinos
TRILINOS_TARGET_SHA 1b19c57

Using Repos:

Repo: TRILINOS (prwolfe/Trilinos)
  • Branch: issue2463
  • SHA: 9803a09
  • Mode: TEST_REPO

Pull Request Author: prwolfe

Copy link
Member

@jwillenbring jwillenbring left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

The comments/usage at the top of the testing env script still refer to GCC. There is also a variable set:

+export SEMS_FORCE_LOCAL_COMPILER_VERSION=4.9.3

is this the correct value for the Intel build?

@prwolfe
Copy link
Contributor Author

prwolfe commented Apr 25, 2018

The variable was an attempt on my part to get the sims modules to load without the error. Turns out that despite referencing this the intel module then ignores it and hard code 4.8.4 as the default so we alway s get the warning message. I will get it out of the script and clean up the comments.

@trilinos-autotester
Copy link
Contributor

Status Flag 'Pull Request AutoTester' - Jenkins Testing: all Jobs PASSED

Pull Request Auto Testing has PASSED (click to expand)

Build Information

Test Name: Trilinos_pullrequest_gcc_4.9.3

  • Build Num: 565
  • Status: PASSED

Jenkins Parameters

Parameter Name Value
COMPILER_MODULE sems-gcc/4.9.3
JENKINS_BUILD_TYPE Release
JENKINS_COMM_TYPE MPI
JENKINS_DO_COMPLEX OFF
JENKINS_JOB_TYPE Experimental
MPI_MODULE sems-openmpi/1.8.7
PULLREQUESTNUM 2606
TEST_REPO_ALIAS TRILINOS
TRILINOS_SOURCE_BRANCH issue2463
TRILINOS_SOURCE_REPO https://github.com/prwolfe/Trilinos
TRILINOS_SOURCE_SHA 9803a09
TRILINOS_TARGET_BRANCH develop
TRILINOS_TARGET_REPO https://github.com/trilinos/Trilinos
TRILINOS_TARGET_SHA 1b19c57

Build Information

Test Name: Trilinos_pullrequest_gcc_4.8.4

  • Build Num: 282
  • Status: PASSED

Jenkins Parameters

Parameter Name Value
COMPILER_MODULE sems-gcc/4.8.4
JENKINS_BUILD_TYPE Release
JENKINS_COMM_TYPE MPI
JENKINS_DO_COMPLEX OFF
JENKINS_JOB_TYPE Experimental
MPI_MODULE sems-openmpi/1.8.7
PULLREQUESTNUM 2606
TEST_REPO_ALIAS TRILINOS
TRILINOS_SOURCE_BRANCH issue2463
TRILINOS_SOURCE_REPO https://github.com/prwolfe/Trilinos
TRILINOS_SOURCE_SHA 9803a09
TRILINOS_TARGET_BRANCH develop
TRILINOS_TARGET_REPO https://github.com/trilinos/Trilinos
TRILINOS_TARGET_SHA 1b19c57


CDash Test Results for PR# 2606.

@trilinos-autotester
Copy link
Contributor

Status Flag 'Pre-Merge Inspection' - - This Pull Request Requires Inspection... The code must be inspected by a member of the Team before Testing/Merging
THE LAST COMMIT TO THIS PULL REQUEST HAS BEEN REVIEWED, BUT NOT ACCEPTED OR REQUIRES CHANGES

@trilinos-autotester
Copy link
Contributor

All Jobs Finished; status = PASSED, However Inspection must be performed before merge can occur...

Note that this will not yet enable the intel build as
the autotester does not yet have the configuration. It
just provides the files needed.
@prwolfe
Copy link
Contributor Author

prwolfe commented Apr 26, 2018

@jwillenbring - I fixed up that environment script. I will take a look at the failing tests. I don't want to turn this on without those resolved.

@trilinos-autotester
Copy link
Contributor

Status Flag 'Pre-Test Inspection' - Auto Inspected - Inspection Is Not Necessary for this Pull Request.

@trilinos-autotester
Copy link
Contributor

Status Flag 'Pull Request AutoTester' - Testing Jenkins Projects:

Pull Request Auto Testing STARTING (click to expand)

Build Information

Test Name: Trilinos_pullrequest_gcc_4.9.3

  • Build Num: 575
  • Status: STARTED

Jenkins Parameters

Parameter Name Value
COMPILER_MODULE sems-gcc/4.9.3
JENKINS_BUILD_TYPE Release
JENKINS_COMM_TYPE MPI
JENKINS_DO_COMPLEX OFF
JENKINS_JOB_TYPE Experimental
MPI_MODULE sems-openmpi/1.8.7
PULLREQUESTNUM 2606
TEST_REPO_ALIAS TRILINOS
TRILINOS_SOURCE_BRANCH issue2463
TRILINOS_SOURCE_REPO https://github.com/prwolfe/Trilinos
TRILINOS_SOURCE_SHA c439f3d
TRILINOS_TARGET_BRANCH develop
TRILINOS_TARGET_REPO https://github.com/trilinos/Trilinos
TRILINOS_TARGET_SHA 19583a6

Build Information

Test Name: Trilinos_pullrequest_gcc_4.8.4

  • Build Num: 292
  • Status: STARTED

Jenkins Parameters

Parameter Name Value
COMPILER_MODULE sems-gcc/4.8.4
JENKINS_BUILD_TYPE Release
JENKINS_COMM_TYPE MPI
JENKINS_DO_COMPLEX OFF
JENKINS_JOB_TYPE Experimental
MPI_MODULE sems-openmpi/1.8.7
PULLREQUESTNUM 2606
TEST_REPO_ALIAS TRILINOS
TRILINOS_SOURCE_BRANCH issue2463
TRILINOS_SOURCE_REPO https://github.com/prwolfe/Trilinos
TRILINOS_SOURCE_SHA c439f3d
TRILINOS_TARGET_BRANCH develop
TRILINOS_TARGET_REPO https://github.com/trilinos/Trilinos
TRILINOS_TARGET_SHA 19583a6

Using Repos:

Repo: TRILINOS (prwolfe/Trilinos)
  • Branch: issue2463
  • SHA: c439f3d
  • Mode: TEST_REPO

Pull Request Author: prwolfe

@trilinos-autotester
Copy link
Contributor

Status Flag 'Pull Request AutoTester' - Jenkins Testing: all Jobs PASSED

Pull Request Auto Testing has PASSED (click to expand)

Build Information

Test Name: Trilinos_pullrequest_gcc_4.9.3

  • Build Num: 575
  • Status: PASSED

Jenkins Parameters

Parameter Name Value
COMPILER_MODULE sems-gcc/4.9.3
JENKINS_BUILD_TYPE Release
JENKINS_COMM_TYPE MPI
JENKINS_DO_COMPLEX OFF
JENKINS_JOB_TYPE Experimental
MPI_MODULE sems-openmpi/1.8.7
PULLREQUESTNUM 2606
TEST_REPO_ALIAS TRILINOS
TRILINOS_SOURCE_BRANCH issue2463
TRILINOS_SOURCE_REPO https://github.com/prwolfe/Trilinos
TRILINOS_SOURCE_SHA c439f3d
TRILINOS_TARGET_BRANCH develop
TRILINOS_TARGET_REPO https://github.com/trilinos/Trilinos
TRILINOS_TARGET_SHA 19583a6

Build Information

Test Name: Trilinos_pullrequest_gcc_4.8.4

  • Build Num: 292
  • Status: PASSED

Jenkins Parameters

Parameter Name Value
COMPILER_MODULE sems-gcc/4.8.4
JENKINS_BUILD_TYPE Release
JENKINS_COMM_TYPE MPI
JENKINS_DO_COMPLEX OFF
JENKINS_JOB_TYPE Experimental
MPI_MODULE sems-openmpi/1.8.7
PULLREQUESTNUM 2606
TEST_REPO_ALIAS TRILINOS
TRILINOS_SOURCE_BRANCH issue2463
TRILINOS_SOURCE_REPO https://github.com/prwolfe/Trilinos
TRILINOS_SOURCE_SHA c439f3d
TRILINOS_TARGET_BRANCH develop
TRILINOS_TARGET_REPO https://github.com/trilinos/Trilinos
TRILINOS_TARGET_SHA 19583a6


CDash Test Results for PR# 2606.

@trilinos-autotester
Copy link
Contributor

Status Flag 'Pre-Merge Inspection' - - This Pull Request Requires Inspection... The code must be inspected by a member of the Team before Testing/Merging
THE LAST COMMIT TO THIS PULL REQUEST HAS NOT BEEN REVIEWED YET!

@trilinos-autotester
Copy link
Contributor

All Jobs Finished; status = PASSED, However Inspection must be performed before merge can occur...

Copy link
Member

@jwillenbring jwillenbring left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks for making those small changes. I think this looks good enough to move forward with. I am excited to get most of the Jenkins scripting into the repo.

@trilinos-autotester
Copy link
Contributor

Status Flag 'Pre-Merge Inspection' - SUCCESS: The last commit to this Pull Request has been INSPECTED AND APPROVED by [ jwillenbring ]!

@trilinos-autotester
Copy link
Contributor

Status Flag 'Pull Request AutoTester' - Pull Request MUST BE MERGED MANUALLY BY Project Team - Master Automerge is disabled (in .cfg file)

@prwolfe prwolfe merged commit 34292a1 into trilinos:develop Apr 26, 2018
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Framework tasks Framework tasks (used internally by Framework team)
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants