Intrepid2 unit tests failing in new ATDM 'release-debug' builds on 'waterman'

[fryeguy52]

CC: @trilinos/intrepid2 , @mperego (Trilinos Discretizations Product Lead), @bartlettroscoe

Next Action Status

PR #3688 merged on 10/21/2018 resulted in all these Intrepid2 tests newly passing on 10/22/2018.

Description

As shown in this query the tests:

• Intrepid2_unit-test_Discretization_Basis_HDIV_TET_In_FEM_Serial_Test_01_SLFadDouble_MPI_1
• Intrepid2_unit-test_Discretization_Basis_HDIV_TET_In_FEM_Serial_Test_01_SLFadDFad_MPI_1
• Intrepid2_unit-test_Discretization_Basis_HDIV_TET_In_FEM_Serial_Test_01_SFadSFad_MPI_1
• Intrepid2_unit-test_Discretization_Basis_HDIV_TET_In_FEM_Serial_Test_01_MPI_1
• Intrepid2_unit-test_Discretization_Basis_HDIV_TET_In_FEM_Cuda_Test_01_SFadSFad_MPI_1
• Intrepid2_unit-test_Discretization_Basis_HDIV_TET_In_FEM_Cuda_Test_01_MPI_1
• Intrepid2_unit-test_Discretization_Basis_HDIV_TET_In_FEM_Cuda_Test_01_DFadDFad_MPI_1

are failing in the builds:

• Trilinos-atdm-waterman-cuda-9.2-release-debug
• Trilinos-atdm-waterman-gnu-release-debug-openmp

Steps to Reproduce

One should be able to reproduce this failure on waterman as described in:

• https://github.com/trilinos/Trilinos/blob/develop/cmake/std/atdm/README.md
  More specifically, the commands given for waterman are provided at:
• https://github.com/trilinos/Trilinos/blob/develop/cmake/std/atdm/README.md#waterman
  The exact commands to reproduce this issue should be:

$ cd <some_build_dir>/

$ source $TRILINOS_DIR/cmake/std/atdm/load-env.sh cuda-9.2-release-debug

$ cmake \
  -GNinja \
  -DTrilinos_CONFIGURE_OPTIONS_FILE:STRING=cmake/std/atdm/ATDMDevEnv.cmake \
  -DTrilinos_ENABLE_TESTS=ON -DTrilinos_ENABLE_Intrepid2=ON \
  $TRILINOS_DIR

$ make NP=20

$ bsub -x -Is -n 20 ctest -j20

[mperego]

@fryeguy52 thanks. I'll try to fix them soon. I think it is just a matter of tolerances being too tight.

[bartlettroscoe]

After the merge of PR #3688 yesterday, we are seeing these Intrepid2 tests newly passing in these builds today.

As shown here , the 7 failing Intrepid2 tests for the build Trilinos-atdm-waterman-cuda-9.2-release-debug described in this Issue have bee fixed as of today (see the -7 subscript and +7 superscript for the number of failing and passing tests for Intrepid, respectfully). And you can see the newly passing Intrepid2 tests for this build here.

And we see 5 Intrepid2 tests newly passing today for the build Trilinos-atdm-waterman-gnu-release-debug-openmp here and here.

Closing as complete.