test failures compiling 12.12.1 w/ intel compilers 2018.1

[nolta]

Description

I'm getting the following test failures with trilinos 12.12.1 compiled with the intel 2018.1 compilers on
a skylake box running centos 7.4:

$ ctest -j40
...
The following tests FAILED:
	1188 - Belos_resolve_gmres_hb_1_MPI_4 (Failed)
	1800 - NOX_Thyra_Heq_MPI_1 (Failed)
	2043 - Stokhos_TpetraCrsMatrixUQPCEUnitTest_Serial_MPI_4 (Failed)
	2050 - Stokhos_TpetraCrsMatrixMPVectorUnitTest_Serial_MPI_4 (Failed)
	2217 - Piro_MatrixFreeDecorator_UnitTests_MPI_4 (Failed)

Output of ctest -VV here: https://gist.github.com/nolta/b18e12c79fb7f7a93937a33060229849

Not sure if these are known issues, or intel compiler bugs, or a misconfigured build.

Steps to Reproduce

Your Environment

• Relevant repo SHA1s/versions: Trilinos 12.12.1
• Relevant configure flags or configure script:

cmake .. -DCMAKE_INSTALL_PREFIX="$prefix" \
    -DBLAS_LIBRARY_DIRS="$MKLROOT/lib/intel64" \
    -DBLAS_LIBRARY_NAMES="mkl_rt" \
    -DBUILD_SHARED_LIBS=ON \
    -DBoostLib_INCLUDE_DIRS="$BOOST_ROOT/include" \
    -DBoostLib_LIBRARY_DIRS="$BOOST_ROOT/lib" \
    -DBoost_INCLUDE_DIRS="$BOOST_ROOT/include" \
    -DCMAKE_CXX_FLAGS="-march=native" \
    -DHDF5_INCLUDE_DIRS="$HDF5_MPI_ROOT/include" \
    -DHDF5_LIBRARY_DIRS="$HDF5_MPI_ROOT/lib" \
    -DLAPACK_LIBRARY_DIRS="$MKLROOT/lib/intel64" \
    -DLAPACK_LIBRARY_NAMES="mkl_rt" \
    -DMKL_INCLUDE_DIRS="$MKLROOT/include" \
    -DMKL_LIBRARY_DIRS="$MKLROOT/lib/intel64" \
    -DMKL_LIBRARY_NAMES="mkl_rt" \
    -DNetcdf_INCLUDE_DIRS="$NETCDF_MPI_ROOT/include" \
    -DNetcdf_LIBRARY_DIRS="$NETCDF_MPI_ROOT/lib" \
    -DTPL_ENABLE_HDF5=ON \
    -DTPL_ENABLE_MKL=ON \
    -DTPL_ENABLE_MPI=ON \
    -DTrilinos_ENABLE_ALL_PACKAGES=ON \
    -DTrilinos_ENABLE_EXPLICIT_INSTANTIATION=ON \
    -DTrilinos_ENABLE_SECONDARY_TESTED_CODE=OFF \
    -DTrilinos_ENABLE_TESTS=ON

• Operating system and version: Centos 7.4 / Skylake Xeon
• Compiler and TPL versions:
  • intel 2018.1 compilers, MKL, & MPI
  • boost 1.66.0
  • hdf5 1.8.20
  • netcdf 4.6.0

Related Issues

• The NOX_Thyra_Heq_MPI_1 failure appears to be Test NOX_Thyra_Heq_MPI_1 failing in new Trilinos-atdm-hansen-shiller-intel-opt-serial and XXX-openmp builds #2247.
• Belos_resolve_gmres_hb_1_MPI_4 and Piro_MatrixFreeDecorator_UnitTests_MPI_4 failed in KokkosCore_UnitTest_[OpenMP|Serial]_MPI_1 tests fail in most of the GNU and Intel builds on hansen/shiller #2320 (comment).
• Stokhos_TpetraCrsMatrixUQPCEUnitTest_Serial_MPI_4 may be Test Stokhos_TpetraCrsMatrixUQPCEUnitTest_Serial[_MPI_4] fails standard CI build and several other builds including the ATDM build Trilinos-atdm-sems-gcc-7-2-0 #2254.

[mhoemmen]

Trilinos 12.12 is at least three years old. Have you tried the latest version of Trilinos, in the master branch?

[github-actions]

This issue has had no activity for 365 days and is marked for closure. It will be closed after an additional 30 days of inactivity.
If you would like to keep this issue open please add a comment and/or remove the MARKED_FOR_CLOSURE label.
If this issue should be kept open even with no activity beyond the time limits you can add the label DO_NOT_AUTOCLOSE.
If it is ok for this issue to be closed, feel free to go ahead and close it. Please do not add any comments or change any labels or otherwise touch this issue unless your intention is to reset the inactivity counter for an additional year.

[github-actions]

This issue was closed due to inactivity for 395 days.