-
Notifications
You must be signed in to change notification settings - Fork 579
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Ifpack2: Ifpack2_BlockTriDiContainerUnitAndPerfTests_MPI_4 test fails in serial build with intel/19 on SKX #10207
Comments
This test is also failing with newer intel compilers, recently tested with intel-oneapi/2021.4.0 on Blake testbed (SKX arch)
|
@ndellingwood Could you please post a minimal cmake script, thanks? |
@jhux2 here's a configuration on Blake that should reproduce: module purge
module load intel/oneAPI/hpc-toolkit/2021.4.0 intel/oneAPI/base-toolkit/2021.4.0 openmpi/4.0.5/intel-oneapi/2021.4.0 cmake/3.22.2
module swap gcc/7.2.0 gcc/10.2.0
module load openblas/0.3.21/gcc/10.2.0
export OMPI_CXX="icpc"
export OMPI_CC="icc"
export OMPI_FC="ifort"
export OMPI_F77="ifort"
export OMPI_F90="ifort"
cmake \
-D CMAKE_INSTALL_PREFIX="${TRILINOS_INSTALL_DIR}" \
-D CMAKE_CXX_STANDARD="17" \
-D CMAKE_CXX_FLAGS="-g" \
-D CMAKE_Fortran_COMPILER="mpif77" \
-D CMAKE_BUILD_TYPE=DEBUG \
\
-D TPL_ENABLE_MPI=ON \
-D MPI_EXEC_POST_NUMPROCS_FLAGS:STRING="-bind-to;socket;-map-by;socket" \
\
-D TPL_ENABLE_BLAS:STRING=ON \
-D BLAS_LIBRARY_DIRS:FILEPATH=${BLAS_ROOT}/lib \
-D BLAS_LIBRARY_NAMES:STRING="openblas" \
-D TPL_ENABLE_LAPACK:STRING=ON \
-D LAPACK_INCLUDE_DIRS:FILEPATH="${LAPACK_ROOT}/include" \
-D LAPACK_LIBRARY_DIRS:FILEPATH=${LAPACK_ROOT}/lib \
-D LAPACK_LIBRARY_NAMES:STRING="openblas" \
\
-D Trilinos_ENABLE_TESTS=ON \
-D Trilinos_ENABLE_EXAMPLES=ON \
-D Trilinos_ENABLE_COMPLEX=ON \
\
-D Trilinos_ENABLE_Ifpack2=ON \
-D Ifpack2_ENABLE_TESTS=ON \
-D Trilinos_ENABLE_Kokkos=ON \
-D Kokkos_ENABLE_SERIAL=ON \
-D Kokkos_ARCH_SKX=ON \
-D Trilinos_ENABLE_KokkosKernels=ON \
$TRILINOS_DIR |
I'm able to reproduce. I rebuilt with the system blas rather than openblas, given there have been other problems reported in builds that use openblas. In the build with the system blas, the test fails in the same way as with openblas. (This isn't too surprising, since OpenMP isn't being used.) |
This issue is still present with newer versions of intel as well with SKX arch (e.g. intel/2021.4, see #11969) |
This issue has had no activity for 365 days and is marked for closure. It will be closed after an additional 30 days of inactivity. |
I'll rerun with intel/2023.2.0 on Blake to see if this is still present with newer versions of intel |
Bug Report
@trilinos/ifpack2
Description
The ifpack2 unit test
Ifpack2_BlockTriDiContainerUnitAndPerfTests_MPI_4
fails in serial builds with intel/19 on SKX architecture in the sub-testIfpack2BlockTriDi_std_complex0double0_int_longlong_Unit_UnitTest
Output snip (collapsible):
Summary
Steps to Reproduce
SHA1: 55d7185
This can be reproduced on the Blake testbed in a serial build with complex types enabled and specifying Skylake architecture with the option
-DKokkos_ARCH_SKX=ON
.Modules:
The text was updated successfully, but these errors were encountered: