Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

ATDM Trilinos configure broken on all CTS-1 and TLCC-2 platforms starting 2020-03-28 #7094

Closed
bartlettroscoe opened this issue Mar 30, 2020 · 2 comments
Labels
ATDM Env Issue Issue with ATDM build or test caused (at least partly) by the env, not a bug in Trilinos ATDM Sev: Critical Problems that critically damage ability to run ATDM Trilinos builds much less allow APP updates client: ATDM Any issue primarily impacting the ATDM project impacting: configure or build The issue is primarily related to configuring or building type: bug The primary issue is a bug in Trilinos code or tests

Comments

@bartlettroscoe
Copy link
Member

Next Action Status

???

Description

As shown in this query all of the builds on 'cts1' and 'tlcc2' platforms have had configure failures starting 2028-03-28. The configure failures show:

-- The C compiler identification is Intel 19.0.5.20190815
-- Check for working C compiler: /opt/openmpi/4.0/intel/bin/mpicc
-- Check for working C compiler: /opt/openmpi/4.0/intel/bin/mpicc -- broken
CMake Error at /projects/cmake/toss3/3.12.2/share/cmake-3.12/Modules/CMakeTestCCompiler.cmake:52 (message):
  The C compiler

    "/opt/openmpi/4.0/intel/bin/mpicc"

  is not able to compile a simple test program.

  It fails with the following output:

    Change Dir: /nscratch/jenkins/eclipse-slave/workspace/Trilinos-atdm-cts1-intel-19.0.5_openmpi-4.0.1_openmp_static_opt/SRC_AND_BUILD/BUILD/CMakeFiles/CMakeTmp
    
    Run Build Command:"/projects/sems/install/toss3/sems/utility/ninja_fortran/1.8.2/bin/ninja" "cmTC_7b3d7"
    [1/2] Building C object CMakeFiles/cmTC_7b3d7.dir/testCCompiler.c.o
    FAILED: CMakeFiles/cmTC_7b3d7.dir/testCCompiler.c.o 
    /opt/openmpi/4.0/intel/bin/mpicc    -MD -MT CMakeFiles/cmTC_7b3d7.dir/testCCompiler.c.o -MF CMakeFiles/cmTC_7b3d7.dir/testCCompiler.c.o.d -o CMakeFiles/cmTC_7b3d7.dir/testCCompiler.c.o   -c testCCompiler.c
    /opt/openmpi/4.0/intel/bin/mpicc: error while loading shared libraries: libimf.so: cannot open shared object file: No such file or directory
    ninja: build stopped: subcommand failed.
    

  

  CMake will not be able to correctly generate this project.
Call Stack (most recent call first):
  /nscratch/jenkins/eclipse-slave/workspace/Trilinos-atdm-cts1-intel-19.0.5_openmpi-4.0.1_openmp_static_opt/Trilinos/cmake/tribits/core/package_arch/TribitsGlobalMacros.cmake:1920 (ENABLE_LANGUAGE)
  /nscratch/jenkins/eclipse-slave/workspace/Trilinos-atdm-cts1-intel-19.0.5_openmpi-4.0.1_openmp_static_opt/Trilinos/cmake/tribits/core/package_arch/TribitsProjectImpl.cmake:192 (TRIBITS_SETUP_ENV)
  /nscratch/jenkins/eclipse-slave/workspace/Trilinos-atdm-cts1-intel-19.0.5_openmpi-4.0.1_openmp_static_opt/Trilinos/cmake/tribits/core/package_arch/TribitsProject.cmake:93 (TRIBITS_PROJECT_IMPL)
  CMakeLists.txt:90 (TRIBITS_PROJECT)
@bartlettroscoe bartlettroscoe added type: bug The primary issue is a bug in Trilinos code or tests impacting: configure or build The issue is primarily related to configuring or building client: ATDM Any issue primarily impacting the ATDM project ATDM Sev: Critical Problems that critically damage ability to run ATDM Trilinos builds much less allow APP updates labels Mar 30, 2020
@bartlettroscoe
Copy link
Member Author

The EMPIRE developers also noticed this and it seems that the basic Intel compilers are just broken. One of them is submitting a bug report to the admins.

I am marking this as ATDM Env Issue.

@bartlettroscoe bartlettroscoe added the ATDM Env Issue Issue with ATDM build or test caused (at least partly) by the env, not a bug in Trilinos label Mar 30, 2020
bartlettroscoe added a commit to bartlettroscoe/Trilinos that referenced this issue Apr 2, 2020
…-328)

For some reason, this seems to fix the compiler check on CTS-1 and TLCC-2
systems.  Something happened between testing day 2020-03-27 and 2020-03-28 to
break this.

This is just a stop-gap measure to address this until we can see how to fix
the configure with the Ninja generator.
bartlettroscoe added a commit that referenced this issue Apr 2, 2020
…htly-manual-updates (#7094, #7109)

I am manaully merging this to 'atdm-nightly' so I can see this running tomorrow.

Also see ATDV-328.
trilinos-autotester added a commit that referenced this issue Apr 2, 2020
…ake-files

Automatically Merged using Trilinos Pull Request AutoTester
PR Title: cts1, tlcc2: Switch from Ninja to Unix Makefiles (#7094, ATDV-328)
PR Author: bartlettroscoe
jmgate pushed a commit to tcad-charon/Trilinos that referenced this issue Apr 3, 2020
…s:develop' (8e5b734).

* trilinos-develop:
  Phalanx, Stokhos, TCouplings: update device type
  cts1, tlcc2: Switch from Ninja to Unix Makefiles (trilinos#7094, ATDV-328)
  MueLu Maxwell test: Spring cleaning
  Percept snapshot as of 4/01/2020
  KokkosKernels/Tpetra stack: local CRS device types
  Snapshot of stk as of 4/01/2020
jmgate pushed a commit to tcad-charon/Trilinos that referenced this issue Apr 3, 2020
…s:develop' (8e5b734).

* trilinos-develop:
  Phalanx, Stokhos, TCouplings: update device type
  cts1, tlcc2: Switch from Ninja to Unix Makefiles (trilinos#7094, ATDV-328)
  MueLu Maxwell test: Spring cleaning
  Percept snapshot as of 4/01/2020
  KokkosKernels/Tpetra stack: local CRS device types
  Snapshot of stk as of 4/01/2020
@bartlettroscoe
Copy link
Member Author

For now, this problem was fixed by switching to "Unix Makefiles" (see PR #7109) as there is a problem with the setuid of the SEMS-provided Ninja (see ATDV-332 and ATDV-332).

Since the build problems are fixed, I am closing this issue. I will leave open ATDV-332 to address the problem with Ninja (which is not a Trilinos problem or an ATDM Trilinos configuration problem but a system problem).

e10harvey added a commit that referenced this issue Apr 13, 2020
…-files

Revert "cts1, tlcc2: Switch from Ninja to Unix Makefiles (#7094, ATDV-328)"
jmgate pushed a commit to tcad-charon/Trilinos that referenced this issue Apr 14, 2020
…s:develop' (8505e85).

* trilinos-develop: (104 commits)
  Intrepid2: add support for hierarchical H(grad) bases on triangle and tetrahedron.
  Change name to ATDM_CONFIG_GET_KNOW_SYSTEM_INFO_REAL_HOSTNAME_OVERRIDE_FOR_UNIT_TESTING, add verbose warning (CDOFA-27)
  Fix small typo (CDOFA-27)
  MueLu: Fixing 2D convex hulls to avoid infinite looping
  Revert "cts1, tlcc2: Switch from Ninja to Unix Makefiles (trilinos#7094, ATDV-328)"
  Only support CMake
  Reorder Adelus in the package list file
  Set ZCPLX as default for test
  Fix Kokkos::subview bounds error
  Make DREAL as default
  Tpetra Distributor: add method to get reverse distributor
  MueLu: Rebase gold files
  MueLu ParameterListInterpreter test: Set "kokkos refactor" for factory xmls
  MueLu: Fix "kokkos refactor" for factory groups
  MueLu: Remove use of undefined MueLu_ENABLE_Galeri
  Amesos2: Turn off cuSolver test if no metis
  Amesos2: Fix unused path warning
  MueLu: rebase gold files
  Fix unused variable warning and add TestSpace
  ATDM: van1-tx2: Add install base dir (CDOFA-27)
  ...
jmgate pushed a commit to tcad-charon/Trilinos that referenced this issue Apr 14, 2020
…s:develop' (8505e85).

* trilinos-develop: (104 commits)
  Intrepid2: add support for hierarchical H(grad) bases on triangle and tetrahedron.
  Change name to ATDM_CONFIG_GET_KNOW_SYSTEM_INFO_REAL_HOSTNAME_OVERRIDE_FOR_UNIT_TESTING, add verbose warning (CDOFA-27)
  Fix small typo (CDOFA-27)
  MueLu: Fixing 2D convex hulls to avoid infinite looping
  Revert "cts1, tlcc2: Switch from Ninja to Unix Makefiles (trilinos#7094, ATDV-328)"
  Only support CMake
  Reorder Adelus in the package list file
  Set ZCPLX as default for test
  Fix Kokkos::subview bounds error
  Make DREAL as default
  Tpetra Distributor: add method to get reverse distributor
  MueLu: Rebase gold files
  MueLu ParameterListInterpreter test: Set "kokkos refactor" for factory xmls
  MueLu: Fix "kokkos refactor" for factory groups
  MueLu: Remove use of undefined MueLu_ENABLE_Galeri
  Amesos2: Turn off cuSolver test if no metis
  Amesos2: Fix unused path warning
  MueLu: rebase gold files
  Fix unused variable warning and add TestSpace
  ATDM: van1-tx2: Add install base dir (CDOFA-27)
  ...
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
ATDM Env Issue Issue with ATDM build or test caused (at least partly) by the env, not a bug in Trilinos ATDM Sev: Critical Problems that critically damage ability to run ATDM Trilinos builds much less allow APP updates client: ATDM Any issue primarily impacting the ATDM project impacting: configure or build The issue is primarily related to configuring or building type: bug The primary issue is a bug in Trilinos code or tests
Projects
None yet
Development

No branches or pull requests

1 participant