Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Kokkos + KokkosKernels Promotion To Version 2.6.00 #2351

Merged
merged 28 commits into from
Mar 8, 2018
Merged

Conversation

ndellingwood
Copy link
Contributor

@trilinos/kokkos
@trilinos/kokkos-kernels

Description

This merges Kokkos and KokkosKernels versions 2.6.00 into Trilinos.
This adds support for Volta GPUs and improves performance of all Cuda kernel launches and View shallow copies and atomics with Serial backend.
This adds enhancement for KokkosKernels Batched BLAS and performance improvements for Spgemm hashing.

Kokkos ChangeLog

2.6.00 (2018-03-07)

Full Changelog

Part of the Kokkos C++ Performance Portability Programming EcoSystem 2.6

Implemented enhancements:

  • Support NVIDIA Volta microarchitecture #1466
  • Kokkos - Define empty functions when profiling disabled #1424
  • Don't use __constant__ cache for lock arrays, enable once per run update instead of once per call #1385
  • task dag enhancement. #1354
  • Cuda task team collectives and stack size #1353
  • Replace View operator acceptance of more than rank integers with 'access' function #1333
  • Interoperability: Do not shut down backend execution space runtimes upon calling finalize. #1305
  • shmem_size for LayoutStride #1291
  • Kokkos::resize performs poorly on 1D Views #1270
  • stride() is inconsistent with dimension(), extent(), etc. #1214
  • Kokkos::sort defaults to std::sort on host #1208
  • DynamicView with host size grow #1206
  • Unmanaged View with Anonymous Memory Space #1175
  • Sort subset of Kokkos::DynamicView #1160
  • MDRange policy doesn't support lambda reductions #1054
  • Add ability to set hook on Kokkos::finalize #714
  • Atomics with Serial Backend - Default should be Disable? #549
  • KOKKOS_ENABLE_DEPRECATED_CODE #1359

Fixed bugs:

  • cuda_internal_maximum_warp_count returns 8, but I believe it should return 16 for P100 #1269
  • Cuda: level 1 scratch memory bug (reported by Stan Moore) #1434
  • MDRangePolicy Reduction requires value_type typedef in Functor #1379
  • Kokkos DeepCopy between empty views fails #1369
  • Several issues with new CMake build infrastructure (reported by Eric Phipps) #1365
  • deep_copy between rank-1 host/device views of differing layouts without UVM no longer works (reported by Eric Phipps) #1363
  • Profiling can't be disabled in CMake, and a parallel_for is missing for tasks (reported by Kyungjoo Kim) #1349
  • get_work_partition int overflow (reported by berryj5) #1327
  • Kokkos::deep_copy must fence even if the two views are the same #1303
  • CudaUVMSpace::allocate/deallocate must fence #1302
  • ViewResize on CUDA fails in Debug because of too many resources requested #1299
  • Cuda 9 and intrepid2 calls from Panzer. #1183
  • Slowdown due to tracking_enabled() in 2.04.00 (found by Albany app) #1016
  • Bounds checking fails with zero-span Views (reported by Stan Moore) #1411

KokkosKernels ChangeLog

2.6.00 (2018-03-07)

Full Changelog

Implemented enhancements:

  • Spgemm hash promotion #171
  • Batched BLAS enhancement #170

Fixed bugs:

  • d2_graph_color doesn't have a default coloring mechanism #168
  • Build error when MKL TPL is enabled #135

How Has This Been Tested?

This set of changes has been tested on Shepard and White with Intel 17, GCC 5.3, NVCC 8.
Configurations according to kokkos-kernels/scripts/trilinos-integration test scripts.
A detailed list of test failures is provided below. No additional test failures compared to the current
trilinos/develop branch were observed. Both individual packages are passing their comprehensive
nightly test suites. This includes testing of more than 200 configuration spanning 25+ compiler versions and 9 hardware platforms ( Intel Skylake, Intel SandyBridge, Intel Haswell, Intel Haswell + NVIDIA K40, Intel KNL, ARM, Power8, Power8 + K80, Power8 + P100).

ibaned and others added 28 commits January 9, 2018 09:15
KokkosGraph_GraphColor.hpp renamed KokkosGraph_graph_color.hpp
 Changes to be committed:
	modified:   MueLu_AggregationPhase1Algorithm_kokkos_def.hpp
atomic_increment has better performance and usage prevents need for
casting in atomic_fetch_add
static members in CellTools (structs with View members) required a
finalize hook to properly destruct to prevent errors of the following
type:
  cudaDeviceSynchronize() error( cudaErrorCudartUnloading)
Cast '1' increment to proper type in Kokkos::atomic_fetch_add; replace
with Kokkos::atomic_increment when possible.
Added to fix issues exposed by Panzer unit tests during Trilinos
integration testing with Cuda backend.
Necessary to fix error with Cuda of type
cudaDeviceSynchronize() error(cudaErrorCudartUnloading)
  due to View wrapped in RCP having destructor called after
Kokkos::finalize.
Changes to be committed:
	modified:   ../../../panzer/adapters-stk/test/gather_scatter_evaluators/scatter_field_evaluator.cpp
…53ad40

From repository at [email protected]:kokkos/kokkos.git

At commit:
commit e01945d0947f47e579468f325e4d97446453ad40
Merge: 62e760f d1ba7d7
Author: Nathan Ellingwood <[email protected]>
Date:   Wed Mar 7 16:10:52 2018 -0700

    Merge branch 'develop' for 2.6.00

    Part of Kokkos C++ Performance Portability Programming EcoSystem 2.6
…d27a6a56b98114

From repository at [email protected]:kokkos/kokkos-kernels.git

At commit:
commit 6e8e97a977564673bdadc15085d27a6a56b98114
Merge: 00b1648 f81778c
Author: Nathan Ellingwood <[email protected]>
Date:   Wed Mar 7 16:29:28 2018 -0700

    Merge branch 'develop' for 2.6.00

    Part of Kokkos C++ Performance Portability Programming EcoSystem 2.6
@ndellingwood ndellingwood requested a review from ibaned March 8, 2018 00:03
@ndellingwood ndellingwood requested a review from a team as a code owner March 8, 2018 00:03
@ndellingwood
Copy link
Contributor Author

@crtrott

Nathan please, add the output from the test runs

Will post shortly.

@ndellingwood
Copy link
Contributor Author

ndellingwood commented Mar 8, 2018

Testing Results Shepard Serial

Errors and test failures are a strict subset of the ones encountered on the develop branch of Trilinos (without the Kokkos or KokkosKernels snapshots) with the same configuration.

Build Errors:

None

General Test Results:

Two failures that also failed with existing Trilinos develop branch

99% tests passed, 2 tests failed out of 1742

Label Time Summary:
Amesos2          =  10.39 sec (9 tests)
Anasazi          = 119.36 sec (100 tests)
Belos            = 108.98 sec (87 tests)
Ifpack           =  45.55 sec (41 tests)
Ifpack2          =  48.34 sec (35 tests)
Intrepid         = 184.78 sec (153 tests)
Intrepid2        =  94.80 sec (144 tests)
Isorropia        =   4.12 sec (4 tests)
Kokkos           =  46.60 sec (23 tests)
KokkosKernels    = 109.27 sec (4 tests)
ML               =  20.34 sec (16 tests)
MueLu            = 329.16 sec (96 tests)
NOX              = 121.15 sec (92 tests)
Panzer           = 156.44 sec (116 tests)
Phalanx          =  21.05 sec (22 tests)
ROL              = 146.92 sec (71 tests)
Sacado           = 162.98 sec (292 tests)
ShyLU_Node       =   1.78 sec (3 tests)
Stokhos          = 105.24 sec (75 tests)
Stratimikos      =  28.28 sec (24 tests)
Thyra            =  71.69 sec (81 tests)
Tpetra           = 145.21 sec (149 tests)
Xpetra           =  24.02 sec (18 tests)
Zoltan2          = 112.07 sec (96 tests)

Total Test time (real) = 2217.83 sec

Test Failures:

The following tests FAILED:
        712 - ML_MLP_Restart_MPI_4 (Failed)
        1352 - NOX_Thyra_Heq_MPI_1 (Failed)

@ndellingwood
Copy link
Contributor Author

ndellingwood commented Mar 8, 2018

Testing Results Shepard Pthreads

Errors and test failures are a strict subset of the ones encountered on the develop branch of Trilinos (without the Kokkos or KokkosKernels snapshots) with the same configuration.

Build Errors:

Massive amount of 'undefined reference' errors on both develop and kokkos-develop Trilinos branches.

The kokkos-develop branch makes it farther through the build, exposes the following MueLu error also seen on develop and kokkos-develop branch of Trilinos with Cuda:

ascldap/users/ndellin/IntegrationTests/pthreads/trilinos-update/packages/teuchos/core/src/Teuchos_RCP.hpp(288): error: a value of type "MueLu::Hierarchy<TrilinosCouplings::EpetraIntrepidPoissonExample::ST={double}, int, int, KokkosClassic::DefaultNode::DefaultNodeType> *" cannot be used to initialize an entity of type "MueLu::EpetraOperator::Hierarchy *"
    : ptr_(r_ptr.get()), // will not compile if T is not base class of T2

General Test Results:

Many tests not run. No difference between the kokkos-develop and develop branches of Trilinos.

83% tests passed, 296 tests failed out of 1702

Label Time Summary:
Amesos2          =   8.20 sec (8 tests)
Anasazi          =  85.46 sec (71 tests)
Belos            =  87.16 sec (72 tests)
Ifpack           =  45.92 sec (41 tests)
Ifpack2          =  44.54 sec (35 tests)
Intrepid         = 179.38 sec (153 tests)
Intrepid2        =  93.43 sec (144 tests)
Isorropia        =   4.29 sec (4 tests)
Kokkos           =  88.43 sec (25 tests)
KokkosKernels    = 213.54 sec (8 tests)
ML               =  20.99 sec (16 tests)
MueLu            =   1.26 sec (92 tests)
NOX              = 121.32 sec (92 tests)
Panzer           =  54.09 sec (116 tests)
Phalanx          =  19.35 sec (22 tests)
ROL              =   0.00 sec (71 tests)
Sacado           = 163.66 sec (296 tests)
Stokhos          =   0.00 sec (78 tests)
Stratimikos      =  25.67 sec (24 tests)
Thyra            =  71.50 sec (81 tests)
Tpetra           = 146.03 sec (149 tests)
Xpetra           =  20.34 sec (17 tests)
Zoltan2          = 111.66 sec (96 tests)

Total Test time (real) = 1612.03 sec

Test Failures

The following tests FAILED:
        721 - ML_MLP_Restart_MPI_4 (Failed)
        1313 - NOX_Thyra_Heq_MPI_1 (Failed)
        1351 - MueLu_FixedMatrixPattern-Tpetra_MPI_4 (Not Run)
        1352 - MueLu_StandardReuse-Tpetra_MPI_4 (Not Run)
        1353 - MueLu_ReuseSequenceTpetra_MPI_1 (Not Run)
        1354 - MueLu_FixedMatrixPattern-Epetra_MPI_4 (Not Run)
        1355 - MueLu_StandardReuse-Epetra_MPI_4 (Not Run)
        1356 - MueLu_ReuseSequenceEpetra_MPI_1 (Not Run)
        1357 - MueLu_MatrixDriver_MPI_4 (Not Run)
        1358 - MueLu_Epetra1DLaplace_MPI_4 (Not Run)
        1359 - MueLu_Tpetra1DLaplace_MPI_4 (Not Run)
        1360 - MueLu_Stratimikos_MPI_4 (Not Run)
        1361 - MueLu_Stratimikos2_MPI_4 (Not Run)
        1362 - MueLu_LevelWrap-Tpetra_MPI_4 (Not Run)
        1363 - MueLu_LevelWrap-Epetra_MPI_4 (Not Run)
        1364 - MueLu_BlockCrs-Tpetra_MPI_4 (Not Run)
        1365 - MueLu_Simple_MPI_4 (Not Run)
        1366 - MueLu_MLParameterList-Epetra_MPI_4 (Not Run)
        1367 - MueLu_MLParameterList_Repartition-Epetra_MPI_4 (Not Run)
        1368 - MueLu_Q2Q1-Tpetra_MPI_1 (Not Run)
        1369 - MueLu_UnitTestsEpetra_MPI_1 (Not Run)
        1370 - MueLu_UnitTestsEpetra_MPI_4 (Not Run)
        1371 - MueLu_UnitTestsTpetra_MPI_1 (Not Run)
        1372 - MueLu_UnitTestsTpetra_MPI_4 (Not Run)
        1373 - MueLu_UnitTestsEpetra_kokkos_MPI_1 (Not Run)
        1374 - MueLu_UnitTestsEpetra_kokkos_MPI_4 (Not Run)
        1375 - MueLu_UnitTestsTpetra_kokkos_MPI_1 (Not Run)
        1376 - MueLu_UnitTestsTpetra_kokkos_MPI_4 (Not Run)
        1377 - MueLu_Redirection_MPI_4 (Not Run)
        1378 - MueLu_DriverTpetra_MPI_4 (Not Run)
        1379 - MueLu_DriverTpetra_WithGlobalConstants_MPI_4 (Not Run)
        1380 - MueLu_DriverTpetraTripleMatrixProduct_MPI_4 (Not Run)
        1381 - MueLu_DriverTpetraILU_MPI_4 (Not Run)
        1382 - MueLu_DriverTpetra_Milestone_MPI_4 (Not Run)
        1383 - MueLu_RAPScalingTestTpetra_MPI_4 (Not Run)
        1384 - MueLu_SmootherScalingTestTpetra_MPI_4 (Not Run)
        1385 - MueLu_ReadMatrixTpetra_MPI_4 (Not Run)
        1386 - MueLu_ParameterListInterpreterEpetra_MPI_1 (Not Run)
        1387 - MueLu_ParameterListInterpreterEpetra_MPI_4 (Not Run)
        1388 - MueLu_CreateOperatorEpetra_MPI_1 (Not Run)
        1389 - MueLu_CreateOperatorEpetra_MPI_4 (Not Run)
        1390 - MueLu_ParameterListInterpreterEpetraHeavy_MPI_1 (Not Run)
        1391 - MueLu_ParameterListInterpreterEpetraHeavy_MPI_4 (Not Run)
        1392 - MueLu_ParameterListInterpreterTpetra_MPI_1 (Not Run)
        1393 - MueLu_ParameterListInterpreterTpetra_MPI_4 (Not Run)
        1394 - MueLu_CreateOperatorTpetra_MPI_1 (Not Run)
        1395 - MueLu_CreateOperatorTpetra_MPI_4 (Not Run)
        1396 - MueLu_ParameterListInterpreterTpetraHeavy_MPI_1 (Not Run)
        1397 - MueLu_ParameterListInterpreterTpetraHeavy_MPI_4 (Not Run)
        1398 - MueLu_BlockedTransfer_Epetra_MPI_4 (Not Run)
        1399 - MueLu_BlockedTransfer_Tpetra_MPI_4 (Not Run)
        1400 - MueLu_simple-factory-request-mechanism_MPI_4 (Not Run)
        1401 - MueLu_Maxwell3D-Tpetra_MPI_4 (Not Run)
        1402 - MueLu_Maxwell3D-Tpetra-Stratimikos_MPI_4 (Not Run)
        1403 - MueLu_Maxwell3D-Epetra_MPI_4 (Not Run)
        1404 - MueLu_Navier2D_Epetra_MPI_4 (Not Run)
        1405 - MueLu_Navier2DBlocked_Epetra_MPI_4 (Not Run)
        1406 - MueLu_Navier2DBlocked_xml_format_MPI_4 (Not Run)
        1407 - MueLu_Navier2DBlocked_xml_format2_MPI_4 (Not Run)
        1408 - MueLu_Navier2DBlocked_xml_blockdirect_MPI_4 (Not Run)
        1409 - MueLu_Navier2DBlocked_xml_bgs1_MPI_4 (Not Run)
        1410 - MueLu_Navier2DBlocked_xml_bs1_MPI_4 (Not Run)
        1411 - MueLu_Navier2DBlocked_xml_bs2_MPI_4 (Not Run)
        1412 - MueLu_Navier2DBlocked_xml_sim1_MPI_4 (Not Run)
        1413 - MueLu_Navier2DBlocked_xml_sim2_MPI_4 (Not Run)
        1414 - MueLu_Navier2DBlocked_xml_uzawa1_MPI_4 (Not Run)
        1415 - MueLu_Navier2DBlocked_xml_indef1_MPI_4 (Not Run)
        1416 - MueLu_Navier2DBlocked_BraessSarazinSmoother_MPI_4 (Not Run)
        1417 - MueLu_Navier2DBlocked_SimpleSmoother_MPI_4 (Not Run)
        1418 - MueLu_Navier2DBlocked_BraessSarazin_MPI_4 (Not Run)
        1419 - MueLu_Navier2DBlockedReuseAggs_MPI_4 (Not Run)
        1420 - MueLu_Navier2DBlocked_Simple_MPI_4 (Not Run)
        1421 - MueLu_paramlist_MPI_4 (Not Run)
        1422 - MueLu_paramlistAdv_MPI_4 (Not Run)
        1423 - MueLu_Aggregation_MPI_4 (Not Run)
        1424 - MueLu_simple1D-UncoupledAggregation-Tpetra_MPI_4 (Not Run)
        1425 - MueLu_simple1D-UncoupledAggregation-Epetra_MPI_4 (Not Run)
        1426 - MueLu_Driver_TogglePFactory_tent_tent_Epetra_MPI_4 (Not Run)
        1427 - MueLu_Driver_TogglePFactory_sa_tent_Epetra_MPI_4 (Not Run)
        1428 - MueLu_Driver_TogglePFactory_semi_tent_Epetra_MPI_4 (Not Run)
        1429 - MueLu_Driver_TogglePFactory_tent_tent_Tpetra_MPI_4 (Not Run)
        1430 - MueLu_Driver_TogglePFactory_sa_tent_Tpetra_MPI_4 (Not Run)
        1431 - MueLu_Driver_TogglePFactory_semi_tent_Tpetra_MPI_4 (Not Run)
        1432 - MueLu_Driver_TogglePFactory_semi_tent_line_Tpetra_MPI_4 (Not Run)
        1433 - MueLu_Driver_TogglePFactory_semi_sa_line_easy_Tpetra_MPI_4 (Not Run)
        1434 - MueLu_ConvergenceEpetra_MPI_1 (Not Run)
        1435 - MueLu_ConvergenceEpetra_MPI_4 (Not Run)
        1436 - MueLu_ConvergenceTpetra_MPI_1 (Not Run)
        1437 - MueLu_ConvergenceTpetra_MPI_4 (Not Run)
        1438 - Stokhos_LegendreBasisUnitTest_MPI_1 (Not Run)
        1439 - Stokhos_NormalizedLegendreBasisUnitTest_MPI_1 (Not Run)
        1440 - Stokhos_HermiteBasisUnitTest_MPI_1 (Not Run)
        1441 - Stokhos_NormalizedHermiteBasisUnitTest_MPI_1 (Not Run)
        1442 - Stokhos_JacobiBasisUnitTest_MPI_1 (Not Run)
        1443 - Stokhos_QuadExpansionUnitTest_MPI_1 (Not Run)
        1444 - Stokhos_QuadraturePseudoSpectralExpansionUnitTest_MPI_1 (Not Run)
        1445 - Stokhos_TensorProductPseudoSpectralExpansionUnitTest_MPI_1 (Not Run)
        1446 - Stokhos_SmolyakPseudoSpectralExpansionUnitTest_MPI_1 (Not Run)
        1447 - Stokhos_AlgebraicExpansionUnitTest_MPI_1 (Not Run)
        1448 - Stokhos_ConstantExpansionUnitTest_MPI_1 (Not Run)
        1449 - Stokhos_DivisionOperatorUnitTest_MPI_1 (Not Run)
        1450 - Stokhos_StieltjesUnitTest_MPI_1 (Not Run)
        1451 - Stokhos_LanczosUnitTest_MPI_1 (Not Run)
        1452 - Stokhos_GramSchmidtUnitTest_MPI_1 (Not Run)
        1453 - Stokhos_Sparse3TensorUnitTest_MPI_1 (Not Run)
        1454 - Stokhos_ExponentialRandomFieldUnitTest_MPI_1 (Not Run)
        1455 - Stokhos_LogNormalUnitTest_MPI_1 (Not Run)
        1456 - Stokhos_SDMUtilsUnitTest_MPI_1 (Not Run)
        1457 - Stokhos_ProductBasisUtilsUnitTest_MPI_1 (Not Run)
        1458 - Stokhos_TensorProductBasisUnitTest_MPI_1 (Not Run)
        1459 - Stokhos_TotalOrderBasisUnitTest_MPI_1 (Not Run)
        1460 - Stokhos_SmolyakBasisUnitTest_MPI_1 (Not Run)
        1461 - Stokhos_TensorProductPseudoSpectralOperatorUnitTest_MPI_1 (Not Run)
        1462 - Stokhos_LexicographicTreeBasisUnitTest_MPI_1 (Not Run)
        1463 - Stokhos_SparseGridQuadratureUnitTest_MPI_1 (Not Run)
        1464 - Stokhos_MatrixFreeOperatorUnitTest_MPI_1 (Not Run)
        1465 - Stokhos_InterlacedOpUnitTest_MPI_2 (Not Run)
        1466 - Stokhos_BasisInteractionGraphUnitTest_MPI_1 (Not Run)
        1467 - Stokhos_AdaptivityToolsUnitTest_MPI_1 (Not Run)
        1468 - Stokhos_BuildColBasisUnitTest_MPI_2 (Not Run)
        1469 - Stokhos_InterlacedMapUnitTest_MPI_2 (Not Run)
        1470 - Stokhos_SacadoTraitsUnitTest_MPI_1 (Not Run)
        1471 - Stokhos_SacadoPromoteUnitTest_MPI_1 (Not Run)
        1472 - Stokhos_SacadoPCEUnitTest_MPI_1 (Not Run)
        1473 - Stokhos_SacadoETPCEUnitTest_MPI_1 (Not Run)
        1474 - Stokhos_SacadoPCESerializationTests_MPI_1 (Not Run)
        1475 - Stokhos_SacadoPCECommTests_MPI_1 (Not Run)
        1476 - Stokhos_SacadoUQPCEUnitTest_MPI_1 (Not Run)
        1477 - Stokhos_SacadoUQPCESerializationTests_MPI_1 (Not Run)
        1478 - Stokhos_SacadoUQPCECommTests_MPI_1 (Not Run)
        1479 - Stokhos_KokkosViewUQPCEUnitTest_Threads_MPI_1 (Not Run)
        1480 - Stokhos_KokkosViewUQPCEUnitTest_Serial_MPI_1 (Not Run)
        1481 - Stokhos_KokkosCrsMatrixUQPCEUnitTest_Threads_MPI_1 (Not Run)
        1482 - Stokhos_TpetraCrsMatrixUQPCEUnitTest_Threads_MPI_4 (Not Run)
        1483 - Stokhos_SacadoMPVectorUnitTest_MPI_1 (Not Run)
        1484 - Stokhos_SacadoMPVectorSerializationTests_MPI_1 (Not Run)
        1485 - Stokhos_SacadoMPVectorCommTests_MPI_1 (Not Run)
        1486 - Stokhos_KokkosViewMPVectorUnitTest_Threads_MPI_1 (Not Run)
        1487 - Stokhos_KokkosViewMPVectorUnitTest_Serial_MPI_1 (Not Run)
        1488 - Stokhos_KokkosCrsMatrixMPVectorUnitTest_Threads_MPI_1 (Not Run)
        1489 - Stokhos_KokkosViewFadMPVectorUnitTest_Threads_MPI_1 (Not Run)
        1490 - Stokhos_TpetraCrsMatrixMPVectorUnitTest_Threads_MPI_4 (Not Run)
        1491 - Stokhos_KokkosArrayKernelsUnitTest_Serial_MPI_1 (Not Run)
        1492 - Stokhos_KokkosArrayKernelsUnitTest_Threads_MPI_1 (Not Run)
        1493 - Stokhos_TpetraMatVec_MPI_4 (Not Run)
        1494 - Stokhos_hermite_example_MPI_1 (Not Run)
        1495 - Stokhos_Linear2D_Diffusion_PCE_Example_MPI_2 (Not Run)
        1496 - Stokhos_Linear2D_Diffusion_PCE_Interlaced_Example_MPI_2 (Not Run)
        1497 - Stokhos_nox_example_MPI_1 (Not Run)
        1498 - Stokhos_Linear2D_Diffusion_PCE_NOX_Example_MPI_2 (Not Run)
        1499 - Stokhos_Linear2D_Diffusion_GMRES_Mean_Based_MPI_2 (Not Run)
        1500 - Stokhos_Linear2D_Diffusion_GMRES_AGS_MPI_2 (Not Run)
        1501 - Stokhos_Linear2D_Diffusion_CG_AGS_MPI_2 (Not Run)
        1502 - Stokhos_Linear2D_Diffusion_GMRES_GS_MPI_2 (Not Run)
        1503 - Stokhos_Linear2D_Diffusion_GMRES_AJ_MPI_2 (Not Run)
        1504 - Stokhos_Linear2D_Diffusion_GMRES_KP_MPI_2 (Not Run)
        1505 - Stokhos_Linear2D_Diffusion_GS_MPI_2 (Not Run)
        1506 - Stokhos_Linear2D_Diffusion_JA_MPI_2 (Not Run)
        1507 - Stokhos_Linear2D_Diffusion_LN_MPI_2 (Not Run)
        1508 - Stokhos_Linear2D_Diffusion_GSLN_MPI_2 (Not Run)
        1509 - Stokhos_Linear2D_Diffusion_GMRES_FA_MPI_2 (Not Run)
        1510 - Stokhos_Linear2D_Diffusion_GMRES_KL_MPI_2 (Not Run)
        1511 - Stokhos_Linear2D_Diffusion_GMRES_KLR_MPI_2 (Not Run)
        1512 - Stokhos_uq_handbook_nonlinear_sg_example_MPI_1 (Not Run)
        1513 - Stokhos_sacado_example_MPI_1 (Not Run)
        1514 - Stokhos_division_example_MPI_1 (Not Run)
        1515 - Stokhos_sacado_ensemble_example_MPI_1 (Not Run)
        1516 - ROL_TeuchosVectorInterface_MPI_4 (Not Run)
        1517 - ROL_TeuchosFunctionInterface_MPI_4 (Not Run)
        1518 - ROL_adapters_epetra_test_vector_EpetraMultiVectorInterface_MPI_4 (Not Run)
        1519 - ROL_adapters_epetra_test_sol_EpetraSROMSampleGenerator_MPI_4 (Not Run)
        1520 - ROL_adapters_tpetra_test_vector_TpetraMultiVectorInterface_MPI_4 (Not Run)
        1521 - ROL_adapters_tpetra_test_vector_SimulatedVectorTpetraBatchManagerInterface_MPI_4 (Not Run)
        1522 - ROL_adapters_tpetra_test_vector_ScaledTpetraMultiVector_MPI_4 (Not Run)
        1523 - ROL_adapters_tpetra_test_function_TpetraBoundConstraintInterface_MPI_4 (Not Run)
        1524 - ROL_adapters_tpetra_test_sol_TpetraSimulatedConstraintInterface_MPI_4 (Not Run)
        1525 - ROL_adapters_tpetra_test_sol_TpetraSimulatedConstraintInterfaceCVaR_MPI_4 (Not Run)
        1526 - ROL_adapters_tpetra_test_sol_TpetraSimulatedConstraintInterfaceDual_MPI_4 (Not Run)
        1527 - ROL_adapters_belos_test_vector_BelosInterface_MPI_4 (Not Run)
        1528 - ROL_NonlinearProblemTest_MPI_4 (Not Run)
        1529 - ROL_adapters_thyra_test_vector_ThyraInterface_MPI_4 (Not Run)
        1530 - ROL_adapters_thyra_test_vector_ScaledThyraVector_MPI_4 (Not Run)
        1531 - ROL_test_algorithm_OptimizationSolverStatusTestInput_MPI_1 (Not Run)
        1532 - ROL_test_elementwise_StdVector_MPI_1 (Not Run)
        1533 - ROL_test_elementwise_TpetraMultiVector_MPI_4 (Not Run)
        1534 - ROL_test_elementwise_BoundConstraint_MPI_1 (Not Run)
        1535 - ROL_test_function_DerivativeCheck_MPI_1 (Not Run)
        1536 - ROL_test_function_BarrierFunctionCheck_MPI_1 (Not Run)
        1537 - ROL_test_function_BlockOperatorCheck_MPI_1 (Not Run)
        1538 - ROL_test_function_SimOptSolveCheck_MPI_1 (Not Run)
        1539 - ROL_test_function_NonlinearLeastSquaresCheck_MPI_1 (Not Run)
        1540 - ROL_test_function_StdObjectiveCheck_MPI_1 (Not Run)
        1541 - ROL_test_function_CompositeObjectiveCheck_MPI_1 (Not Run)
        1542 - ROL_test_function_CompositeObjectiveSimOptCheck_MPI_1 (Not Run)
        1543 - ROL_test_function_ConstraintPartionedCheck_MPI_1 (Not Run)
        1544 - ROL_test_function_CompositeConstraintCheck_MPI_1 (Not Run)
        1545 - ROL_test_function_HouseholderReflectorCheck_MPI_1 (Not Run)
        1546 - ROL_test_function_BinaryConstraintCheck_MPI_4 (Not Run)
        1547 - ROL_test_function_operator_StdLinearOperator_MPI_1 (Not Run)
        1548 - ROL_test_function_operator_StdTridiagonalOperator_MPI_1 (Not Run)
        1549 - ROL_test_function_constraint_ObjectiveConstraintConversion_MPI_1 (Not Run)
        1550 - ROL_test_function_constraint_ScalarLinearConstraint_MPI_1 (Not Run)
        1551 - ROL_test_function_constraint_Constraint_TimeSimOpt_MPI_1 (Not Run)
        1552 - ROL_test_sol_solInterface_MPI_1 (Not Run)
        1553 - ROL_test_sol_solDistributions_MPI_1 (Not Run)
        1554 - ROL_test_sol_solTeuchosBatchManager_MPI_4 (Not Run)
        1555 - ROL_test_sol_solSROMGenerator_MPI_1 (Not Run)
        1556 - ROL_test_sol_checkParametrizedSimOptSolve_MPI_1 (Not Run)
        1557 - ROL_test_sol_checkSROMVector_MPI_1 (Not Run)
        1558 - ROL_test_sol_checkHMCR_MPI_1 (Not Run)
        1559 - ROL_test_sol_checkSuperQuantileQuadrangle_MPI_1 (Not Run)
        1560 - ROL_test_sol_checkSpectralRisk_MPI_1 (Not Run)
        1561 - ROL_test_sol_checkAlmostSureConstraint_MPI_1 (Not Run)
        1562 - ROL_test_sol_checkMeanValueConstraint_MPI_1 (Not Run)
        1563 - ROL_test_sol_checkRiskNeutralConstraint_MPI_1 (Not Run)
        1564 - ROL_test_step_LineSearch_MPI_1 (Not Run)
        1565 - ROL_test_step_TrustRegion_MPI_1 (Not Run)
        1566 - ROL_test_step_BoxConstrained_LineSearch_MPI_1 (Not Run)
        1567 - ROL_test_step_BoxConstrained_TrustRegion_MPI_1 (Not Run)
        1568 - ROL_test_step_BoxConstrained_PrimalDualActiveSet_MPI_1 (Not Run)
        1569 - ROL_test_step_LineSearchTypes_MPI_1 (Not Run)
        1570 - ROL_test_step_StepNotImplemented_MPI_1 (Not Run)
        1571 - ROL_test_step_InteriorPointStep_MPI_1 (Not Run)
        1572 - ROL_test_step_MoreauYosidaPenaltyStep_MPI_1 (Not Run)
        1573 - ROL_test_step_interiorpoint_BarrierObjective_MPI_1 (Not Run)
        1574 - ROL_test_step_interiorpoint_PrimalDualResidual_MPI_1 (Not Run)
        1575 - ROL_test_step_interiorpoint_PrimalDualNewtonKrylov_MPI_1 (Not Run)
        1576 - ROL_test_step_krylov_GMRES_MPI_1 (Not Run)
        1577 - ROL_test_utils_ScalarMinimizationTest01_MPI_1 (Not Run)
        1578 - ROL_test_utils_ScalarMinimizationTest02_MPI_1 (Not Run)
        1579 - ROL_test_vector_StdVectorInterface_MPI_1 (Not Run)
        1580 - ROL_test_vector_CArrayVectorInterface_MPI_1 (Not Run)
        1581 - ROL_test_vector_MultiVectorInterface_MPI_1 (Not Run)
        1582 - ROL_test_vector_PartitionedVectorInterface_MPI_1 (Not Run)
        1583 - ROL_test_vector_ScaledStdVectorInterface_MPI_1 (Not Run)
        1584 - ROL_test_vector_ProfiledVectorInterface_MPI_1 (Not Run)
        1585 - ROL_test_vector_RieszVectorInterface_MPI_1 (Not Run)
        1586 - ROL_test_vector_PinTVector_MPI_3 (Not Run)
        1645 - PanzerAdaptersSTK_tSTKInterface_MPI_1 (Not Run)
        1646 - PanzerAdaptersSTK_tLineMeshFactory_MPI_2 (Not Run)
        1647 - PanzerAdaptersSTK_tSquareQuadMeshFactory_MPI_2 (Not Run)
        1648 - PanzerAdaptersSTK_tSquareTriMeshFactory_MPI_2 (Not Run)
        1649 - PanzerAdaptersSTK_tCubeHexMeshFactory_MPI_2 (Not Run)
        1650 - PanzerAdaptersSTK_tCubeTetMeshFactory_MPI_2 (Not Run)
        1651 - PanzerAdaptersSTK_tSingleBlockCubeHexMeshFactory_MPI_4 (Not Run)
        1652 - PanzerAdaptersSTK_tSTK_IO_MPI_1 (Not Run)
        1653 - PanzerAdaptersSTK_tExodusReaderFactory_MPI_2 (Not Run)
        1654 - PanzerAdaptersSTK_tGhosting_MPI_4 (Not Run)
        1655 - PanzerAdaptersSTK_tSTKConnManager_MPI_2 (Not Run)
        1656 - PanzerAdaptersSTK_tSquareQuadMeshDOFManager_MPI_2 (Not Run)
        1657 - PanzerAdaptersSTK_tDOFManager2_Orientation_MPI_2 (Not Run)
        1658 - PanzerAdaptersSTK_tSquareTriMeshDOFManager_MPI_2 (Not Run)
        1659 - PanzerAdaptersSTK_tEpetraLinObjFactory_MPI_2 (Not Run)
        1660 - PanzerAdaptersSTK_tCubeHexMeshDOFManager_MPI_2 (Not Run)
        1661 - PanzerAdaptersSTK_tSquareQuadMeshDOFManager_edgetests_MPI_1 (Not Run)
        1662 - PanzerAdaptersSTK_tBlockedDOFManagerFactory_MPI_2 (Not Run)
        1663 - PanzerAdaptersSTK_tDOFManager2_SimpleTests_MPI_4 (Not Run)
        1664 - PanzerAdaptersSTK_workset_builder_MPI_1 (Not Run)
        1665 - PanzerAdaptersSTK_d_workset_builder_MPI_2 (Not Run)
        1666 - PanzerAdaptersSTK_d_workset_builder_3d_MPI_1 (Not Run)
        1667 - PanzerAdaptersSTK_cascade_MPI_2 (Not Run)
        1668 - PanzerAdaptersSTK_hdiv_basis_MPI_1 (Not Run)
        1669 - PanzerAdaptersSTK_workset_container_MPI_2 (Not Run)
        1670 - PanzerAdaptersSTK_field_manager_builder_MPI_1 (Not Run)
        1671 - PanzerAdaptersSTK_initial_condition_builder_MPI_1 (Not Run)
        1672 - PanzerAdaptersSTK_initial_condition_builder2_MPI_2 (Not Run)
        1673 - PanzerAdaptersSTK_initial_condition_control_MPI_2 (Not Run)
        1674 - PanzerAdaptersSTK_assembly_engine_MPI_4 (Not Run)
        1675 - PanzerAdaptersSTK_simple_bc_MPI_2 (Not Run)
        1676 - PanzerAdaptersSTK_model_evaluator_MPI_4 (Not Run)
        1677 - PanzerAdaptersSTK_model_evaluator_mass_check_MPI_1 (Not Run)
        1678 - PanzerAdaptersSTK_thyra_model_evaluator_MPI_4 (Not Run)
        1679 - PanzerAdaptersSTK_explicit_model_evaluator_MPI_4 (Not Run)
        1680 - PanzerAdaptersSTK_response_residual_MPI_2 (Not Run)
        1681 - PanzerAdaptersSTK_solver_MPI_4 (Not Run)
        1682 - PanzerAdaptersSTK_gs_evaluators_MPI_1 (Not Run)
        1683 - PanzerAdaptersSTK_scatter_field_evaluator_MPI_1 (Not Run)
        1684 - PanzerAdaptersSTK_periodic_bcs_MPI_4 (Not Run)
        1685 - PanzerAdaptersSTK_periodic_mesh_MPI_2 (Not Run)
        1686 - PanzerAdaptersSTK_bcstrategy_MPI_1 (Not Run)
        1687 - PanzerAdaptersSTK_bcstrategy_composite_factory_MPI_1 (Not Run)
        1688 - PanzerAdaptersSTK_STK_ResponseLibraryTest2_MPI_2 (Not Run)
        1689 - PanzerAdaptersSTK_STK_VolumeSideResponse_MPI_2 (Not Run)
        1690 - PanzerAdaptersSTK_ip_coordinates_MPI_2 (Not Run)
        1691 - PanzerAdaptersSTK_tGatherSolution_MPI_2 (Not Run)
        1692 - PanzerAdaptersSTK_tScatterResidual_MPI_2 (Not Run)
        1693 - PanzerAdaptersSTK_tScatterDirichletResidual_MPI_2 (Not Run)
        1694 - PanzerAdaptersSTK_tBasisTimesVector_MPI_1 (Not Run)
        1695 - PanzerAdaptersSTK_tPointBasisValuesEvaluator_MPI_1 (Not Run)
        1696 - PanzerAdaptersSTK_tDomainInterface_MPI_2 (Not Run)
        1697 - PanzerAdaptersSTK_node_normals_MPI_2 (Not Run)
        1698 - PanzerAdaptersSTK_tFaceToElem_MPI_2 (Not Run)
        1699 - PanzerAdaptersSTK_LocalMesh_Tests_MPI_1 (Not Run)
        1700 - PanzerAdaptersIOSS_tIOSSConnManager1_MPI_1 (Not Run)
        1701 - PanzerAdaptersIOSS_tIOSSConnManager2_MPI_2 (Not Run)
        1702 - PanzerAdaptersIOSS_tIOSSConnManager3_MPI_3 (Not Run)

@ndellingwood
Copy link
Contributor Author

Testing Results White OpenMP

Errors and test failures are a strict subset of the ones encountered on the develop branch of Trilinos (without the Kokkos or KokkosKernels snapshots) with the same configuration.

Build Errors:

None

General Test Results:

96% tests passed, 70 tests failed out of 1805

Label Time Summary:
Amesos2          =   6.52 sec (9 tests)
Anasazi          = 261.55 sec (71 tests)
Belos            =  68.38 sec (72 tests)
Ifpack           =  35.88 sec (41 tests)
Ifpack2          =  42.16 sec (35 tests)
Intrepid         = 149.91 sec (153 tests)
Intrepid2        =  77.49 sec (240 tests)
Isorropia        =   3.17 sec (4 tests)
Kokkos           =  85.16 sec (26 tests)
KokkosKernels    = 173.75 sec (8 tests)
ML               =  16.26 sec (16 tests)
MueLu            = 319.40 sec (92 tests)
NOX              = 513.25 sec (92 tests)
Panzer           = 156.91 sec (116 tests)
Phalanx          =  12.93 sec (22 tests)
ROL              = 188.30 sec (71 tests)
Sacado           =  76.70 sec (296 tests)
ShyLU_Node       =   0.91 sec (4 tests)
Stokhos          = 102.79 sec (78 tests)
Stratimikos      =  22.19 sec (24 tests)
Thyra            =  48.56 sec (81 tests)
Tpetra           = 100.75 sec (149 tests)
Xpetra           =  18.29 sec (18 tests)
Zoltan2          =  86.20 sec (96 tests)

Total Test time (real) = 2564.32 sec

Test Failures:

One additional failure on the develop branch not occurring on the kokkos-develop branch of Trilinos.

The following tests FAILED:
        740 - Belos_pseudo_gmres_hb_MPI_4 (Failed)
        741 - Belos_bl_pgmres_hb_0_MPI_4 (Failed)
        742 - Belos_bl_pgmres_hb_1_MPI_4 (Failed)
        743 - Belos_bl_pgmres_hb_2_MPI_4 (Failed)
        744 - Belos_pseudo_pgmres_hb_MPI_4 (Failed)
        745 - Belos_bl_fgmres_hb_MPI_4 (Failed)
        761 - Belos_gcrodr_hb_MPI_4 (Failed)
        763 - Belos_prec_gcrodr_hb_1_MPI_4 (Failed)
        816 - Anasazi_Epetra_ModalSolversTester_MPI_4 (Failed)
        818 - Anasazi_Epetra_OrthoManagerTester_0_MPI_4 (Failed)
        819 - Anasazi_Epetra_OrthoManagerTester_1_MPI_4 (Timeout)
        820 - Anasazi_Epetra_OrthoManagerTester_2_MPI_4 (Failed)
        821 - Anasazi_Epetra_OrthoManagerTester_3_MPI_4 (Failed)
        822 - Anasazi_Epetra_OrthoManagerTester_4_MPI_4 (Failed)
        823 - Anasazi_Epetra_OrthoManagerTester_5_MPI_4 (Failed)
        824 - Anasazi_Epetra_OrthoManagerMatTester_0_MPI_4 (Failed)
        825 - Anasazi_Epetra_OrthoManagerMatTester_1_MPI_4 (Failed)
        826 - Anasazi_Epetra_OrthoManagerMatTester_2_MPI_4 (Failed)
        827 - Anasazi_Epetra_OrthoManagerMatTester_3_MPI_4 (Failed)
        828 - Anasazi_Epetra_OrthoManagerMatTester_4_MPI_4 (Failed)
        829 - Anasazi_Epetra_OrthoManagerMatTester_5_MPI_4 (Failed)
        830 - Anasazi_Epetra_OrthoManagerGenTester_0_MPI_4 (Failed)
        831 - Anasazi_Epetra_OrthoManagerGenTester_1_MPI_4 (Failed)
        832 - Anasazi_Epetra_BlockDavidson_solvertest_MPI_4 (Failed)
        833 - Anasazi_Epetra_BlockDavidson_test_0_MPI_4 (Failed)
        834 - Anasazi_Epetra_BlockDavidson_test_1_MPI_4 (Failed)
        835 - Anasazi_Epetra_BlockDavidson_test_2_MPI_4 (Failed)
        836 - Anasazi_Epetra_BlockDavidson_test_3_MPI_4 (Failed)
        837 - Anasazi_Epetra_BlockDavidson_test_4_MPI_4 (Failed)
        838 - Anasazi_Epetra_BlockDavidson_test_5_MPI_4 (Failed)
        839 - Anasazi_Epetra_BlockDavidson_test_6_MPI_4 (Failed)
        840 - Anasazi_Epetra_BlockDavidson_test_7_MPI_4 (Failed)
        841 - Anasazi_Epetra_BlockDavidson_test_8_MPI_4 (Failed)
        842 - Anasazi_Epetra_BlockDavidson_auxtest_MPI_4 (Failed)
        843 - Anasazi_Epetra_BKS_solvertest_MPI_4 (Failed)
        845 - Anasazi_Epetra_BKS_test_1_MPI_4 (Failed)
        849 - Anasazi_Epetra_BKS_nh_test_1_MPI_4 (Failed)
        850 - Anasazi_Epetra_GeneralizedDavidson_solvertest_MPI_4 (Failed)
        853 - Anasazi_Epetra_LOBPCG_solvertest_MPI_4 (Failed)
        854 - Anasazi_Epetra_LOBPCG_simpletest_MPI_4 (Failed)
        855 - Anasazi_Epetra_LOBPCG_test_MPI_4 (Failed)
        856 - Anasazi_Epetra_LOBPCG_auxtest_MPI_4 (Failed)
        857 - Anasazi_Epetra_IRTR_test_0_MPI_4 (Failed)
        858 - Anasazi_Epetra_IRTR_test_1_MPI_4 (Failed)
        859 - Anasazi_Epetra_IRTR_test_2_MPI_4 (Failed)
        860 - Anasazi_Epetra_IRTR_test_3_MPI_4 (Failed)
        861 - Anasazi_Epetra_IRTR_auxtest_0_MPI_4 (Failed)
        862 - Anasazi_Epetra_IRTR_auxtest_1_MPI_4 (Failed)
        863 - Anasazi_Epetra_IRTR_auxtest_2_MPI_4 (Failed)
        864 - Anasazi_Epetra_IRTR_auxtest_3_MPI_4 (Failed)
        865 - Anasazi_Epetra_IRTR_auxtest_4_MPI_4 (Failed)
        872 - Anasazi_BlockDavidsonThyra_test_MPI_4 (Failed)
        875 - Anasazi_IRTRThyra_test_0_MPI_4 (Failed)
        876 - Anasazi_IRTRThyra_test_1_MPI_4 (Failed)
        877 - Anasazi_IRTRThyra_test_2_MPI_4 (Failed)
        878 - Anasazi_IRTRThyra_test_3_MPI_4 (Failed)
        879 - Anasazi_LOBPCGThyra_test_MPI_4 (Failed)
        886 - Anasazi_Tpetra_TraceMinDavidson_largest_standard_test_MPI_4 (Failed)
        893 - Ifpack2_Jacobi_hb_belos_MPI_1 (Failed)
        894 - Ifpack2_Jacobi_hb_belos_MPI_2 (Failed)
        902 - Ifpack2_GS_belos_MPI_1 (Failed)
        903 - Ifpack2_SGS_belos_MPI_1 (Failed)
        928 - Stratimikos_Thyra_Belos_StatusTest_UnitTests_MPI_1 (Failed)
        936 - Stratimikos_Belos_GCRODR_strattest_MPI_4 (Failed)
        1337 - Intrepid2_unit-test_Orientation_Serial_Test_Orientation_TET_MPI_1 (Failed)
        1373 - NOX_LOCA_AnasaziJacobianInverse_MPI_1 (Timeout)
        1374 - NOX_LOCA_AnasaziNotConverged_MPI_1 (Timeout)
        1447 - NOX_LOCA_MultiPointTcubed_MPI_2 (Failed)
        1585 - Stokhos_TpetraCrsMatrixUQPCEUnitTest_OpenMP_MPI_4 (Failed)
        1593 - Stokhos_TpetraCrsMatrixMPVectorUnitTest_OpenMP_MPI_4 (Failed)

@ndellingwood
Copy link
Contributor Author

Testing Results White Cuda

Errors and test failures are a strict subset of the ones encountered on the develop branch of Trilinos (without the Kokkos or KokkosKernels snapshots) with the same configuration.

Build Errors:

No new build errors were introduced by the integration testing. The following errors occur with both develop and kokkos-develop branches of Trilinos:

ROL
/mnt/netapp/OHPC_home/ndellin/IntegrationTests/cuda/trilinos-update/packages/rol/test/function/test_03.cpp(79): error: the type in a dynamic_cast must be a pointer or reference to a complete class type, or void *

MueLu

/mnt/netapp/OHPC_home/ndellin/IntegrationTests/cuda/trilinos-update/packages/teuchos/core/src/Teuchos_RCP.hpp(288): error: a value of type "MueLu::Hierarchy<TrilinosCouplings::EpetraIntrepidPoissonExample::ST, int, int, KokkosClassic::DefaultNode::DefaultNodeType> *" cannot be used to initialize an entity of type "MueLu::EpetraOperator::Hierarchy *"
          detected during instantiation of "Teuchos::RCP<T>::RCP(const Teuchos::RCP<T2> &) [with T=MueLu::EpetraOperator::Hierarchy, T2=MueLu::Hierarchy<TrilinosCouplings::EpetraIntrepidPoissonExample::ST, int, int, KokkosClassic::DefaultNode::DefaultNodeType>]"
/mnt/netapp/OHPC_home/ndellin/IntegrationTests/cuda/trilinos-update/packages/trilinoscouplings/examples/scaling/IntrepidPoisson_Pamgen_EpetraAztecOO_main.cpp(260): here

1 error detected in the compilation of "/tmp/tmpxft_0000a101_00000000-7_IntrepidPoisson_Pamgen_EpetraAztecOO_main.cpp1.ii".

General Test Results:

96% tests passed, 71 tests failed out of 1816

Label Time Summary:
Amesos2          =  14.85 sec (8 tests)
Anasazi          =  97.19 sec (71 tests)
Belos            =  93.96 sec (72 tests)
Ifpack           =  38.49 sec (41 tests)
Ifpack2          = 123.86 sec (35 tests)
Intrepid         = 359.00 sec (153 tests)
Intrepid2        = 180.34 sec (247 tests)
Isorropia        =   3.18 sec (4 tests)
Kokkos           = 204.84 sec (26 tests)
KokkosKernels    = 160.33 sec (8 tests)
ML               =  17.50 sec (16 tests)
MueLu            = 1016.49 sec (92 tests)
NOX              = 538.94 sec (92 tests)
Panzer           = 613.70 sec (116 tests)
Phalanx          =  22.24 sec (22 tests)
ROL              = 399.15 sec (71 tests)
Sacado           = 102.40 sec (299 tests)
Stokhos          = 370.95 sec (82 tests)
Stratimikos      =  25.40 sec (24 tests)
Thyra            =  55.46 sec (81 tests)
Tpetra           = 380.63 sec (151 tests)
Xpetra           =  71.29 sec (18 tests)
Zoltan2          = 178.24 sec (96 tests)

Total Test time (real) = 5031.59 sec

Test Failures:

One additional test failed on kokkos-develop branch during this testing, PanzerAdaptersSTK_scatter_field_evaluator_MPI_1, fixed by commit 6cd283d on the kokkos-develop branch.

The following tests FAILED:
        745 - Belos_pseudo_gmres_hb_MPI_4 (Failed)
        746 - Belos_bl_pgmres_hb_0_MPI_4 (Failed)
        747 - Belos_bl_pgmres_hb_1_MPI_4 (Failed)
        748 - Belos_bl_pgmres_hb_2_MPI_4 (Failed)
        749 - Belos_pseudo_pgmres_hb_MPI_4 (Failed)
        750 - Belos_bl_fgmres_hb_MPI_4 (Failed)
        766 - Belos_gcrodr_hb_MPI_4 (Failed)
        768 - Belos_prec_gcrodr_hb_1_MPI_4 (Failed)
        816 - Anasazi_Epetra_ModalSolversTester_MPI_4 (Failed)
        818 - Anasazi_Epetra_OrthoManagerTester_0_MPI_4 (Failed)
        819 - Anasazi_Epetra_OrthoManagerTester_1_MPI_4 (Failed)
        820 - Anasazi_Epetra_OrthoManagerTester_2_MPI_4 (Failed)
        821 - Anasazi_Epetra_OrthoManagerTester_3_MPI_4 (Failed)
        822 - Anasazi_Epetra_OrthoManagerTester_4_MPI_4 (Failed)
        823 - Anasazi_Epetra_OrthoManagerTester_5_MPI_4 (Failed)
        824 - Anasazi_Epetra_OrthoManagerMatTester_0_MPI_4 (Failed)
        825 - Anasazi_Epetra_OrthoManagerMatTester_1_MPI_4 (Failed)
        826 - Anasazi_Epetra_OrthoManagerMatTester_2_MPI_4 (Failed)
        827 - Anasazi_Epetra_OrthoManagerMatTester_3_MPI_4 (Failed)
        828 - Anasazi_Epetra_OrthoManagerMatTester_4_MPI_4 (Failed)
        829 - Anasazi_Epetra_OrthoManagerMatTester_5_MPI_4 (Failed)
        830 - Anasazi_Epetra_OrthoManagerGenTester_0_MPI_4 (Failed)
        831 - Anasazi_Epetra_OrthoManagerGenTester_1_MPI_4 (Failed)
        832 - Anasazi_Epetra_BlockDavidson_solvertest_MPI_4 (Failed)
        833 - Anasazi_Epetra_BlockDavidson_test_0_MPI_4 (Failed)
        834 - Anasazi_Epetra_BlockDavidson_test_1_MPI_4 (Failed)
        835 - Anasazi_Epetra_BlockDavidson_test_2_MPI_4 (Failed)
        836 - Anasazi_Epetra_BlockDavidson_test_3_MPI_4 (Failed)
        837 - Anasazi_Epetra_BlockDavidson_test_4_MPI_4 (Failed)
        838 - Anasazi_Epetra_BlockDavidson_test_5_MPI_4 (Failed)
        839 - Anasazi_Epetra_BlockDavidson_test_6_MPI_4 (Failed)
        840 - Anasazi_Epetra_BlockDavidson_test_7_MPI_4 (Failed)
        841 - Anasazi_Epetra_BlockDavidson_test_8_MPI_4 (Failed)
        842 - Anasazi_Epetra_BlockDavidson_auxtest_MPI_4 (Failed)
        843 - Anasazi_Epetra_BKS_solvertest_MPI_4 (Failed)
        845 - Anasazi_Epetra_BKS_test_1_MPI_4 (Failed)
        849 - Anasazi_Epetra_BKS_nh_test_1_MPI_4 (Failed)
        850 - Anasazi_Epetra_GeneralizedDavidson_solvertest_MPI_4 (Failed)
        853 - Anasazi_Epetra_LOBPCG_solvertest_MPI_4 (Failed)
        854 - Anasazi_Epetra_LOBPCG_simpletest_MPI_4 (Failed)
        855 - Anasazi_Epetra_LOBPCG_test_MPI_4 (Failed)
        856 - Anasazi_Epetra_LOBPCG_auxtest_MPI_4 (Failed)
        857 - Anasazi_Epetra_IRTR_test_0_MPI_4 (Failed)
        858 - Anasazi_Epetra_IRTR_test_1_MPI_4 (Failed)
        859 - Anasazi_Epetra_IRTR_test_2_MPI_4 (Failed)
        860 - Anasazi_Epetra_IRTR_test_3_MPI_4 (Failed)
        861 - Anasazi_Epetra_IRTR_auxtest_0_MPI_4 (Failed)
        862 - Anasazi_Epetra_IRTR_auxtest_1_MPI_4 (Failed)
        863 - Anasazi_Epetra_IRTR_auxtest_2_MPI_4 (Failed)
        864 - Anasazi_Epetra_IRTR_auxtest_3_MPI_4 (Failed)
        865 - Anasazi_Epetra_IRTR_auxtest_4_MPI_4 (Failed)
        872 - Anasazi_BlockDavidsonThyra_test_MPI_4 (Failed)
        875 - Anasazi_IRTRThyra_test_0_MPI_4 (Failed)
        876 - Anasazi_IRTRThyra_test_1_MPI_4 (Failed)
        877 - Anasazi_IRTRThyra_test_2_MPI_4 (Failed)
        878 - Anasazi_IRTRThyra_test_3_MPI_4 (Failed)
        879 - Anasazi_LOBPCGThyra_test_MPI_4 (Failed)
        886 - Anasazi_Tpetra_TraceMinDavidson_largest_standard_test_MPI_4 (Failed)
        928 - Stratimikos_Thyra_Belos_StatusTest_UnitTests_MPI_1 (Failed)
        936 - Stratimikos_Belos_GCRODR_strattest_MPI_4 (Failed)
        1344 - Intrepid2_unit-test_Orientation_Serial_Test_Orientation_TET_MPI_1 (Failed)
        1380 - NOX_LOCA_AnasaziJacobianInverse_MPI_1 (Timeout)
        1381 - NOX_LOCA_AnasaziNotConverged_MPI_1 (Timeout)
        1454 - NOX_LOCA_MultiPointTcubed_MPI_2 (Failed)
        1482 - MueLu_UnitTestsTpetra_MPI_4 (Timeout)
        1594 - Stokhos_TpetraCrsMatrixUQPCEUnitTest_Cuda_MPI_4 (Failed)
        1604 - Stokhos_TpetraCrsMatrixMPVectorUnitTest_Serial_MPI_4 (Failed)
        1642 - ROL_NonlinearProblemTest_MPI_4 (Timeout)
        1647 - ROL_test_elementwise_TpetraMultiVector_MPI_4 (Failed)
        1651 - ROL_test_function_BlockOperatorCheck_MPI_1 (Not Run)
        1797 - PanzerAdaptersSTK_scatter_field_evaluator_MPI_1 (Failed)

@ndellingwood
Copy link
Contributor Author

@crtrott Summary of build and test output posted.

@crtrott
Copy link
Member

crtrott commented Mar 8, 2018

Ok considering Jims post we can go ahead and merge!!! The Teuchos::null thing in Panzer can be done later.

@crtrott crtrott merged commit c9a19bf into develop Mar 8, 2018
@crtrott crtrott removed the stage: in progress Work on the issue has started label Mar 8, 2018
@crtrott crtrott deleted the kokkos-develop branch March 8, 2018 04:51
@crtrott
Copy link
Member

crtrott commented Mar 8, 2018

Merged!!

@crtrott
Copy link
Member

crtrott commented Mar 8, 2018

Nathan do you have the merge for Kokkos and KokkosKernels ready?

@crtrott
Copy link
Member

crtrott commented Mar 8, 2018

I.e. is everything in develop and is it just a straightforward merge at this point?

@ndellingwood
Copy link
Contributor Author

@crtrott I have the develop and master branches ready (on kokkos-dev) that we prepped for the snapshots into Trilinos. I don't have permissions to push them, how do we proceed?

@crtrott
Copy link
Member

crtrott commented Mar 8, 2018

ok I open this up now so you can push, and then I close this again.

@crtrott
Copy link
Member

crtrott commented Mar 8, 2018

OK Kokkos is open for you to push. Don't screw it up ;-)

@ndellingwood
Copy link
Contributor Author

Kokkos is done!
Need permission still for KokkosKernels,
remote: error: GH006: Protected branch update failed for refs/heads/develop.

@crtrott
Copy link
Member

crtrott commented Mar 8, 2018

ok opening up kokkos-kernels now.

@crtrott
Copy link
Member

crtrott commented Mar 8, 2018

Try now.

@ndellingwood
Copy link
Contributor Author

@crtrott I still need permission for the master branch on KokkosKernels, develop is done...

@crtrott
Copy link
Member

crtrott commented Mar 8, 2018

Try again

@ndellingwood
Copy link
Contributor Author

@crtrott develop and master branches updated in both Kokkos and KokkosKernels!

@crtrott
Copy link
Member

crtrott commented Mar 8, 2018

Branches are closed again.

@crtrott
Copy link
Member

crtrott commented Mar 8, 2018

Thanks Nathan for all the work on this !! Good job.

@ndellingwood
Copy link
Contributor Author

Thanks for all the help!!

@mhoemmen
Copy link
Contributor

mhoemmen commented Mar 8, 2018

YAY

@ibaned
Copy link
Contributor

ibaned commented Mar 8, 2018

For what its worth, the checkin script run also passed.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

9 participants