Implement a pipeline unit for selective pre-release filtering

[fridex]

Related Issues and Dependencies

Depends-On: thoth-station/python#334
Related: thoth-station/thoth-application#816
Related: pypa/pipenv#4607

This introduces a breaking change

• No

This Pull Request implements

With this change, we will provide experimental support for allowing pre-releases only for selected packages, based on configuration in Pipfile. Users can state which dependencies can be included in a form of pre-releases. An example could be the following Pipfile:

[[source]]
url = "https://pypi.org/simple"
verify_ssl = true
name = "pypi"

[packages]
tensorflow = ">=2.3"

[dev-packages]

[requires]
python_version = "3.6"

[thoth.allow_prereleases]
tensorflow = true

As stated in the configuration, resolver will include pre-releases only for matching TensorFlow=>2.3. As pre-releases apply only for TensorFlow itself, all the other packages will need to be released (not in a form of a pre-release). This configuration option is applicable to any dependencies in the dependency graph, not just for the direct ones.

As this feature is not supported by the Python community, we require custom configuration options in Pipfile which diverge from the upstream. Users should be aware that.

[fridex]

/hold

...wait for thoth-python release and I'll write some docs.

[sesheta]

Pytest Test failed! Click here

running test
WARNING: Testing via this command is deprecated and will be removed in a future version. Users looking for a generic test entry point independent of test runner are encouraged to use tox.
running egg_info
creating thoth_adviser.egg-info
writing thoth_adviser.egg-info/PKG-INFO
writing dependency_links to thoth_adviser.egg-info/dependency_links.txt
writing entry points to thoth_adviser.egg-info/entry_points.txt
writing requirements to thoth_adviser.egg-info/requires.txt
writing top-level names to thoth_adviser.egg-info/top_level.txt
writing manifest file 'thoth_adviser.egg-info/SOURCES.txt'
package init file 'docs/__init__.py' not found (or not a regular file)
package init file 'thoth/__init__.py' not found (or not a regular file)
package init file 'docs/source/__init__.py' not found (or not a regular file)
package init file 'docs/source/_static/__init__.py' not found (or not a regular file)
package init file 'docs/source/_templates/__init__.py' not found (or not a regular file)
package init file 'docs/source/predictors/__init__.py' not found (or not a regular file)
package init file 'tests/data/__init__.py' not found (or not a regular file)
package init file 'tests/data/graph/__init__.py' not found (or not a regular file)
package init file 'tests/data/projects/__init__.py' not found (or not a regular file)
package init file 'thoth/adviser/data/__init__.py' not found (or not a regular file)
package init file 'thoth/adviser/data/tensorflow/__init__.py' not found (or not a regular file)
reading manifest file 'thoth_adviser.egg-info/SOURCES.txt'
reading manifest template 'MANIFEST.in'
warning: no previously-included files found matching 'liveness.py'
warning: no previously-included files found matching '*.md'
warning: no previously-included files found matching '*.sh'
warning: no previously-included files found matching 'thoth-adviser'
warning: no previously-included files found matching '*.toml'
warning: no previously-included files found matching '*.yaml'
warning: no previously-included files found matching 'tests/wraps/pytorch/test_mkl_threads.txt'
warning: no previously-included files found matching 'thoth/adviser/wraps/pytorch/mkl_threads.txt'
warning: no files found matching '*.yaml' under directory 'openshift'
warning: no files found matching '*.yaml' under directory 'workflows'
writing manifest file 'thoth_adviser.egg-info/SOURCES.txt'
running build_ext
============================= test session starts ==============================
platform linux -- Python 3.8.3, pytest-6.2.2, py-1.10.0, pluggy-0.13.1 -- /opt/app-root/bin/python3
cachedir: .pytest_cache
hypothesis profile 'default' -> database=DirectoryBasedExampleDatabase('/workspace/repo/.hypothesis/examples')
rootdir: /workspace/repo
plugins: hypothesis-6.1.1, cov-2.11.1, mypy-0.8.0, timeout-1.4.2
timeout: 60.0s
timeout method: signal
timeout func_only: False
collecting ... collected 1321 items

tests/__init__.py::mypy PASSED
tests/__init__.py::mypy-status PASSED
tests/base.py::mypy PASSED
tests/conftest.py::mypy PASSED
tests/graph_mock.py::mypy PASSED
tests/helpers.py::mypy PASSED
tests/test_beam.py::mypy PASSED
tests/test_beam.py::TestBeam::test_initialization_positive PASSED
tests/test_beam.py::TestBeam::test_initialization_not_positive_error PASSED
tests/test_beam.py::TestBeam::test_wipe PASSED
tests/test_beam.py::TestBeam::test_add_state PASSED
tests/test_beam.py::TestBeam::test_get_random PASSED
tests/test_beam.py::TestBeam::test_iter_states_sorted PASSED
tests/test_beam.py::TestBeam::test_max PASSED
tests/test_beam.py::TestBeam::test_add_state_order_multi PASSED
tests/test_beam.py::TestBeam::test_add_state_order_single PASSED
tests/test_beam.py::TestBeam::test_remove PASSED
tests/test_context.py::mypy PASSED
tests/test_context.py::TestContext::test_get_package_version PASSED
tests/test_context.py::TestContext::test_get_package_version_graceful PASSED
tests/test_context.py::TestContext::test_get_top_accepted_final_state PASSED
tests/test_context.py::TestContext::test_register_accepted_final_state PASSED
tests/test_context.py::TestContext::test_register_package_version_existing PASSED
tests/test_context.py::TestContext::test_register_package_tuple_new PASSED
tests/test_context.py::TestContext::test_register_package_tuple_existing PASSED
tests/test_context.py::TestContext::test_note_dependencies PASSED
tests/test_context.py::TestContext::test_is_dependency_monkey PASSED
tests/test_context.py::TestContext::test_is_adviser PASSED
tests/test_context.py::TestContext::test_invalid_context_no_type PASSED
tests/test_context.py::TestContext::test_invalid_context_type PASSED
tests/test_dependency_monkey.py::mypy PASSED
tests/test_dependency_monkey.py::TestDependencyMonkey::test_construct PASSED
tests/test_dependency_monkey.py::TestDependencyMonkey::test_amun_output PASSED
tests/test_dependency_monkey.py::TestDependencyMonkey::test_dir_output PASSED
tests/test_dependency_monkey.py::TestDependencyMonkey::test_stdout_output PASSED
tests/test_dm_report.py::mypy PASSED
tests/test_dm_report.py::TestDependencyMonkeyReport::test_to_dict PASSED
tests/test_dm_report.py::TestDependencyMonkeyReport::test_add_responses PASSED
tests/test_exceptions.py::mypy PASSED
tests/test_exceptions.py::TestExceptions::test_exception_hierarchy PASSED
tests/test_pipeline_builder.py::mypy PASSED
tests/test_pipeline_builder.py::TestPipelineBuilderContext::test_is_included PASSED
tests/test_pipeline_builder.py::TestPipelineBuilderContext::test_is_adviser_pipeline PASSED
tests/test_pipeline_builder.py::TestPipelineBuilderContext::test_is_dependency_monkey_pipeline PASSED
tests/test_pipeline_builder.py::TestPipelineBuilderContext::test_invalid_pipeline_builder_context PASSED
tests/test_pipeline_builder.py::TestPipelineBuilderContext::test_add_unit[Boot2-boots] PASSED
tests/test_pipeline_builder.py::TestPipelineBuilderContext::test_add_unit[Pseudonym2-pseudonyms] PASSED
tests/test_pipeline_builder.py::TestPipelineBuilderContext::test_add_unit[Sieve2-sieves] PASSED
tests/test_pipeline_builder.py::TestPipelineBuilderContext::test_add_unit[Step2-steps] PASSED
tests/test_pipeline_builder.py::TestPipelineBuilderContext::test_add_unit[Stride2-strides] PASSED
tests/test_pipeline_builder.py::TestPipelineBuilderContext::test_add_unit[Wrap2-wraps] PASSED
tests/test_pipeline_builder.py::TestPipelineBuilderContext::test_get_included_boots PASSED
tests/test_pipeline_builder.py::TestPipelineBuilderContext::test_get_included_pseudonyms PASSED
tests/test_pipeline_builder.py::TestPipelineBuilderContext::test_get_included_sieves PASSED
tests/test_pipeline_builder.py::TestPipelineBuilderContext::test_get_included_steps PASSED
tests/test_pipeline_builder.py::TestPipelineBuilderContext::test_get_included_strides PASSED
tests/test_pipeline_builder.py::TestPipelineBuilderContext::test_get_included_wraps PASSED
tests/test_pipeline_builder.py::TestPipelineBuilder::test_build_configuration[get_adviser_pipeline_config-kwargs0] PASSED
tests/test_pipeline_builder.py::TestPipelineBuilder::test_build_configuration[get_dependency_monkey_pipeline_config-kwargs1] PASSED
tests/test_pipeline_builder.py::TestPipelineBuilder::test_blocked_units PASSED
tests/test_pipeline_builder.py::TestPipelineBuilder::test_from_dict PASSED
tests/test_pipeline_builder.py::TestPipelineBuilder::test_load PASSED
tests/test_pipeline_builder.py::TestPipelineBuilder::test_from_dict_unit_configuration_error PASSED
tests/test_pipeline_builder.py::TestPipelineBuilder::test_from_dict_unit_not_exist_error PASSED
tests/test_pipeline_config.py::mypy PASSED
tests/test_pipeline_config.py::TestPipelineConfig::test_to_dict PASSED
tests/test_pipeline_config.py::TestPipelineConfig::test_iter_units PASSED
tests/test_pipeline_config.py::TestPipelineConfig::test_call_pre_run PASSED
tests/test_pipeline_config.py::TestPipelineConfig::test_call_post_run PASSED
tests/test_pipeline_config.py::TestPipelineConfig::test_call_post_run_report PASSED
tests/test_predictor.py::mypy PASSED
tests/test_predictor.py::TestPredictor::test_keep_temperature_history_init PASSED
tests/test_predictor.py::TestPredictor::test_assign_context PASSED
tests/test_product.py::mypy PASSED
tests/test_product.py::TestProduct::test_from_final_state PASSED
tests/test_product.py::TestProduct::test_to_dict PASSED
tests/test_product.py::TestProduct::test_environment_markers PASSED
tests/test_product.py::TestProduct::test_environment_markers_shared PASSED
tests/test_report.py::mypy PASSED
tests/test_report.py::TestReport::test_stack_info PASSED
tests/test_report.py::TestReport::test_add_product PASSED
tests/test_report.py::TestReport::test_to_dict PASSED
tests/test_resolver.py::mypy PASSED
tests/test_resolver.py::TestResolver::test_run_boots PASSED
tests/test_resolver.py::TestResolver::test_run_boots_not_acceptable PASSED
tests/test_resolver.py::TestResolver::test_run_boots_error PASSED
tests/test_resolver.py::TestResolver::test_run_sieves PASSED
tests/test_resolver.py::TestResolver::test_run_sieves_error PASSED
tests/test_resolver.py::TestResolver::test_run_sieves_not_acceptable PASSED
tests/test_resolver.py::TestResolver::test_run_steps_not_acceptable PASSED
tests/test_resolver.py::TestResolver::test_run_steps_step_error PASSED
tests/test_resolver.py::TestResolver::test_run_steps_multi_package_resolution PASSED
tests/test_resolver.py::TestResolver::test_run_steps_error PASSED
tests/test_resolver.py::TestResolver::test_run_steps_inf_nan[inf] PASSED
tests/test_resolver.py::TestResolver::test_run_steps_inf_nan[nan] PASSED
tests/test_resolver.py::TestResolver::test_run_strides PASSED
tests/test_resolver.py::TestResolver::test_run_strides_not_acceptable PASSED
tests/test_resolver.py::TestResolver::test_run_strides_error PASSED
tests/test_resolver.py::TestResolver::test_run_wraps PASSED
tests/test_resolver.py::TestResolver::test_run_wraps_error PASSED
tests/test_resolver.py::TestResolver::test_resolve_direct_dependencies_multiple_error PASSED
tests/test_resolver.py::TestResolver::test_resolve_direct_dependencies_some_error PASSED
tests/test_resolver.py::TestResolver::test_resolve_direct_dependencies PASSED
tests/test_resolver.py::TestResolver::test_prepare_initial_state_limit_latest_versions PASSED
tests/test_resolver.py::TestResolver::test_prepare_initial_state_cannot_produce_stack PASSED
tests/test_resolver.py::TestResolver::test_prepare_initial_state PASSED
tests/test_resolver.py::TestResolver::test_expand_state_not_found_one_unresolved PASSED
tests/test_resolver.py::TestResolver::test_expand_state_not_found_more_unresolved PASSED
tests/test_resolver.py::TestResolver::test_expand_state_no_dependencies_final_simple PASSED
tests/test_resolver.py::TestResolver::test_expand_state_no_dependencies_final PASSED
tests/test_resolver.py::TestResolver::test_expand_state_no_dependencies_final_multiple_different PASSED
tests/test_resolver.py::TestResolver::test_expand_state_no_dependencies_final_multiple_same PASSED
tests/test_resolver.py::TestResolver::test_expand_state_no_intersection PASSED
tests/test_resolver.py::TestResolver::test_expand_state_sieves_discarded PASSED
tests/test_resolver.py::TestResolver::test_expand_state_intersection_adjust PASSED
tests/test_resolver.py::TestResolver::test_expand_state_no_dependencies_not_final PASSED
tests/test_resolver.py::TestResolver::test_expand_state_add_dependencies_call PASSED
tests/test_resolver.py::TestResolver::test_expand_state_add_dependencies_unsolved PASSED
tests/test_resolver.py::TestResolver::test_resolve_boot_error PASSED
tests/test_resolver.py::TestResolver::test_resolve_pre_run_error[boots] PASSED
tests/test_resolver.py::TestResolver::test_resolve_pre_run_error[sieves] PASSED
tests/test_resolver.py::TestResolver::test_resolve_pre_run_error[steps] PASSED
tests/test_resolver.py::TestResolver::test_resolve_pre_run_error[strides] PASSED
tests/test_resolver.py::TestResolver::test_resolve_pre_run_error[wraps] PASSED
tests/test_resolver.py::TestResolver::test_do_resolve_states_limit_reached PASSED
tests/test_resolver.py::TestResolver::test_expand_state_marker_true PASSED
tests/test_resolver.py::TestResolver::test_expand_state_marker_false PASSED
tests/test_resolver.py::TestResolver::test_do_resolve_states_beam_empty PASSED
tests/test_resolver.py::TestResolver::test_resolve_products PASSED
tests/test_resolver.py::TestResolver::test_resolve_products_eager_stop PASSED
tests/test_resolver.py::TestResolver::test_resolve_no_stack PASSED
tests/test_resolver.py::TestResolver::test_resolve PASSED
tests/test_resolver.py::TestResolver::test_get_adviser_instance PASSED
tests/test_resolver.py::TestResolver::test_get_dependency_monkey_instance PASSED
tests/test_resolver.py::TestResolver::test_positive_int_validator[-1-10] PASSED
tests/test_resolver.py::TestResolver::test_positive_int_validator[10--1] PASSED
tests/test_resolver.py::TestResolver::test_positive_int_validator[-1--1] PASSED
tests/test_resolver.py::TestResolver::test_positive_int_validator[0-10] PASSED
tests/test_resolver.py::TestResolver::test_positive_int_validator[10-0] PASSED
tests/test_resolver.py::TestResolver::test_positive_int_validator[0-0] PASSED
tests/test_resolver.py::TestResolver::test_no_direct_dependencies_error PASSED
tests/test_resolver.py::TestResolver::test_finalize_initial_state PASSED
tests/test_resolver.py::TestResolver::test_finalize_state PASSED
tests/test_resolver.py::TestResolver::test_step_boundaries[101.0-1.0] PASSED
tests/test_resolver.py::TestResolver::test_step_boundaries[-101.0--1.0] PASSED
tests/test_resolver.py::TestResolver::test_maybe_score_user_lock_file_no_lock_file PASSED
tests/test_resolver.py::TestResolver::test_maybe_score_user_lock_file_sieves_removal PASSED
tests/test_resolver.py::TestResolver::test_maybe_score_user_lock_file_steps_removal PASSED
tests/test_resolver.py::TestResolver::test_maybe_score_user_lock_file PASSED
tests/test_resolver.py::TestResolver::test_maybe_score_user_lock_file_error PASSED
tests/test_resolver.py::TestResolver::test_prepare_user_lock_file_index_not_enabled PASSED
tests/test_resolver.py::TestResolver::test_prepare_user_lock_file_provenance_unknown PASSED
tests/test_resolver.py::TestResolver::test_prepare_user_lock_file_one_source PASSED
tests/test_resolver.py::TestResolver::test_prepare_user_lock_file_multiple_sources PASSED
tests/test_resolver.py::TestResolver::test_sieve_skip_package_exception PASSED
tests/test_resolver.py::TestResolver::test_sieve_skip_package PASSED
tests/test_resolver.py::TestResolver::test_sieve_skip_package_unresolved PASSED
tests/test_resolver.py::TestResolver::test_sieve_skip_package_direct PASSED
tests/test_resolver.py::TestResolver::test_sieve_skip_package_user_stack PASSED
tests/test_resolver.py::TestResolver::test_sieve_skip_package_user_stack_direct PASSED
tests/test_resolver.py::TestResolver::test_step_skip_package_run_steps PASSED
tests/test_resolver.py::TestResolver::test_run_pseudonyms PASSED
tests/test_resolver.py::TestResolver::test_run_pseudonyms_initial_state PASSED
tests/test_resolver.py::TestResolver::test_run_pseudonym_units PASSED
tests/test_resolver.py::TestResolver::test_run_pseudonym_units_no_return PASSED
tests/test_resolver.py::TestResolver::test_run_pseudonym_units_already_resolved PASSED
tests/test_resolver.py::TestResolver::test_run_pseudonym_units_already_unresolved PASSED
tests/test_resolver.py::TestResolver::test_run_boots_only_none PASSED
tests/test_resolver.py::TestResolver::test_run_boots_with_none PASSED
tests/test_resolver.py::TestResolver::test_run_sieves_with_none PASSED
tests/test_resolver.py::TestResolver::test_run_sieves_only_none PASSED
tests/test_resolver.py::TestResolver::test_run_steps_with_none PASSED
tests/test_resolver.py::TestResolver::test_run_steps_only_none PASSED
tests/test_resolver.py::TestResolver::test_run_strides_only_none PASSED
tests/test_resolver.py::TestResolver::test_run_strides_with_none PASSED
tests/test_resolver.py::TestResolver::test_run_wraps_only_none PASSED
tests/test_resolver.py::TestResolver::test_run_wraps_with_none PASSED
tests/test_resolver.py::TestResolver::test_run_boot_unit_run PASSED
tests/test_resolver.py::TestResolver::test_run_pseudonym_unit_run PASSED
tests/test_resolver.py::TestResolver::test_run_sieves_unit_run PASSED
tests/test_resolver.py::TestResolver::test_run_steps_unit_run PASSED
tests/test_resolver.py::TestResolver::test_run_stride_unit_run PASSED
tests/test_resolver.py::TestResolver::test_run_wraps_unit_run PASSED
tests/test_resolver.py::TestResolver::test_run_steps_skip_package PASSED
tests/test_resolver.py::TestResolver::test_run_steps_skip_package_no_result PASSED
tests/test_resolver.py::TestResolver::test_run_steps_skip_package_unresolved PASSED
tests/test_resolver.py::TestResolver::test_run_steps_skip_package_no_unresolved PASSED
tests/test_resolver.py::TestResolver::test_run_steps_skip_package_beam_remove PASSED
tests/test_solver.py::mypy PASSED
tests/test_solver.py::TestSolver::test_db_0_raises[graph0] PASSED
tests/test_solver.py::TestSolver::test_db_0[graph0] PASSED
tests/test_solver.py::TestSolver::test_db_0_multiple[graph0] PASSED
tests/test_solver.py::TestSolver::test_db_0_package_raises[graph0] PASSED
tests/test_solver.py::TestSolver::test_db_0_all_package_versions[graph0] PASSED
tests/test_solver.py::TestSolver::test_db_0_package_multiple[graph0] PASSED
tests/test_solver.py::TestSolver::test_db_0_multiple_times_error[graph0] PASSED
tests/test_state.py::mypy PASSED
tests/test_state.py::TestState::test_justification PASSED
tests/test_state.py::TestState::test_is_final PASSED
tests/test_state.py::TestState::test_add_unresolved_dependency PASSED
tests/test_state.py::TestState::test_get_random_first_unresolved_dependency PASSED
tests/test_state.py::TestState::test_get_random_first_unresolved_dependency_error PASSED
tests/test_state.py::TestState::test_clone PASSED
tests/test_state.py::TestState::test_parent PASSED
tests/test_state.py::TestState::test_dict_order[0] PASSED
tests/test_state.py::TestState::test_dict_order[1] PASSED
tests/test_state.py::TestState::test_dict_order[2] PASSED
tests/test_state.py::TestState::test_dict_order[3] PASSED
tests/test_state.py::TestState::test_dict_order[4] PASSED
tests/test_step.py::mypy PASSED
tests/test_step.py::TestStep::test_boundaries PASSED
tests/test_unit.py::mypy PASSED
tests/test_unit.py::TestUnit::test_is_aicoe_release[package_version0-True] PASSED
tests/test_unit.py::TestUnit::test_is_aicoe_release[package_version1-True] PASSED
tests/test_unit.py::TestUnit::test_is_aicoe_release[package_version2-False] PASSED
tests/test_unit.py::TestUnit::test_get_aicoe_configuration[package_version0-expected0] PASSED
tests/test_unit.py::TestUnit::test_get_aicoe_configuration[package_version1-expected1] PASSED
tests/test_unit.py::TestUnit::test_get_aicoe_configuration[package_version2-None] PASSED
tests/boots/__init__.py::mypy PASSED
tests/boots/test_fully_specified_environment.py::mypy PASSED
tests/boots/test_fully_specified_environment.py::TestFullySpecifiedEnvironment::test_provided_unit_tested <- tests/base.py PASSED
tests/boots/test_fully_specified_environment.py::TestFullySpecifiedEnvironment::test_provided_package_version <- tests/base.py SKIPPED
tests/boots/test_fully_specified_environment.py::TestFullySpecifiedEnvironment::test_default_configuration <- tests/base.py PASSED
tests/boots/test_fully_specified_environment.py::TestFullySpecifiedEnvironment::test_super_pre_run <- tests/base.py SKIPPED
tests/boots/test_fully_specified_environment.py::TestFullySpecifiedEnvironment::test_default_multi_package_resolution <- tests/base.py SKIPPED
tests/boots/test_fully_specified_environment.py::TestFullySpecifiedEnvironment::test_verify_multiple_should_include PASSED
tests/boots/test_fully_specified_environment.py::TestFullySpecifiedEnvironment::test_should_include PASSED
tests/boots/test_fully_specified_environment.py::TestFullySpecifiedEnvironment::test_should_include_no_include PASSED
tests/boots/test_fully_specified_environment.py::TestFullySpecifiedEnvironment::test_run PASSED
tests/boots/test_fully_specified_environment.py::TestFullySpecifiedEnvironment::test_run_error PASSED
tests/boots/test_gpu.py::mypy PASSED
tests/boots/test_gpu.py::TestGPUBoot::test_provided_unit_tested <- tests/base.py PASSED
tests/boots/test_gpu.py::TestGPUBoot::test_provided_package_version <- tests/base.py SKIPPED
tests/boots/test_gpu.py::TestGPUBoot::test_default_configuration <- tests/base.py PASSED
tests/boots/test_gpu.py::TestGPUBoot::test_super_pre_run <- tests/base.py SKIPPED
tests/boots/test_gpu.py::TestGPUBoot::test_default_multi_package_resolution <- tests/base.py SKIPPED
tests/boots/test_gpu.py::TestGPUBoot::test_verify_multiple_should_include PASSED
tests/boots/test_gpu.py::TestGPUBoot::test_include_no_cuda PASSED
tests/boots/test_gpu.py::TestGPUBoot::test_include_no_gpu PASSED
tests/boots/test_gpu.py::TestGPUBoot::test_no_cuda PASSED
tests/boots/test_gpu.py::TestGPUBoot::test_no_gpu PASSED
tests/boots/test_pipfile_hash.py::mypy PASSED
tests/boots/test_pipfile_hash.py::TestPipifleHashBoot::test_provided_unit_tested <- tests/base.py PASSED
tests/boots/test_pipfile_hash.py::TestPipifleHashBoot::test_provided_package_version <- tests/base.py SKIPPED
tests/boots/test_pipfile_hash.py::TestPipifleHashBoot::test_default_configuration <- tests/base.py PASSED
tests/boots/test_pipfile_hash.py::TestPipifleHashBoot::test_super_pre_run <- tests/base.py SKIPPED
tests/boots/test_pipfile_hash.py::TestPipifleHashBoot::test_default_multi_package_resolution <- tests/base.py SKIPPED
tests/boots/test_pipfile_hash.py::TestPipifleHashBoot::test_verify_multiple_should_include PASSED
tests/boots/test_pipfile_hash.py::TestPipifleHashBoot::test_no_include_no_pipenv_files PASSED
tests/boots/test_pipfile_hash.py::TestPipifleHashBoot::test_should_include PASSED
tests/boots/test_pipfile_hash.py::TestPipifleHashBoot::test_run_hash_match PASSED
tests/boots/test_pipfile_hash.py::TestPipifleHashBoot::test_run_hash_mismatch PASSED
tests/boots/test_platform.py::mypy PASSED
tests/boots/test_platform.py::TestPlatformBoot::test_provided_unit_tested <- tests/base.py PASSED
tests/boots/test_platform.py::TestPlatformBoot::test_provided_package_version <- tests/base.py SKIPPED
tests/boots/test_platform.py::TestPlatformBoot::test_default_configuration <- tests/base.py PASSED
tests/boots/test_platform.py::TestPlatformBoot::test_super_pre_run <- tests/base.py SKIPPED
tests/boots/test_platform.py::TestPlatformBoot::test_default_multi_package_resolution <- tests/base.py SKIPPED
tests/boots/test_platform.py::TestPlatformBoot::test_verify_multiple_should_include PASSED
tests/boots/test_platform.py::TestPlatformBoot::test_should_include PASSED
tests/boots/test_platform.py::TestPlatformBoot::test_adjust PASSED
tests/boots/test_platform.py::TestPlatformBoot::test_no_platform PASSED
tests/boots/test_platform.py::TestPlatformBoot::test_no_adjust PASSED
tests/boots/test_python_version.py::mypy PASSED
tests/boots/test_python_version.py::TestPythonVersionBoot::test_provided_unit_tested <- tests/base.py PASSED
tests/boots/test_python_version.py::TestPythonVersionBoot::test_provided_package_version <- tests/base.py SKIPPED
tests/boots/test_python_version.py::TestPythonVersionBoot::test_default_configuration <- tests/base.py PASSED
tests/boots/test_python_version.py::TestPythonVersionBoot::test_super_pre_run <- tests/base.py SKIPPED
tests/boots/test_python_version.py::TestPythonVersionBoot::test_default_multi_package_resolution <- tests/base.py SKIPPED
tests/boots/test_python_version.py::TestPythonVersionBoot::test_verify_multiple_should_include PASSED
tests/boots/test_python_version.py::TestPythonVersionBoot::test_no_python_config PASSED
tests/boots/test_python_version.py::TestPythonVersionBoot::test_no_python_pipfile PASSED
tests/boots/test_python_version.py::TestPythonVersionBoot::test_python_version_mismatch PASSED
tests/boots/test_rhel_version.py::mypy PASSED
tests/boots/test_rhel_version.py::TestRHELVersionBoot::test_provided_unit_tested <- tests/base.py PASSED
tests/boots/test_rhel_version.py::TestRHELVersionBoot::test_provided_package_version <- tests/base.py SKIPPED
tests/boots/test_rhel_version.py::TestRHELVersionBoot::test_default_configuration <- tests/base.py PASSED
tests/boots/test_rhel_version.py::TestRHELVersionBoot::test_super_pre_run <- tests/base.py SKIPPED
tests/boots/test_rhel_version.py::TestRHELVersionBoot::test_default_multi_package_resolution <- tests/base.py SKIPPED
tests/boots/test_rhel_version.py::TestRHELVersionBoot::test_verify_multiple_should_include PASSED
tests/boots/test_rhel_version.py::TestRHELVersionBoot::test_version_change PASSED
tests/boots/test_rhel_version.py::TestRHELVersionBoot::test_version_no_change_no_os_match PASSED
tests/boots/test_rhel_version.py::TestRHELVersionBoot::test_version_no_change_no_version PASSED
tests/boots/test_solved_software_environment.py::mypy PASSED
tests/boots/test_solved_software_environment.py::TestSolvedSoftwareEnvironmentBoot::test_provided_unit_tested <- tests/base.py PASSED
tests/boots/test_solved_software_environment.py::TestSolvedSoftwareEnvironmentBoot::test_provided_package_version <- tests/base.py SKIPPED
tests/boots/test_solved_software_environment.py::TestSolvedSoftwareEnvironmentBoot::test_default_configuration <- tests/base.py PASSED
tests/boots/test_solved_software_environment.py::TestSolvedSoftwareEnvironmentBoot::test_super_pre_run <- tests/base.py SKIPPED
tests/boots/test_solved_software_environment.py::TestSolvedSoftwareEnvironmentBoot::test_default_multi_package_resolution <- tests/base.py SKIPPED
tests/boots/test_solved_software_environment.py::TestSolvedSoftwareEnvironmentBoot::test_verify_multiple_should_include PASSED
tests/boots/test_solved_software_environment.py::TestSolvedSoftwareEnvironmentBoot::test_should_include PASSED
tests/boots/test_solved_software_environment.py::TestSolvedSoftwareEnvironmentBoot::test_should_include_not_fully_specified PASSED
tests/boots/test_solved_software_environment.py::TestSolvedSoftwareEnvironmentBoot::test_run PASSED
tests/boots/test_solved_software_environment.py::TestSolvedSoftwareEnvironmentBoot::test_run_error PASSED
tests/boots/test_ubi.py::mypy PASSED
tests/boots/test_ubi.py::TestUbiBoot::test_provided_unit_tested <- tests/base.py PASSED
tests/boots/test_ubi.py::TestUbiBoot::test_provided_package_version <- tests/base.py SKIPPED
tests/boots/test_ubi.py::TestUbiBoot::test_default_configuration <- tests/base.py PASSED
tests/boots/test_ubi.py::TestUbiBoot::test_super_pre_run <- tests/base.py SKIPPED
tests/boots/test_ubi.py::TestUbiBoot::test_default_multi_package_resolution <- tests/base.py SKIPPED
tests/boots/test_ubi.py::TestUbiBoot::test_verify_multiple_should_include PASSED
tests/boots/test_ubi.py::TestUbiBoot::test_rhel_assign PASSED
tests/boots/test_ubi.py::TestUbiBoot::test_no_rhel_assign PASSED
tests/predictors/__init__.py::mypy PASSED
tests/predictors/test_annealing.py::mypy PASSED
tests/predictors/test_annealing.py::TestAdaptiveSimulatedAnnealing::test_temperature_function PASSED
tests/predictors/test_annealing.py::TestAdaptiveSimulatedAnnealing::test_acceptance_probability PASSED
tests/predictors/test_annealing.py::TestAdaptiveSimulatedAnnealing::test_pre_run PASSED
tests/predictors/test_annealing.py::TestAdaptiveSimulatedAnnealing::test_run PASSED
tests/predictors/test_hill_climbing.py::mypy PASSED
tests/predictors/test_hill_climbing.py::TestHillClimbing::test_run PASSED
tests/predictors/test_hill_climbing.py::TestHillClimbing::test_pre_run PASSED
tests/predictors/test_latest.py::mypy PASSED
tests/predictors/test_latest.py::TestApproximatingLatest::test_run PASSED
tests/predictors/test_latest.py::TestApproximatingLatest::test_heat_up PASSED
tests/predictors/test_latest.py::TestApproximatingLatest::test_heat_up_end PASSED
tests/predictors/test_mcts.py::mypy PASSED
tests/predictors/test_mcts.py::TestMCTS::test_init PASSED
tests/predictors/test_mcts.py::TestMCTS::test_pre_run PASSED
tests/predictors/test_mcts.py::TestMCTS::test_set_reward_signal_nan PASSED
tests/predictors/test_mcts.py::TestMCTS::test_set_reward_signal PASSED
tests/predictors/test_mcts.py::TestMCTS::test_set_reward_signal_inf PASSED
tests/predictors/test_mcts.py::TestMCTS::test_run_heat_up[None] PASSED
tests/predictors/test_mcts.py::TestMCTS::test_run_heat_up[next_state1] PASSED
tests/predictors/test_mcts.py::TestMCTS::test_run_next_state PASSED
tests/predictors/test_mcts.py::TestMCTS::test_run_next_state_no_last PASSED
tests/predictors/test_mcts.py::TestMCTS::test_run_no_next_state PASSED
tests/predictors/test_package_combinations.py::mypy PASSED
tests/predictors/test_package_combinations.py::TestPackageCombinations::test_pre_run_error PASSED
tests/predictors/test_package_combinations.py::TestPackageCombinations::test_pre_run PASSED
tests/predictors/test_random_walk.py::mypy PASSED
tests/predictors/test_random_walk.py::TestRandomWalk::test_run PASSED
tests/predictors/test_random_walk.py::TestRandomWalk::test_pre_run PASSED
tests/predictors/test_sampling.py::mypy PASSED
tests/predictors/test_sampling.py::TestSampling::test_run PASSED
tests/predictors/test_sampling.py::TestSampling::test_pre_run PASSED
tests/predictors/test_td.py::mypy PASSED
tests/predictors/test_td.py::TestTemporalDifference::test_acceptance_probability PASSED
tests/predictors/test_td.py::TestTemporalDifference::test_temperature_function PASSED
tests/predictors/test_td.py::TestTemporalDifference::test_init PASSED
tests/predictors/test_td.py::TestTemporalDifference::test_pre_run PASSED
tests/predictors/test_td.py::TestTemporalDifference::test_set_reward_signal_nan_inf[nan] PASSED
tests/predictors/test_td.py::TestTemporalDifference::test_set_reward_signal_nan_inf[inf] PASSED
tests/predictors/test_td.py::TestTemporalDifference::test_set_reward_signal_nan_inf[-inf] PASSED
tests/predictors/test_td.py::TestTemporalDifference::test_set_reward_signal_unseen PASSED
tests/predictors/test_td.py::TestTemporalDifference::test_set_reward_signal_seen PASSED
tests/predictors/test_td.py::TestTemporalDifference::test_do_exploitation PASSED
tests/predictors/test_td.py::TestTemporalDifference::test_do_exploitation_no_records PASSED
tests/predictors/test_td.py::TestTemporalDifference::test_run_exploration PASSED
tests/predictors/test_td.py::TestTemporalDifference::test_run_exploitation PASSED
tests/predictors/test_td.py::TestTemporalDifference::test_validation PASSED
tests/predictors/test_td.py::TestTemporalDifference::test_step_default PASSED
tests/predictors/test_td.py::TestTemporalDifference::test_n_step_td_step_adjust PASSED
tests/predictors/test_td.py::TestTemporalDifference::test_n_step_td_step_no_adjust PASSED
tests/pseudonyms/__init__.py::mypy PASSED
tests/pseudonyms/test_intel_tensorflow.py::mypy PASSED
tests/pseudonyms/test_intel_tensorflow.py::TestIntelTensorFlowPseudonym::test_provided_unit_tested <- tests/base.py PASSED
tests/pseudonyms/test_intel_tensorflow.py::TestIntelTensorFlowPseudonym::test_provided_package_version <- tests/base.py PASSED
tests/pseudonyms/test_intel_tensorflow.py::TestIntelTensorFlowPseudonym::test_default_configuration <- tests/base.py PASSED
tests/pseudonyms/test_intel_tensorflow.py::TestIntelTensorFlowPseudonym::test_super_pre_run <- tests/base.py PASSED
tests/pseudonyms/test_intel_tensorflow.py::TestIntelTensorFlowPseudonym::test_default_multi_package_resolution <- tests/base.py SKIPPED
tests/pseudonyms/test_intel_tensorflow.py::TestIntelTensorFlowPseudonym::test_verify_multiple_should_include PASSED
tests/pseudonyms/test_intel_tensorflow.py::TestIntelTensorFlowPseudonym::test_recommendation_types_considered PASSED
tests/pseudonyms/test_intel_tensorflow.py::TestIntelTensorFlowPseudonym::test_include[RecommendationType.TESTING] PASSED
tests/pseudonyms/test_intel_tensorflow.py::TestIntelTensorFlowPseudonym::test_include[RecommendationType.STABLE] PASSED
tests/pseudonyms/test_intel_tensorflow.py::TestIntelTensorFlowPseudonym::test_include[RecommendationType.PERFORMANCE] PASSED
tests/pseudonyms/test_intel_tensorflow.py::TestIntelTensorFlowPseudonym::test_include[RecommendationType.SECURITY] PASSED
tests/pseudonyms/test_intel_tensorflow.py::TestIntelTensorFlowPseudonym::test_no_include[RecommendationType.LATEST-None-None] PASSED
tests/pseudonyms/test_intel_tensorflow.py::TestIntelTensorFlowPseudonym::test_no_include[RecommendationType.TESTING-None-10.1] PASSED
tests/pseudonyms/test_intel_tensorflow.py::TestIntelTensorFlowPseudonym::test_no_include[None-DecisionType.RANDOM-None] PASSED
tests/pseudonyms/test_intel_tensorflow.py::TestIntelTensorFlowPseudonym::test_pre_run PASSED
tests/pseudonyms/test_intel_tensorflow.py::TestIntelTensorFlowPseudonym::test_run_pseudonym PASSED
tests/pseudonyms/test_intel_tensorflow.py::TestIntelTensorFlowPseudonym::test_run_noop[tf_versions0] PASSED
tests/pseudonyms/test_intel_tensorflow.py::TestIntelTensorFlowPseudonym::test_run_noop[tf_versions1] PASSED
tests/pseudonyms/test_tensorflow_gpu.py::mypy PASSED
tests/pseudonyms/test_tensorflow_gpu.py::TestTensorFlowGPUPseudonym::test_provided_unit_tested <- tests/base.py PASSED
tests/pseudonyms/test_tensorflow_gpu.py::TestTensorFlowGPUPseudonym::test_provided_package_version <- tests/base.py PASSED
tests/pseudonyms/test_tensorflow_gpu.py::TestTensorFlowGPUPseudonym::test_default_configuration <- tests/base.py PASSED
tests/pseudonyms/test_tensorflow_gpu.py::TestTensorFlowGPUPseudonym::test_super_pre_run <- tests/base.py PASSED
tests/pseudonyms/test_tensorflow_gpu.py::TestTensorFlowGPUPseudonym::test_default_multi_package_resolution <- tests/base.py SKIPPED
tests/pseudonyms/test_tensorflow_gpu.py::TestTensorFlowGPUPseudonym::test_verify_multiple_should_include PASSED
tests/pseudonyms/test_tensorflow_gpu.py::TestTensorFlowGPUPseudonym::test_recommendation_types_considered PASSED
tests/pseudonyms/test_tensorflow_gpu.py::TestTensorFlowGPUPseudonym::test_include[RecommendationType.TESTING] PASSED
tests/pseudonyms/test_tensorflow_gpu.py::TestTensorFlowGPUPseudonym::test_include[RecommendationType.STABLE] PASSED
tests/pseudonyms/test_tensorflow_gpu.py::TestTensorFlowGPUPseudonym::test_include[RecommendationType.PERFORMANCE] PASSED
tests/pseudonyms/test_tensorflow_gpu.py::TestTensorFlowGPUPseudonym::test_include[RecommendationType.SECURITY] PASSED
tests/pseudonyms/test_tensorflow_gpu.py::TestTensorFlowGPUPseudonym::test_no_include[RecommendationType.LATEST-None-10.1] PASSED
tests/pseudonyms/test_tensorflow_gpu.py::TestTensorFlowGPUPseudonym::test_no_include[RecommendationType.PERFORMANCE-None-None] PASSED
tests/pseudonyms/test_tensorflow_gpu.py::TestTensorFlowGPUPseudonym::test_no_include[None-DecisionType.RANDOM-None] PASSED
tests/pseudonyms/test_tensorflow_gpu.py::TestTensorFlowGPUPseudonym::test_pre_run PASSED
tests/pseudonyms/test_tensorflow_gpu.py::TestTensorFlowGPUPseudonym::test_run_pseudonym PASSED
tests/pseudonyms/test_tensorflow_gpu.py::TestTensorFlowGPUPseudonym::test_run_noop[tf_versions0] PASSED
tests/pseudonyms/test_tensorflow_gpu.py::TestTensorFlowGPUPseudonym::test_run_noop[tf_versions1] PASSED
tests/pseudonyms/_debug/__init__.py::mypy PASSED
tests/pseudonyms/_debug/test_alias.py::mypy PASSED
tests/pseudonyms/_debug/test_alias.py::TestAliasPseudonym::test_provided_unit_tested <- tests/base.py PASSED
tests/pseudonyms/_debug/test_alias.py::TestAliasPseudonym::test_super_pre_run <- tests/base.py PASSED
tests/pseudonyms/_debug/test_alias.py::TestAliasPseudonym::test_default_multi_package_resolution <- tests/base.py SKIPPED
tests/pseudonyms/_debug/test_alias.py::TestAliasPseudonym::test_verify_multiple_should_include SKIPPED
tests/pseudonyms/_debug/test_alias.py::TestAliasPseudonym::test_default_configuration SKIPPED
tests/pseudonyms/_debug/test_alias.py::TestAliasPseudonym::test_provided_package_version SKIPPED
tests/pseudonyms/_debug/test_alias.py::TestAliasPseudonym::test_no_include PASSED
tests/pseudonyms/_debug/test_alias.py::TestAliasPseudonym::test_run_pseudonym[2.2.0-https://pypi.org/simple] PASSED
tests/pseudonyms/_debug/test_alias.py::TestAliasPseudonym::test_run_pseudonym[None-https://pypi.org/simple] PASSED
tests/pseudonyms/_debug/test_alias.py::TestAliasPseudonym::test_run_pseudonym[2.2.0-None] PASSED
tests/pseudonyms/_debug/test_alias.py::TestAliasPseudonym::test_run_pseudonym[None-None] PASSED
tests/pseudonyms/_debug/test_alias.py::TestAliasPseudonym::test_run_noop[==1.1.1-https://pypi.org/simple-2.2.0-https://pypi.org/simple] PASSED
tests/pseudonyms/_debug/test_alias.py::TestAliasPseudonym::test_run_noop[==1.1.1-https://pypi.org/simple-2.2.0-None] PASSED
tests/pseudonyms/_debug/test_alias.py::TestAliasPseudonym::test_run_noop[==2.2.0-https://thoth-station.ninja/simple-2.2.0-https://pypi.org/simple] PASSED
tests/pseudonyms/_debug/test_alias.py::TestAliasPseudonym::test_run_noop[==2.2.0-https://thoth-station.ninja/simple-None-https://pypi.org/simple] PASSED
tests/pseudonyms/_debug/test_alias.py::TestAliasPseudonym::test_run_noop[==1.1.1-https://thoth-station.ninja/simple-2.2.0-https://pypi.org/simple] PASSED
tests/sieves/__init__.py::mypy PASSED
tests/sieves/test_experimental_prereleases.py::mypy PASSED
tests/sieves/test_experimental_prereleases.py::TestSelctiveCutPreReleasesSieve::test_provided_unit_tested <- tests/base.py PASSED
tests/sieves/test_experimental_prereleases.py::TestSelctiveCutPreReleasesSieve::test_provided_package_version <- tests/base.py PASSED
tests/sieves/test_experimental_prereleases.py::TestSelctiveCutPreReleasesSieve::test_super_pre_run <- tests/base.py PASSED
tests/sieves/test_experimental_prereleases.py::TestSelctiveCutPreReleasesSieve::test_default_multi_package_resolution <- tests/base.py SKIPPED
tests/sieves/test_experimental_prereleases.py::TestSelctiveCutPreReleasesSieve::test_include[RecommendationType.STABLE] FAILED
tests/sieves/test_experimental_prereleases.py::TestSelctiveCutPreReleasesSieve::test_include[RecommendationType.PERFORMANCE] FAILED
tests/sieves/test_experimental_prereleases.py::TestSelctiveCutPreReleasesSieve::test_include[RecommendationType.SECURITY] FAILED
tests/sieves/test_experimental_prereleases.py::TestSelctiveCutPreReleasesSieve::test_include[RecommendationType.LATEST] FAILED
tests/sieves/test_experimental_prereleases.py::TestSelctiveCutPreReleasesSieve::test_include[RecommendationType.TESTING] FAILED
tests/sieves/test_experimental_prereleases.py::TestSelctiveCutPreReleasesSieve::test_verify_multiple_should_include FAILED
tests/sieves/test_experimental_prereleases.py::TestSelctiveCutPreReleasesSieve::test_default_configuration SKIPPED
tests/sieves/test_experimental_prereleases.py::TestSelctiveCutPreReleasesSieve::test_not_include[RecommendationType.STABLE-\n[[source]]\nurl = "https://pypi.org/simple"\nverify_ssl = true\nname = "pypi"\n\n[packages]\ntensorflow = "*"\n\n[pipenv]\nallow_prereleases = true\n\n[thoth.allow_prereleases]\ntensorflow = true\nflask = false\n] PASSED
tests/sieves/test_experimental_prereleases.py::TestSelctiveCutPreReleasesSieve::test_not_include[RecommendationType.STABLE-\n[[source]]\nurl = "https://pypi.org/simple"\nverify_ssl = true\nname = "pypi"\n\n[packages]\ntensorflow = "*"\n\n[pipenv]\nallow_prereleases = false\n] PASSED
tests/sieves/test_experimental_prereleases.py::TestSelctiveCutPreReleasesSieve::test_not_include[RecommendationType.PERFORMANCE-\n[[source]]\nurl = "https://pypi.org/simple"\nverify_ssl = true\nname = "pypi"\n\n[packages]\ntensorflow = "*"\n\n[pipenv]\nallow_prereleases = true\n\n[thoth.allow_prereleases]\ntensorflow = true\nflask = false\n] PASSED
tests/sieves/test_experimental_prereleases.py::TestSelctiveCutPreReleasesSieve::test_not_include[RecommendationType.PERFORMANCE-\n[[source]]\nurl = "https://pypi.org/simple"\nverify_ssl = true\nname = "pypi"\n\n[packages]\ntensorflow = "*"\n\n[pipenv]\nallow_prereleases = false\n] PASSED
tests/sieves/test_experimental_prereleases.py::TestSelctiveCutPreReleasesSieve::test_not_include[RecommendationType.SECURITY-\n[[source]]\nurl = "https://pypi.org/simple"\nverify_ssl = true\nname = "pypi"\n\n[packages]\ntensorflow = "*"\n\n[pipenv]\nallow_prereleases = true\n\n[thoth.allow_prereleases]\ntensorflow = true\nflask = false\n] PASSED
tests/sieves/test_experimental_prereleases.py::TestSelctiveCutPreReleasesSieve::test_not_include[RecommendationType.SECURITY-\n[[source]]\nurl = "https://pypi.org/simple"\nverify_ssl = true\nname = "pypi"\n\n[packages]\ntensorflow = "*"\n\n[pipenv]\nallow_prereleases = false\n] PASSED
tests/sieves/test_experimental_prereleases.py::TestSelctiveCutPreReleasesSieve::test_not_include[RecommendationType.LATEST-\n[[source]]\nurl = "https://pypi.org/simple"\nverify_ssl = true\nname = "pypi"\n\n[packages]\ntensorflow = "*"\n\n[pipenv]\nallow_prereleases = true\n\n[thoth.allow_prereleases]\ntensorflow = true\nflask = false\n] PASSED
tests/sieves/test_experimental_prereleases.py::TestSelctiveCutPreReleasesSieve::test_not_include[RecommendationType.LATEST-\n[[source]]\nurl = "https://pypi.org/simple"\nverify_ssl = true\nname = "pypi"\n\n[packages]\ntensorflow = "*"\n\n[pipenv]\nallow_prereleases = false\n] PASSED
tests/sieves/test_experimental_prereleases.py::TestSelctiveCutPreReleasesSieve::test_not_include[RecommendationType.TESTING-\n[[source]]\nurl = "https://pypi.org/simple"\nverify_ssl = true\nname = "pypi"\n\n[packages]\ntensorflow = "*"\n\n[pipenv]\nallow_prereleases = true\n\n[thoth.allow_prereleases]\ntensorflow = true\nflask = false\n] PASSED
tests/sieves/test_experimental_prereleases.py::TestSelctiveCutPreReleasesSieve::test_not_include[RecommendationType.TESTING-\n[[source]]\nurl = "https://pypi.org/simple"\nverify_ssl = true\nname = "pypi"\n\n[packages]\ntensorflow = "*"\n\n[pipenv]\nallow_prereleases = false\n] PASSED
tests/sieves/test_experimental_prereleases.py::TestSelctiveCutPreReleasesSieve::test_remove_pre_releases_disallowed_noop[tensorflow-2.4.0rc1] FAILED
tests/sieves/test_experimental_prereleases.py::TestSelctiveCutPreReleasesSieve::test_remove_pre_releases_disallowed_noop[flask-1.0] FAILED
tests/sieves/test_experimental_prereleases.py::TestSelctiveCutPreReleasesSieve::test_pre_releases_disallowed_removal[flask-1.0dev0] FAILED
tests/sieves/test_experimental_prereleases.py::TestSelctiveCutPreReleasesSieve::test_pre_releases_disallowed_removal[numpy-1.0dev0] FAILED
tests/sieves/test_filter_index.py::mypy PASSED
tests/sieves/test_filter_index.py::TestFilterIndexSieve::test_provided_unit_tested <- tests/base.py PASSED
tests/sieves/test_filter_index.py::TestFilterIndexSieve::test_provided_package_version <- tests/base.py PASSED
tests/sieves/test_filter_index.py::TestFilterIndexSieve::test_super_pre_run <- tests/base.py PASSED
tests/sieves/test_filter_index.py::TestFilterIndexSieve::test_default_multi_package_resolution <- tests/base.py SKIPPED
tests/sieves/test_filter_index.py::TestFilterIndexSieve::test_verify_multiple_should_include SKIPPED
tests/sieves/test_filter_index.py::TestFilterIndexSieve::test_default_configuration PASSED
tests/sieves/test_filter_index.py::TestFilterIndexSieve::test_run_filter PASSED
tests/sieves/test_filter_index.py::TestFilterIndexSieve::test_run_no_filter PASSED
tests/sieves/test_filter_index.py::TestFilterIndexSieve::test_run_no_filter_multiple PASSED
tests/sieves/test_index_enabled.py::mypy PASSED
tests/sieves/test_index_enabled.py::TestPackageIndexSieve::test_provided_unit_tested <- tests/base.py PASSED
tests/sieves/test_index_enabled.py::TestPackageIndexSieve::test_provided_package_version <- tests/base.py PASSED
tests/sieves/test_index_enabled.py::TestPackageIndexSieve::test_default_configuration <- tests/base.py PASSED
tests/sieves/test_index_enabled.py::TestPackageIndexSieve::test_super_pre_run <- tests/base.py PASSED
tests/sieves/test_index_enabled.py::TestPackageIndexSieve::test_default_multi_package_resolution <- tests/base.py SKIPPED
tests/sieves/test_index_enabled.py::TestPackageIndexSieve::test_verify_multiple_should_include PASSED
tests/sieves/test_index_enabled.py::TestPackageIndexSieve::test_sieve_index_enabled PASSED
tests/sieves/test_index_enabled.py::TestPackageIndexSieve::test_sieve_index_disabled PASSED
tests/sieves/test_index_enabled.py::TestPackageIndexSieve::test_sieve_index_not_found PASSED
tests/sieves/test_locked.py::mypy PASSED
tests/sieves/test_locked.py::TestCutPreReleasesSieve::test_provided_unit_tested <- tests/base.py PASSED
tests/sieves/test_locked.py::TestCutPreReleasesSieve::test_provided_package_version <- tests/base.py PASSED
tests/sieves/test_locked.py::TestCutPreReleasesSieve::test_default_configuration <- tests/base.py PASSED
tests/sieves/test_locked.py::TestCutPreReleasesSieve::test_super_pre_run <- tests/base.py PASSED
tests/sieves/test_locked.py::TestCutPreReleasesSieve::test_default_multi_package_resolution <- tests/base.py SKIPPED
tests/sieves/test_locked.py::TestCutPreReleasesSieve::test_verify_multiple_should_include PASSED
tests/sieves/test_locked.py::TestCutPreReleasesSieve::test_cut_locked PASSED
tests/sieves/test_locked.py::TestCutPreReleasesSieve::test_cut_locked_dev PASSED
tests/sieves/test_locked.py::TestCutPreReleasesSieve::test_no_cut PASSED
tests/sieves/test_locked.py::TestCutPreReleasesSieve::test_no_cut_dev PASSED
tests/sieves/test_locked.py::TestCutPreReleasesSieve::test_noop PASSED
tests/sieves/test_locked.py::TestCutPreReleasesSieve::test_noop_dev PASSED
tests/sieves/test_prereleases.py::mypy PASSED
tests/sieves/test_prereleases.py::TestCutPreReleasesSieve::test_provided_unit_tested <- tests/base.py PASSED
tests/sieves/test_prereleases.py::TestCutPreReleasesSieve::test_provided_package_version <- tests/base.py PASSED
tests/sieves/test_prereleases.py::TestCutPreReleasesSieve::test_default_configuration <- tests/base.py PASSED
tests/sieves/test_prereleases.py::TestCutPreReleasesSieve::test_super_pre_run <- tests/base.py PASSED
tests/sieves/test_prereleases.py::TestCutPreReleasesSieve::test_default_multi_package_resolution <- tests/base.py SKIPPED
tests/sieves/test_prereleases.py::TestCutPreReleasesSieve::test_include[RecommendationType.STABLE] PASSED
tests/sieves/test_prereleases.py::TestCutPreReleasesSieve::test_include[RecommendationType.PERFORMANCE] PASSED
tests/sieves/test_prereleases.py::TestCutPreReleasesSieve::test_include[RecommendationType.SECURITY] PASSED
tests/sieves/test_prereleases.py::TestCutPreReleasesSieve::test_include[RecommendationType.LATEST] PASSED
tests/sieves/test_prereleases.py::TestCutPreReleasesSieve::test_include[RecommendationType.TESTING] PASSED
tests/sieves/test_prereleases.py::TestCutPreReleasesSieve::test_not_include[RecommendationType.STABLE] PASSED
tests/sieves/test_prereleases.py::TestCutPreReleasesSieve::test_not_include[RecommendationType.PERFORMANCE] PASSED
tests/sieves/test_prereleases.py::TestCutPreReleasesSieve::test_not_include[RecommendationType.SECURITY] PASSED
tests/sieves/test_prereleases.py::TestCutPreReleasesSieve::test_not_include[RecommendationType.LATEST] PASSED
tests/sieves/test_prereleases.py::TestCutPreReleasesSieve::test_not_include[RecommendationType.TESTING] PASSED
tests/sieves/test_prereleases.py::TestCutPreReleasesSieve::test_verify_multiple_should_include PASSED
tests/sieves/test_prereleases.py::TestCutPreReleasesSieve::test_remove_pre_releases_disallowed_noop PASSED
tests/sieves/test_prereleases.py::TestCutPreReleasesSieve::test_pre_releases_disallowed_removal PASSED
tests/sieves/test_solved.py::mypy PASSED
tests/sieves/test_solved.py::TestSolvedSieve::test_provided_unit_tested <- tests/base.py PASSED
tests/sieves/test_solved.py::TestSolvedSieve::test_provided_package_version <- tests/base.py PASSED
tests/sieves/test_solved.py::TestSolvedSieve::test_super_pre_run <- tests/base.py PASSED
tests/sieves/test_solved.py::TestSolvedSieve::test_default_multi_package_resolution <- tests/base.py SKIPPED
tests/sieves/test_solved.py::TestSolvedSieve::test_verify_multiple_should_include PASSED
tests/sieves/test_solved.py::TestSolvedSieve::test_not_found PASSED
tests/sieves/test_solved.py::TestSolvedSieve::test_not_solved_without_error PASSED
tests/sieves/test_solved.py::TestSolvedSieve::test_acceptable_with_error PASSED
tests/sieves/test_solved.py::TestSolvedSieve::test_default_configuration PASSED
tests/sieves/test_thoth_s2i_abi_compat.py::mypy PASSED
tests/sieves/test_thoth_s2i_abi_compat.py::TestThothS2IAbiCompatibilitySieve::test_provided_unit_tested <- tests/base.py PASSED
tests/sieves/test_thoth_s2i_abi_compat.py::TestThothS2IAbiCompatibilitySieve::test_provided_package_version <- tests/base.py PASSED
tests/sieves/test_thoth_s2i_abi_compat.py::TestThothS2IAbiCompatibilitySieve::test_default_configuration <- tests/base.py PASSED
tests/sieves/test_thoth_s2i_abi_compat.py::TestThothS2IAbiCompatibilitySieve::test_default_multi_package_resolution <- tests/base.py SKIPPED
tests/sieves/test_thoth_s2i_abi_compat.py::TestThothS2IAbiCompatibilitySieve::test_verify_multiple_should_include PASSED
tests/sieves/test_thoth_s2i_abi_compat.py::TestThothS2IAbiCompatibilitySieve::test_no_should_include[None] PASSED
tests/sieves/test_thoth_s2i_abi_compat.py::TestThothS2IAbiCompatibilitySieve::test_no_should_include[fedora:32] PASSED
tests/sieves/test_thoth_s2i_abi_compat.py::TestThothS2IAbiCompatibilitySieve::test_should_include PASSED
tests/sieves/test_thoth_s2i_abi_compat.py::TestThothS2IAbiCompatibilitySieve::test_no_thoth_s2i_version PASSED
tests/sieves/test_thoth_s2i_abi_compat.py::TestThothS2IAbiCompatibilitySieve::test_abi_compat_symbols_present PASSED
tests/sieves/test_thoth_s2i_abi_compat.py::TestThothS2IAbiCompatibilitySieve::test_abi_compat_symbols_not_present PASSED
tests/sieves/test_thoth_s2i_abi_compat.py::TestThothS2IAbiCompatibilitySieve::test_super_pre_run PASSED
tests/sieves/test_version_constraint.py::mypy PASSED
tests/sieves/test_version_constraint.py::TestVersionConstrainSieve::test_provided_unit_tested <- tests/base.py PASSED
tests/sieves/test_version_constraint.py::TestVersionConstrainSieve::test_provided_package_version <- tests/base.py PASSED
tests/sieves/test_version_constraint.py::TestVersionConstrainSieve::test_default_multi_package_resolution <- tests/base.py SKIPPED
tests/sieves/test_version_constraint.py::TestVersionConstrainSieve::test_verify_multiple_should_include SKIPPED
tests/sieves/test_version_constraint.py::TestVersionConstrainSieve::test_configuration_error PASSED
tests/sieves/test_version_constraint.py::TestVersionConstrainSieve::test_default_configuration PASSED
tests/sieves/test_version_constraint.py::TestVersionConstrainSieve::test_run_filter PASSED
tests/sieves/test_version_constraint.py::TestVersionConstrainSieve::test_run_no_filter PASSED
tests/sieves/test_version_constraint.py::TestVersionConstrainSieve::test_super_pre_run PASSED
tests/sieves/backports/__init__.py::mypy PASSED
tests/sieves/backports/test_enum34.py::mypy PASSED
tests/sieves/backports/test_enum34.py::TestEnum34BackportSieve::test_provided_unit_tested <- tests/base.py PASSED
tests/sieves/backports/test_enum34.py::TestEnum34BackportSieve::test_provided_package_version <- tests/base.py PASSED
tests/sieves/backports/test_enum34.py::TestEnum34BackportSieve::test_default_configuration <- tests/base.py PASSED
tests/sieves/backports/test_enum34.py::TestEnum34BackportSieve::test_super_pre_run <- tests/base.py PASSED
tests/sieves/backports/test_enum34.py::TestEnum34BackportSieve::test_default_multi_package_resolution <- tests/base.py SKIPPED
tests/sieves/backports/test_enum34.py::TestEnum34BackportSieve::test_verify_multiple_should_include PASSED
tests/sieves/backports/test_enum34.py::TestEnum34BackportSieve::test_should_include[3.4-RecommendationType.LATEST-None-False] PASSED
tests/sieves/backports/test_enum34.py::TestEnum34BackportSieve::test_should_include[3.5-None-DecisionType.RANDOM-True] PASSED
tests/sieves/backports/test_enum34.py::TestEnum34BackportSieve::test_should_include[3.6-RecommendationType.STABLE-None-False] PASSED
tests/sieves/backports/test_enum34.py::TestEnum34BackportSieve::test_should_include[3.7-RecommendationType.TESTING-None-True] PASSED
tests/sieves/backports/test_enum34.py::TestEnum34BackportSieve::test_should_include[3.8-None-DecisionType.ALL-False] PASSED
tests/sieves/backports/test_enum34.py::TestEnum34BackportSieve::test_no_include[3.0-RecommendationType.LATEST-None-False] PASSED
tests/sieves/backports/test_enum34.py::TestEnum34BackportSieve::test_no_include[None-RecommendationType.LATEST-None-False] PASSED
tests/sieves/backports/test_enum34.py::TestEnum34BackportSieve::test_no_include[3.1-None-DecisionType.RANDOM-True] PASSED
tests/sieves/backports/test_enum34.py::TestEnum34BackportSieve::test_no_include[3.2-RecommendationType.STABLE-None-False] PASSED
tests/sieves/backports/test_enum34.py::TestEnum34BackportSieve::test_no_include[3.3-RecommendationType.TESTING-None-True] PASSED
tests/sieves/backports/test_enum34.py::TestEnum34BackportSieve::test_no_include[3.2-None-DecisionType.ALL-False] PASSED
tests/sieves/backports/test_enum34.py::TestEnum34BackportSieve::test_remove PASSED
tests/sieves/backports/test_functools32.py::mypy PASSED
tests/sieves/backports/test_functools32.py::TestFunctools32BackportSieve::test_provided_unit_tested <- tests/base.py PASSED
tests/sieves/backports/test_functools32.py::TestFunctools32BackportSieve::test_provided_package_version <- tests/base.py PASSED
tests/sieves/backports/test_functools32.py::TestFunctools32BackportSieve::test_default_configuration <- tests/base.py PASSED
tests/sieves/backports/test_functools32.py::TestFunctools32BackportSieve::test_super_pre_run <- tests/base.py PASSED
tests/sieves/backports/test_functools32.py::TestFunctools32BackportSieve::test_default_multi_package_resolution <- tests/base.py SKIPPED
tests/sieves/backports/test_functools32.py::TestFunctools32BackportSieve::test_verify_multiple_should_include PASSED
tests/sieves/backports/test_functools32.py::TestFunctools32BackportSieve::test_should_include[3.7-RecommendationType.LATEST-None-False] PASSED
tests/sieves/backports/test_functools32.py::TestFunctools32BackportSieve::test_should_include[3.8-None-DecisionType.RANDOM-True] PASSED
tests/sieves/backports/test_functools32.py::TestFunctools32BackportSieve::test_should_include[3.9-RecommendationType.STABLE-None-False] PASSED
tests/sieves/backports/test_functools32.py::TestFunctools32BackportSieve::test_should_include[3.5-RecommendationType.TESTING-None-True] PASSED
tests/sieves/backports/test_functools32.py::TestFunctools32BackportSieve::test_should_include[3.2-None-DecisionType.ALL-False] PASSED
tests/sieves/backports/test_functools32.py::TestFunctools32BackportSieve::test_no_include[2.7-RecommendationType.LATEST-None-False] PASSED
tests/sieves/backports/test_functools32.py::TestFunctools32BackportSieve::test_no_include[None-RecommendationType.LATEST-None-False] PASSED
tests/sieves/backports/test_functools32.py::TestFunctools32BackportSieve::test_no_include[3.1-None-DecisionType.RANDOM-True] PASSED
tests/sieves/backports/test_functools32.py::TestFunctools32BackportSieve::test_no_include[3.0-RecommendationType.STABLE-None-False] PASSED
tests/sieves/backports/test_functools32.py::TestFunctools32BackportSieve::test_no_include[2.6-RecommendationType.TESTING-None-True] PASSED
tests/sieves/backports/test_functools32.py::TestFunctools32BackportSieve::test_no_include[3.1-None-DecisionType.ALL-False] PASSED
tests/sieves/backports/test_functools32.py::TestFunctools32BackportSieve::test_remove PASSED
tests/sieves/backports/test_importlib_metadata.py::mypy PASSED
tests/sieves/backports/test_importlib_metadata.py::TestImportlibMetadataBackportSieve::test_provided_unit_tested <- tests/base.py PASSED
tests/sieves/backports/test_importlib_metadata.py::TestImportlibMetadataBackportSieve::test_provided_package_version <- tests/base.py PASSED
tests/sieves/backports/test_importlib_metadata.py::TestImportlibMetadataBackportSieve::test_default_configuration <- tests/base.py PASSED
tests/sieves/backports/test_importlib_metadata.py::TestImportlibMetadataBackportSieve::test_super_pre_run <- tests/base.py PASSED
tests/sieves/backports/test_importlib_metadata.py::TestImportlibMetadataBackportSieve::test_default_multi_package_resolution <- tests/base.py SKIPPED
tests/sieves/backports/test_importlib_metadata.py::TestImportlibMetadataBackportSieve::test_verify_multiple_should_include PASSED
tests/sieves/backports/test_importlib_metadata.py::TestImportlibMetadataBackportSieve::test_should_include[3.8-RecommendationType.LATEST-None-False] PASSED
tests/sieves/backports/test_importlib_metadata.py::TestImportlibMetadataBackportSieve::test_should_include[3.8-None-DecisionType.RANDOM-True] PASSED
tests/sieves/backports/test_importlib_metadata.py::TestImportlibMetadataBackportSieve::test_should_include[3.9-RecommendationType.STABLE-None-False] PASSED
tests/sieves/backports/test_importlib_metadata.py::TestImportlibMetadataBackportSieve::test_should_include[3.9-RecommendationType.TESTING-None-True] PASSED
tests/sieves/backports/test_importlib_metadata.py::TestImportlibMetadataBackportSieve::test_no_include[3.4-RecommendationType.LATEST-None-False] PASSED
tests/sieves/backports/test_importlib_metadata.py::TestImportlibMetadataBackportSieve::test_no_include[None-RecommendationType.LATEST-None-False] PASSED
tests/sieves/backports/test_importlib_metadata.py::TestImportlibMetadataBackportSieve::test_no_include[3.5-None-DecisionType.RANDOM-True] PASSED
tests/sieves/backports/test_importlib_metadata.py::TestImportlibMetadataBackportSieve::test_no_include[3.3-RecommendationType.STABLE-None-False] PASSED
tests/sieves/backports/test_importlib_metadata.py::TestImportlibMetadataBackportSieve::test_no_include[3.6-RecommendationType.TESTING-None-True] PASSED
tests/sieves/backports/test_importlib_metadata.py::TestImportlibMetadataBackportSieve::test_no_include[3.7-None-DecisionType.ALL-False] PASSED
tests/sieves/backports/test_importlib_metadata.py::TestImportlibMetadataBackportSieve::test_remove PASSED
tests/sieves/backports/test_importlib_resources.py::mypy PASSED
tests/sieves/backports/test_importlib_resources.py::TestImportlibResourcesBackportSieve::test_provided_unit_tested <- tests/base.py PASSED
tests/sieves/backports/test_importlib_resources.py::TestImportlibResourcesBackportSieve::test_provided_package_version <- tests/base.py PASSED
tests/sieves/backports/test_importlib_resources.py::TestImportlibResourcesBackportSieve::test_default_configuration <- tests/base.py PASSED
tests/sieves/backports/test_importlib_resources.py::TestImportlibResourcesBackportSieve::test_super_pre_run <- tests/base.py PASSED
tests/sieves/backports/test_importlib_resources.py::TestImportlibResourcesBackportSieve::test_default_multi_package_resolution <- tests/base.py SKIPPED
tests/sieves/backports/test_importlib_resources.py::TestImportlibResourcesBackportSieve::test_verify_multiple_should_include PASSED
tests/sieves/backports/test_importlib_resources.py::TestImportlibResourcesBackportSieve::test_should_include[3.8-RecommendationType.LATEST-None-False] PASSED
tests/sieves/backports/test_importlib_resources.py::TestImportlibResourcesBackportSieve::test_should_include[3.8-None-DecisionType.RANDOM-True] PASSED
tests/sieves/backports/test_importlib_resources.py::TestImportlibResourcesBackportSieve::test_should_include[3.9-RecommendationType.STABLE-None-False] PASSED
tests/sieves/backports/test_importlib_resources.py::TestImportlibResourcesBackportSieve::test_should_include[3.9-RecommendationType.TESTING-None-True] PASSED
tests/sieves/backports/test_importlib_resources.py::TestImportlibResourcesBackportSieve::test_no_include[3.4-RecommendationType.LATEST-None-False] PASSED
tests/sieves/backports/test_importlib_resources.py::TestImportlibResourcesBackportSieve::test_no_include[None-RecommendationType.LATEST-None-False] PASSED
tests/sieves/backports/test_importlib_resources.py::TestImportlibResourcesBackportSieve::test_no_include[3.5-None-DecisionType.RANDOM-True] PASSED
tests/sieves/backports/test_importlib_resources.py::TestImportlibResourcesBackportSieve::test_no_include[3.3-RecommendationType.STABLE-None-False] PASSED
tests/sieves/backports/test_importlib_resources.py::TestImportlibResourcesBackportSieve::test_no_include[3.6-RecommendationType.TESTING-None-True] PASSED
tests/sieves/backports/test_importlib_resources.py::TestImportlibResourcesBackportSieve::test_no_include[3.7-None-DecisionType.ALL-False] PASSED
tests/sieves/backports/test_importlib_resources.py::TestImportlibResourcesBackportSieve::test_remove PASSED
tests/sieves/backports/test_mock.py::mypy PASSED
tests/sieves/backports/test_mock.py::TestMockBackportSieve::test_provided_unit_tested <- tests/base.py PASSED
tests/sieves/backports/test_mock.py::TestMockBackportSieve::test_provided_package_version <- tests/base.py PASSED
tests/sieves/backports/test_mock.py::TestMockBackportSieve::test_default_configuration <- tests/base.py PASSED
tests/sieves/backports/test_mock.py::TestMockBackportSieve::test_super_pre_run <- tests/base.py PASSED
tests/sieves/backports/test_mock.py::TestMockBackportSieve::test_default_multi_package_resolution <- tests/base.py SKIPPED
tests/sieves/backports/test_mock.py::TestMockBackportSieve::test_verify_multiple_should_include PASSED
tests/sieves/backports/test_mock.py::TestMockBackportSieve::test_should_include[3.8-RecommendationType.LATEST-None-False] PASSED
tests/sieves/backports/test_mock.py::TestMockBackportSieve::test_should_include[3.8-None-DecisionType.RANDOM-True] PASSED
tests/sieves/backports/test_mock.py::TestMockBackportSieve::test_should_include[3.9-RecommendationType.STABLE-None-False] PASSED
tests/sieves/backports/test_mock.py::TestMockBackportSieve::test_should_include[3.9-RecommendationType.TESTING-None-True] PASSED
tests/sieves/backports/test_mock.py::TestMockBackportSieve::test_no_include[3.0-RecommendationType.LATEST-None-False] PASSED
tests/sieves/backports/test_mock.py::TestMockBackportSieve::test_no_include[None-RecommendationType.LATEST-None-False] PASSED
tests/sieves/backports/test_mock.py::TestMockBackportSieve::test_no_include[3.1-None-DecisionType.RANDOM-True] PASSED
tests/sieves/backports/test_mock.py::TestMockBackportSieve::test_no_include[3.2-RecommendationType.STABLE-None-False] PASSED
tests/sieves/backports/test_mock.py::TestMockBackportSieve::test_no_include[3.2-RecommendationType.TESTING-None-True] PASSED
tests/sieves/backports/test_mock.py::TestMockBackportSieve::test_no_include[2.7-None-DecisionType.ALL-False] PASSED
tests/sieves/backports/test_mock.py::TestMockBackportSieve::test_remove PASSED
tests/sieves/pandas/__init__.py::mypy PASSED
tests/sieves/pandas/test_py36_drop.py::mypy PASSED
tests/sieves/pandas/test_py36_drop.py::TestPandasPy36Sieve::test_provided_unit_tested <- tests/base.py PASSED
tests/sieves/pandas/test_py36_drop.py::TestPandasPy36Sieve::test_provided_package_version <- tests/base.py PASSED
tests/sieves/pandas/test_py36_drop.py::TestPandasPy36Sieve::test_default_configuration <- tests/base.py PASSED
tests/sieves/pandas/test_py36_drop.py::TestPandasPy36Sieve::test_super_pre_run <- tests/base.py PASSED
tests/sieves/pandas/test_py36_drop.py::TestPandasPy36Sieve::test_default_multi_package_resolution <- tests/base.py SKIPPED
tests/sieves/pandas/test_py36_drop.py::TestPandasPy36Sieve::test_verify_multiple_should_include PASSED
tests/sieves/pandas/test_py36_drop.py::TestPandasPy36Sieve::test_include[RecommendationType.STABLE] PASSED
tests/sieves/pandas/test_py36_drop.py::TestPandasPy36Sieve::test_include[RecommendationType.PERFORMANCE] PASSED
tests/sieves/pandas/test_py36_drop.py::TestPandasPy36Sieve::test_include[RecommendationType.SECURITY] PASSED
tests/sieves/pandas/test_py36_drop.py::TestPandasPy36Sieve::test_no_include[RecommendationType.TESTING-None-3.6] PASSED
tests/sieves/pandas/test_py36_drop.py::TestPandasPy36Sieve::test_no_include[RecommendationType.LATEST-None-3.6] PASSED
tests/sieves/pandas/test_py36_drop.py::TestPandasPy36Sieve::test_no_include[None-DecisionType.RANDOM-3.6] PASSED
tests/sieves/pandas/test_py36_drop.py::TestPandasPy36Sieve::test_no_include[RecommendationType.STABLE-None-3.9] PASSED
tests/sieves/pandas/test_py36_drop.py::TestPandasPy36Sieve::test_no_include[RecommendationType.PERFORMANCE-None-3.8] PASSED
tests/sieves/pandas/test_py36_drop.py::TestPandasPy36Sieve::test_run[1.2.0] PASSED
tests/sieves/pandas/test_py36_drop.py::TestPandasPy36Sieve::test_run[2.0.0] PASSED
tests/sieves/pandas/test_py36_drop.py::TestPandasPy36Sieve::test_no_filter PASSED
tests/sieves/setuptools/__init__.py::mypy PASSED
tests/sieves/setuptools/test_py36.py::mypy PASSED
tests/sieves/setuptools/test_py36.py::TestPy36SetuptoolsSieve::test_provided_unit_tested <- tests/base.py PASSED
tests/sieves/setuptools/test_py36.py::TestPy36SetuptoolsSieve::test_provided_package_version <- tests/base.py PASSED
tests/sieves/setuptools/test_py36.py::TestPy36SetuptoolsSieve::test_default_configuration <- tests/base.py PASSED
tests/sieves/setuptools/test_py36.py::TestPy36SetuptoolsSieve::test_super_pre_run <- tests/base.py PASSED
tests/sieves/setuptools/test_py36.py::TestPy36SetuptoolsSieve::test_default_multi_package_resolution <- tests/base.py SKIPPED
tests/sieves/setuptools/test_py36.py::TestPy36SetuptoolsSieve::test_verify_multiple_should_include PASSED
tests/sieves/setuptools/test_py36.py::TestPy36SetuptoolsSieve::test_include[RecommendationType.STABLE-None] PASSED
tests/sieves/setuptools/test_py36.py::TestPy36SetuptoolsSieve::test_include[RecommendationType.TESTING-None] PASSED
tests/sieves/setuptools/test_py36.py::TestPy36SetuptoolsSieve::test_include[None-DecisionType.RANDOM] PASSED
tests/sieves/setuptools/test_py36.py::TestPy36SetuptoolsSieve::test_include[None-DecisionType.ALL] PASSED
tests/sieves/setuptools/test_py36.py::TestPy36SetuptoolsSieve::test_no_include[RecommendationType.STABLE-None-3.8] PASSED
tests/sieves/setuptools/test_py36.py::TestPy36SetuptoolsSieve::test_no_include[RecommendationType.TESTING-None-3.9] PASSED
tests/sieves/setuptools/test_py36.py::TestPy36SetuptoolsSieve::test_no_include[None-DecisionType.RANDOM-3.5] PASSED
tests/sieves/setuptools/test_py36.py::TestPy36SetuptoolsSieve::test_filter PASSED
tests/sieves/setuptools/test_py36.py::TestPy36SetuptoolsSieve::test_no_filter PASSED
tests/sieves/tensorflow/__init__.py::mypy PASSED
tests/sieves/tensorflow/test_tf_240_avx2.py::mypy PASSED
tests/sieves/tensorflow/test_tf_240_avx2.py::TestTensorFlowAVX2Step::test_provided_unit_tested <- tests/base.py PASSED
tests/sieves/tensorflow/test_tf_240_avx2.py::TestTensorFlowAVX2Step::test_provided_package_version <- tests/base.py PASSED
tests/sieves/tensorflow/test_tf_240_avx2.py::TestTensorFlowAVX2Step::test_default_configuration <- tests/base.py PASSED
tests/sieves/tensorflow/test_tf_240_avx2.py::TestTensorFlowAVX2Step::test_super_pre_run <- tests/base.py PASSED
tests/sieves/tensorflow/test_tf_240_avx2.py::TestTensorFlowAVX2Step::test_default_multi_package_resolution <- tests/base.py SKIPPED
tests/sieves/tensorflow/test_tf_240_avx2.py::TestTensorFlowAVX2Step::test_verify_multiple_should_include PASSED
tests/sieves/tensorflow/test_tf_240_avx2.py::TestTensorFlowAVX2Step::test_include[RecommendationType.STABLE] PASSED
tests/sieves/tensorflow/test_tf_240_avx2.py::TestTensorFlowAVX2Step::test_include[RecommendationType.TESTING] PASSED
tests/sieves/tensorflow/test_tf_240_avx2.py::TestTensorFlowAVX2Step::test_no_include[RecommendationType.STABLE-None-None-None] PASSED
tests/sieves/tensorflow/test_tf_240_avx2.py::TestTensorFlowAVX2Step::test_no_include[RecommendationType.TESTING-None-6-15] PASSED
tests/sieves/tensorflow/test_tf_240_avx2.py::TestTensorFlowAVX2Step::test_no_include[None-DecisionType.RANDOM-0-0] PASSED
tests/sieves/tensorflow/test_tf_240_avx2.py::TestTensorFlowAVX2Step::test_tf_avx2 PASSED
tests/sieves/tensorflow/test_tf_240_avx2.py::TestTensorFlowAVX2Step::test_no_tf_avx2 PASSED
tests/sieves/tensorflow/test_tf_api.py::mypy PASSED
tests/sieves/tensorflow/test_tf_api.py::TestTensorFlowAPISieve::test_provided_unit_tested <- tests/base.py PASSED
tests/sieves/tensorflow/test_tf_api.py::TestTensorFlowAPISieve::test_provided_package_version <- tests/base.py PASSED
tests/sieves/tensorflow/test_tf_api.py::TestTensorFlowAPISieve::test_default_configuration <- tests/base.py PASSED
tests/sieves/tensorflow/test_tf_api.py::TestTensorFlowAPISieve::test_super_pre_run <- tests/base.py PASSED
tests/sieves/tensorflow/test_tf_api.py::TestTensorFlowAPISieve::test_default_multi_package_resolution <- tests/base.py SKIPPED
tests/sieves/tensorflow/test_tf_api.py::TestTensorFlowAPISieve::test_verify_multiple_should_include PASSED
tests/sieves/tensorflow/test_tf_api.py::TestTensorFlowAPISieve::test_recommendation_types_considered PASSED
tests/sieves/tensorflow/test_tf_api.py::TestTensorFlowAPISieve::test_include[RecommendationType.STABLE] PASSED
tests/sieves/tensorflow/test_tf_api.py::TestTensorFlowAPISieve::test_include[RecommendationType.PERFORMANCE] PASSED
tests/sieves/tensorflow/test_tf_api.py::TestTensorFlowAPISieve::test_include[RecommendationType.SECURITY] PASSED
tests/sieves/tensorflow/test_tf_api.py::TestTensorFlowAPISieve::test_no_include[RecommendationType.LATEST-None-library_usage0] PASSED
tests/sieves/tensorflow/test_tf_api.py::TestTensorFlowAPISieve::test_no_include[RecommendationType.TESTING-None-library_usage1] PASSED
tests/sieves/tensorflow/test_tf_api.py::TestTensorFlowAPISieve::test_no_include[None-DecisionType.RANDOM-library_usage2] PASSED
tests/sieves/tensorflow/test_tf_api.py::TestTensorFlowAPISieve::test_no_include[RecommendationType.STABLE-None-library_usage3] PASSED
tests/sieves/tensorflow/test_tf_api.py::TestTensorFlowAPISieve::test_no_include[RecommendationType.STABLE-None-None] PASSED
tests/sieves/tensorflow/test_tf_api.py::TestTensorFlowAPISieve::test_sieve PASSED
tests/sieves/tensorflow/test_tf_api.py::TestTensorFlowAPISieve::test_unknown_symbol PASSED
tests/sieves/tensorflow/test_tf_api.py::TestTensorFlowAPISieve::test_multiple_calls PASSED
tests/sieves/tensorflow/test_tf_cuda.py::mypy PASSED
tests/sieves/tensorflow/test_tf_cuda.py::TestTensorFlowCUDASieve::test_provided_unit_tested <- tests/base.py PASSED
tests/sieves/tensorflow/test_tf_cuda.py::TestTensorFlowCUDASieve::test_provided_package_version <- tests/base.py PASSED
tests/sieves/tensorflow/test_tf_cuda.py::TestTensorFlowCUDASieve::test_default_configuration <- tests/base.py PASSED
tests/sieves/tensorflow/test_tf_cuda.py::TestTensorFlowCUDASieve::test_super_pre_run <- tests/base.py PASSED
tests/sieves/tensorflow/test_tf_cuda.py::TestTensorFlowCUDASieve::test_default_multi_package_resolution <- tests/base.py SKIPPED
tests/sieves/tensorflow/test_tf_cuda.py::TestTensorFlowCUDASieve::test_verify_multiple_should_include PASSED
tests/sieves/tensorflow/test_tf_cuda.py::TestTensorFlowCUDASieve::test_recommendation_types_considered PASSED
tests/sieves/tensorflow/test_tf_cuda.py::TestTensorFlowCUDASieve::test_include[RecommendationType.STABLE-8] PASSED
tests/sieves/tensorflow/test_tf_cuda.py::TestTensorFlowCUDASieve::test_include[RecommendationType.STABLE-9] PASSED
tests/sieves/tensorflow/test_tf_cuda.py::TestTensorFlowCUDASieve::test_include[RecommendationType.STABLE-10.0] PASSED
tests/sieves/tensorflow/test_tf_cuda.py::TestTensorFlowCUDASieve::test_include[RecommendationType.STABLE-10.1] PASSED
tests/sieves/tensorflow/test_tf_cuda.py::TestTensorFlowCUDASieve::test_include[RecommendationType.STABLE-11.0] PASSED
tests/sieves/tensorflow/test_tf_cuda.py::TestTensorFlowCUDASieve::test_include[RecommendationType.PERFORMANCE-8] PASSED
tests/sieves/tensorflow/test_tf_cuda.py::TestTensorFlowCUDASieve::test_include[RecommendationType.PERFORMANCE-9] PASSED
tests/sieves/tensorflow/test_tf_cuda.py::TestTensorFlowCUDASieve::test_include[RecommendationType.PERFORMANCE-10.0] PASSED
tests/sieves/tensorflow/test_tf_cuda.py::TestTensorFlowCUDASieve::test_include[RecommendationType.PERFORMANCE-10.1] PASSED
tests/sieves/tensorflow/test_tf_cuda.py::TestTensorFlowCUDASieve::test_include[RecommendationType.PERFORMANCE-11.0] PASSED
tests/sieves/tensorflow/test_tf_cuda.py::TestTensorFlowCUDASieve::test_include[RecommendationType.SECURITY-8] PASSED
tests/sieves/tensorflow/test_tf_cuda.py::TestTensorFlowCUDASieve::test_include[RecommendationType.SECURITY-9] PASSED
tests/sieves/tensorflow/test_tf_cuda.py::TestTensorFlowCUDASieve::test_include[RecommendationType.SECURITY-10.0] PASSED
tests/sieves/tensorflow/test_tf_cuda.py::TestTensorFlowCUDASieve::test_include[RecommendationType.SECURITY-10.1] PASSED
tests/sieves/tensorflow/test_tf_cuda.py::TestTensorFlowCUDASieve::test_include[RecommendationType.SECURITY-11.0] PASSED
tests/sieves/tensorflow/test_tf_cuda.py::TestTensorFlowCUDASieve::test_no_include[RecommendationType.LATEST-None-10.1] PASSED
tests/sieves/tensorflow/test_tf_cuda.py::TestTensorFlowCUDASieve::test_no_include[RecommendationType.TESTING-None-10.1] PASSED
tests/sieves/tensorflow/test_tf_cuda.py::TestTensorFlowCUDASieve::test_no_include[None-DecisionType.RANDOM-10.0] PASSED
tests/sieves/tensorflow/test_tf_cuda.py::TestTensorFlowCUDASieve::test_no_include[RecommendationType.STABLE-None-UNKNOWN_CUDA_VERSION] PASSED
tests/sieves/tensorflow/test_tf_cuda.py::TestTensorFlowCUDASieve::test_no_include[RecommendationType.STABLE-None-None] PASSED
tests/sieves/tensorflow/test_tf_cuda.py::TestTensorFlowCUDASieve::test_pre_run[8-_TF_1_CUDA_8_SUPPORT-_EMPTY] PASSED
tests/sieves/tensorflow/test_tf_cuda.py::TestTensorFlowCUDASieve::test_pre_run[9-_TF_1_CUDA_9_SUPPORT-_EMPTY] PASSED
tests/sieves/tensorflow/test_tf_cuda.py::TestTensorFlowCUDASieve::test_pre_run[10.0-_TF_1_CUDA_10_0_SUPPORT-_TF_2_CUDA_10_0_SUPPORT] PASSED
tests/sieves/tensorflow/test_tf_cuda.py::TestTensorFlowCUDASieve::test_pre_run[10.1-_EMPTY-_TF_2_CUDA_10_1_SUPPORT] PASSED
tests/sieves/tensorflow/test_tf_cuda.py::TestTensorFlowCUDASieve::test_pre_run[11.0-_EMPTY-_TF_2_CUDA_11_0_SUPPORT] PASSED
tests/sieves/tensorflow/test_tf_cuda.py::TestTensorFlowCUDASieve::test_pre_run[UNKNOWN_CUDA_VERSION-_EMPTY-_EMPTY] PASSED
tests/sieves/tensorflow/test_tf_cuda.py::TestTensorFlowCUDASieve::test_unknown_tensorflow[tensorflow] PASSED
tests/sieves/tensorflow/test_tf_cuda.py::TestTensorFlowCUDASieve::test_unknown_tensorflow[tensorflow-gpu] PASSED
tests/sieves/tensorflow/test_tf_cuda.py::TestTensorFlowCUDASieve::test_run_yield[tensorflow-2.4.0-11.0] PASSED
tests/sieves/tensorflow/test_tf_cuda.py::TestTensorFlowCUDASieve::test_run_yield[tensorflow-2.3.0-10.1] PASSED
tests/sieves/tensorflow/test_tf_cuda.py::TestTensorFlowCUDASieve::test_run_yield[tensorflow-gpu-2.3.0-10.1] PASSED
tests/sieves/tensorflow/test_tf_cuda.py::TestTensorFlowCUDASieve::test_run_yield[tensorflow-2.2.0-10.1] PASSED
tests/sieves/tensorflow/test_tf_cuda.py::TestTensorFlowCUDASieve::test_run_yield[tensorflow-gpu-2.2.0-10.1] PASSED
tests/sieves/tensorflow/test_tf_cuda.py::TestTensorFlowCUDASieve::test_run_yield[tensorflow-2.1.0-10.1] PASSED
tests/sieves/tensorflow/test_tf_cuda.py::TestTensorFlowCUDASieve::test_run_yield[tensorflow-gpu-2.1.0-10.1] PASSED
tests/sieves/tensorflow/test_tf_cuda.py::TestTensorFlowCUDASieve::test_run_yield[tensorflow-2.0.0-10.0] PASSED
tests/sieves/tensorflow/test_tf_cuda.py::TestTensorFlowCUDASieve::test_run_yield[tensorflow-gpu-2.0.0-10.0] PASSED
tests/sieves/tensorflow/test_tf_cuda.py::TestTensorFlowCUDASieve::test_run_yield[tensorflow_gpu-1.15.0-10.0] PASSED
tests/sieves/tensorflow/test_tf_cuda.py::TestTensorFlowCUDASieve::test_run_yield[tensorflow_gpu-1.14.0-10.0] PASSED
tests/sieves/tensorflow/test_tf_cuda.py::TestTensorFlowCUDASieve::test_run_yield[tensorflow_gpu-1.13.1-10.0] PASSED
tests/sieves/tensorflow/test_tf_cuda.py::TestTensorFlowCUDASieve::test_run_yield[tensorflow_gpu-1.12.0-9] PASSED
tests/sieves/tensorflow/test_tf_cuda.py::TestTensorFlowCUDASieve::test_run_yield[tensorflow_gpu-1.11.0-9] PASSED
tests/sieves/tensorflow/test_tf_cuda.py::TestTensorFlowCUDASieve::test_run_yield[tensorflow_gpu-1.10.0-9] PASSED
tests/sieves/tensorflow/test_tf_cuda.py::TestTensorFlowCUDASieve::test_run_yield[tensorflow_gpu-1.9.0-9] PASSED
tests/sieves/tensorflow/test_tf_cuda.py::TestTensorFlowCUDASieve::test_run_yield[tensorflow_gpu-1.8.0-9] PASSED
tests/sieves/tensorflow/test_tf_cuda.py::TestTensorFlowCUDASieve::test_run_yield[tensorflow_gpu-1.7.0-9] PASSED
tests/sieves/tensorflow/test_tf_cuda.py::TestTensorFlowCUDASieve::test_run_yield[tensorflow_gpu-1.6.0-9] PASSED
tests/sieves/tensorflow/test_tf_cuda.py::TestTensorFlowCUDASieve::test_run_yield[tensorflow_gpu-1.5.0-9] PASSED
tests/sieves/tensorflow/test_tf_cuda.py::TestTensorFlowCUDASieve::test_run_yield[tensorflow_gpu-1.4.0-8] PASSED
tests/sieves/tensorflow/test_tf_cuda.py::TestTensorFlowCUDASieve::test_run_yield[tensorflow_gpu-1.3.0-8] PASSED
tests/sieves/tensorflow/test_tf_cuda.py::TestTensorFlowCUDASieve::test_run_yield[tensorflow_gpu-1.2.0-8] PASSED
tests/sieves/tensorflow/test_tf_cuda.py::TestTensorFlowCUDASieve::test_run_yield[tensorflow_gpu-1.1.0-8] PASSED
tests/sieves/tensorflow/test_tf_cuda.py::TestTensorFlowCUDASieve::test_run_yield[tensorflow_gpu-1.0.0-8] PASSED
tests/sieves/tensorflow/test_tf_cuda.py::TestTensorFlowCUDASieve::test_run_no_yield[pv0-10.0] PASSED
tests/sieves/tensorflow/test_tf_cuda.py::TestTensorFlowCUDASieve::test_run_no_yield[pv1-9] PASSED
tests/sieves/tensorflow/test_tf_cuda.py::TestTensorFlowCUDASieve::test_run_no_yield[pv2-8] PASSED
tests/sieves/tensorflow/test_tf_cuda.py::TestTensorFlowCUDASieve::test_run_no_yield[pv3-10.0] PASSED
tests/sieves/tensorflow/test_tf_cuda.py::TestTensorFlowCUDASieve::test_run_no_yield[pv4-9] PASSED
tests/sieves/tensorflow/test_tf_cuda.py::TestTensorFlowCUDASieve::test_run_no_yield[pv5-8] PASSED
tests/sieves/tensorflow/test_tf_cuda.py::TestTensorFlowCUDASieve::test_run_no_yield[pv6-10.0] PASSED
tests/sieves/tensorflow/test_tf_cuda.py::TestTensorFlowCUDASieve::test_run_no_yield[pv7-9] PASSED
tests/sieves/tensorflow/test_tf_cuda.py::TestTensorFlowCUDASieve::test_run_no_yield[pv8-8] PASSED
tests/sieves/tensorflow/test_tf_cuda.py::TestTensorFlowCUDASieve::test_run_no_yield[pv9-10.0] PASSED
tests/sieves/tensorflow/test_tf_cuda.py::TestTensorFlowCUDASieve::test_run_no_yield[pv10-9] PASSED
tests/sieves/tensorflow/test_tf_cuda.py::TestTensorFlowCUDASieve::test_run_no_yield[pv11-8] PASSED
tests/sieves/tensorflow/test_tf_cuda.py::TestTensorFlowCUDASieve::test_run_no_yield[pv12-10.1] PASSED
tests/sieves/tensorflow/test_tf_cuda.py::TestTensorFlowCUDASieve::test_run_no_yield[pv13-9] PASSED
tests/sieves/tensorflow/test_tf_cuda.py::TestTensorFlowCUDASieve::test_run_no_yield[pv14-8] PASSED
tests/sieves/tensorflow/test_tf_cuda.py::TestTensorFlowCUDASieve::test_run_no_yield[pv15-10.1] PASSED
tests/sieves/tensorflow/test_tf_cuda.py::TestTensorFlowCUDASieve::test_run_no_yield[pv16-10.0] PASSED
tests/sieves/tensorflow/test_tf_cuda.py::TestTensorFlowCUDASieve::test_run_no_yield[pv17-9] PASSED
tests/sieves/tensorflow/test_tf_cuda.py::TestTensorFlowCUDASieve::test_run_no_yield[pv18-8] PASSED
tests/sieves/tensorflow/test_tf_cuda.py::TestTensorFlowCUDASieve::test_run_no_yield[pv19-10.1] PASSED
tests/sieves/tensorflow/test_tf_cuda.py::TestTensorFlowCUDASieve::test_run_no_yield[pv20-9] PASSED
tests/sieves/tensorflow/test_tf_cuda.py::TestTensorFlowCUDASieve::test_run_no_yield[pv21-8] PASSED
tests/sieves/tensorflow/test_tf_cuda.py::TestTensorFlowCUDASieve::test_run_no_yield[pv22-10.1] PASSED
tests/sieves/tensorflow/test_tf_cuda.py::TestTensorFlowCUDASieve::test_run_no_yield[pv23-9] PASSED
tests/sieves/tensorflow/test_tf_cuda.py::TestTensorFlowCUDASieve::test_run_no_yield[pv24-8] PASSED
tests/sieves/tensorflow/test_tf_cuda.py::TestTensorFlowCUDASieve::test_run_no_yield[pv25-10.1] PASSED
tests/sieves/tensorflow/test_tf_cuda.py::TestTensorFlowCUDASieve::test_run_no_yield[pv26-9] PASSED
tests/sieves/tensorflow/test_tf_cuda.py::TestTensorFlowCUDASieve::test_run_no_yield[pv27-8] PASSED
tests/sieves/tensorflow/test_tf_cuda.py::TestTensorFlowCUDASieve::test_run_no_yield[pv28-10.1] PASSED
tests/sieves/tensorflow/test_tf_cuda.py::TestTensorFlowCUDASieve::test_run_no_yield[pv29-10.0] PASSED
tests/sieves/tensorflow/test_tf_cuda.py::TestTensorFlowCUDASieve::test_run_no_yield[pv30-8] PASSED
tests/sieves/tensorflow/test_tf_cuda.py::TestTensorFlowCUDASieve::test_run_no_yield[pv31-10.1] PASSED
tests/sieves/tensorflow/test_tf_cuda.py::TestTensorFlowCUDASieve::test_run_no_yield[pv32-10.0] PASSED
tests/sieves/tensorflow/test_tf_cuda.py::TestTensorFlowCUDASieve::test_run_no_yield[pv33-8] PASSED
tests/sieves/tensorflow/test_tf_cuda.py::TestTensorFlowCUDASieve::test_run_no_yield[pv34-10.1] PASSED
tests/sieves/tensorflow/test_tf_cuda.py::TestTensorFlowCUDASieve::test_run_no_yield[pv35-10.0] PASSED
tests/sieves/tensorflow/test_tf_cuda.py::TestTensorFlowCUDASieve::test_run_no_yield[pv36-8] PASSED
tests/sieves/tensorflow/test_tf_cuda.py::TestTensorFlowCUDASieve::test_run_no_yield[pv37-10.1] PASSED
tests/sieves/tensorflow/test_tf_cuda.py::TestTensorFlowCUDASieve::test_run_no_yield[pv38-10.0] PASSED
tests/sieves/tensorflow/test_tf_cuda.py::TestTensorFlowCUDASieve::test_run_no_yield[pv39-8] PASSED
tests/sieves/tensorflow/test_tf_cuda.py::TestTensorFlowCUDASieve::test_run_no_yield[pv40-10.1] PASSED
tests/sieves/tensorflow/test_tf_cuda.py::TestTensorFlowCUDASieve::test_run_no_yield[pv41-10.0] PASSED
tests/sieves/tensorflow/test_tf_cuda.py::TestTensorFlowCUDASieve::test_run_no_yield[pv42-8] PASSED
tests/sieves/tensorflow/test_tf_cuda.py::TestTensorFlowCUDASieve::test_run_no_yield[pv43-10.1] PASSED
tests/sieves/tensorflow/test_tf_cuda.py::TestTensorFlowCUDASieve::test_run_no_yield[pv44-10.0] PASSED
tests/sieves/tensorflow/test_tf_cuda.py::TestTensorFlowCUDASieve::test_run_no_yield[pv45-8] PASSED
tests/sieves/tensorflow/test_tf_cuda.py::TestTensorFlowCUDASieve::test_run_no_yield[pv46-10.1] PASSED
tests/sieves/tensorflow/test_tf_cuda.py::TestTensorFlowCUDASieve::test_run_no_yield[pv47-10.0] PASSED
tests/sieves/tensorflow/test_tf_cuda.py::TestTensorFlowCUDASieve::test_run_no_yield[pv48-8] PASSED
tests/sieves/tensorflow/test_tf_cuda.py::TestTensorFlowCUDASieve::test_run_no_yield[pv49-10.1] PASSED
tests/sieves/tensorflow/test_tf_cuda.py::TestTensorFlowCUDASieve::test_run_no_yield[pv50-10.0] PASSED
tests/sieves/tensorflow/test_tf_cuda.py::TestTensorFlowCUDASieve::test_run_no_yield[pv51-8] PASSED
tests/sieves/tensorflow/test_tf_cuda.py::TestTensorFlowCUDASieve::test_run_no_yield[pv52-10.1] PASSED
tests/sieves/tensorflow/test_tf_cuda.py::TestTensorFlowCUDASieve::test_run_no_yield[pv53-10.0] PASSED
tests/sieves/tensorflow/test_tf_cuda.py::TestTensorFlowCUDASieve::test_run_no_yield[pv54-9] PASSED
tests/sieves/tensorflow/test_tf_cuda.py::TestTensorFlowCUDASieve::test_run_no_yield[pv55-10.1] PASSED
tests/sieves/tensorflow/test_tf_cuda.py::TestTensorFlowCUDASieve::test_run_no_yield[pv56-10.0] PASSED
tests/sieves/tensorflow/test_tf_cuda.py::TestTensorFlowCUDASieve::test_run_no_yield[pv57-9] PASSED
tests/sieves/tensorflow/test_tf_cuda.py::TestTensorFlowCUDASieve::test_run_no_yield[pv58-10.1] PASSED
tests/sieves/tensorflow/test_tf_cuda.py::TestTensorFlowCUDASieve::test_run_no_yield[pv59-10.0] PASSED
tests/sieves/tensorflow/test_tf_cuda.py::TestTensorFlowCUDASieve::test_run_no_yield[pv60-9] PASSED
tests/sieves/tensorflow/test_tf_cuda.py::TestTensorFlowCUDASieve::test_run_no_yield[pv61-10.1] PASSED
tests/sieves/tensorflow/test_tf_cuda.py::TestTensorFlowCUDASieve::test_run_no_yield[pv62-10.0] PASSED
tests/sieves/tensorflow/test_tf_cuda.py::TestTensorFlowCUDASieve::test_run_no_yield[pv63-9] PASSED
tests/sieves/tensorflow/test_tf_cuda.py::TestTensorFlowCUDASieve::test_run_no_yield[pv64-10.1] PASSED
tests/sieves/tensorflow/test_tf_cuda.py::TestTensorFlowCUDASieve::test_run_no_yield[pv65-10.0] PASSED
tests/sieves/tensorflow/test_tf_cuda.py::TestTensorFlowCUDASieve::test_run_no_yield[pv66-9] PASSED
tests/sieves/tensorflow/test_tf_cuda.py::TestTensorFlowCUDASieve::test_sieve_multiple PASSED
tests/sieves/tensorflow/test_tf_py39.py::mypy PASSED
tests/sieves/tensorflow/test_tf_py39.py::TestTensorFlowPython39Sieve::test_provided_unit_tested <- tests/base.py PASSED
tests/sieves/tensorflow/test_tf_py39.py::TestTensorFlowPython39Sieve::test_provided_package_version <- tests/base.py PASSED
tests/sieves/tensorflow/test_tf_py39.py::TestTensorFlowPython39Sieve::test_default_configuration <- tests/base.py PASSED
tests/sieves/tensorflow/test_tf_py39.py::TestTensorFlowPython39Sieve::test_super_pre_run <- tests/base.py PASSED
tests/sieves/tensorflow/test_tf_py39.py::TestTensorFlowPython39Sieve::test_default_multi_package_resolution <- tests/base.py SKIPPED
tests/sieves/tensorflow/test_tf_py39.py::TestTensorFlowPython39Sieve::test_verify_multiple_should_include PASSED
tests/sieves/tensorflow/test_tf_py39.py::TestTensorFlowPython39Sieve::test_recommendation_types_considered PASSED
tests/sieves/tensorflow/test_tf_py39.py::TestTensorFlowPython39Sieve::test_include[RecommendationType.STABLE-3.9] PASSED
tests/sieves/tensorflow/test_tf_py39.py::TestTensorFlowPython39Sieve::test_include[RecommendationType.PERFORMANCE-3.9] PASSED
tests/sieves/tensorflow/test_tf_py39.py::TestTensorFlowPython39Sieve::test_include[RecommendationType.SECURITY-3.9] PASSED
tests/sieves/tensorflow/test_tf_py39.py::TestTensorFlowPython39Sieve::test_no_include[RecommendationType.LATEST-None-3.9] PASSED
tests/sieves/tensorflow/test_tf_py39.py::TestTensorFlowPython39Sieve::test_no_include[RecommendationType.TESTING-None-3.9] PASSED
tests/sieves/tensorflow/test_tf_py39.py::TestTensorFlowPython39Sieve::test_no_include[None-DecisionType.RANDOM-3.9] PASSED
tests/sieves/tensorflow/test_tf_py39.py::TestTensorFlowPython39Sieve::test_no_include[RecommendationType.STABLE-None-3.6] PASSED
tests/sieves/tensorflow/test_tf_py39.py::TestTensorFlowPython39Sieve::test_no_include[RecommendationType.STABLE-None-None] PASSED
tests/sieves/tensorflow/test_tf_py39.py::TestTensorFlowPython39Sieve::test_run_yield[intel-tensorflow-2.5.0] PASSED
tests/sieves/tensorflow/test_tf_py39.py::TestTensorFlowPython39Sieve::test_run_yield[tensorflow-2.5.0] PASSED
tests/sieves/tensorflow/test_tf_py39.py::TestTensorFlowPython39Sieve::test_run_yield[tensorflow-gpu-2.5.0] PASSED
tests/sieves/tensorflow/test_tf_py39.py::TestTensorFlowPython39Sieve::test_run_no_yield[intel-tensorflow-2.4.0] PASSED
tests/sieves/tensorflow/test_tf_py39.py::TestTensorFlowPython39Sieve::test_run_no_yield[tensorflow-2.4.0] PASSED
tests/sieves/tensorflow/test_tf_py39.py::TestTensorFlowPython39Sieve::test_run_no_yield[tensorflow-gpu-2.4.0] PASSED
tests/sieves/tensorflow/test_tf_py39.py::TestTensorFlowPython39Sieve::test_run_no_yield[intel-tensorflow-2.3.0] PASSED
tests/sieves/tensorflow/test_tf_py39.py::TestTensorFlowPython39Sieve::test_run_no_yield[tensorflow-2.3.0] PASSED
tests/sieves/tensorflow/test_tf_py39.py::TestTensorFlowPython39Sieve::test_run_no_yield[tensorflow-gpu-2.3.0] PASSED
tests/sieves/tensorflow/test_tf_py39.py::TestTensorFlowPython39Sieve::test_run_no_yield[intel-tensorflow-2.2.0] PASSED
tests/sieves/tensorflow/test_tf_py39.py::TestTensorFlowPython39Sieve::test_run_no_yield[tensorflow-2.2.0] PASSED
tests/sieves/tensorflow/test_tf_py39.py::TestTensorFlowPython39Sieve::test_run_no_yield[tensorflow-gpu-2.2.0] PASSED
tests/sieves/tensorflow/test_tf_py39.py::TestTensorFlowPython39Sieve::test_run_no_yield[intel-tensorflow-1.12.0] PASSED
tests/sieves/tensorflow/test_tf_py39.py::TestTensorFlowPython39Sieve::test_run_no_yield[tensorflow-1.12.0] PASSED
tests/sieves/tensorflow/test_tf_py39.py::TestTensorFlowPython39Sieve::test_run_no_yield[tensorflow-gpu-1.12.0] PASSED
tests/sieves/tensorflow/test_tf_py39.py::TestTensorFlowPython39Sieve::test_sieve_multiple PASSED
tests/steps/__init__.py::mypy PASSED
tests/steps/test_aicoe.py::mypy PASSED
tests/steps/test_aicoe.py::TestAICoEReleasesStep::test_provided_unit_tested <- tests/base.py PASSED
tests/steps/test_aicoe.py::TestAICoEReleasesStep::test_provided_package_version <- tests/base.py PASSED
tests/steps/test_aicoe.py::TestAICoEReleasesStep::test_default_configuration <- tests/base.py PASSED
tests/steps/test_aicoe.py::TestAICoEReleasesStep::test_super_pre_run <- tests/base.py PASSED
tests/steps/test_aicoe.py::TestAICoEReleasesStep::test_default_multi_package_resolution <- tests/base.py PASSED
tests/steps/test_aicoe.py::TestAICoEReleasesStep::test_verify_multiple_should_include PASSED
tests/steps/test_aicoe.py::TestAICoEReleasesStep::test_aicoe_release PASSED
tests/steps/test_aicoe.py::TestAICoEReleasesStep::test_no_aicoe_release PASSED
tests/steps/test_cve.py::mypy PASSED
tests/steps/test_cve.py::TestCvePenalizationStep::test_provided_unit_tested <- tests/base.py PASSED
tests/steps/test_cve.py::TestCvePenalizationStep::test_provided_package_version <- tests/base.py PASSED
tests/steps/test_cve.py::TestCvePenalizationStep::test_default_configuration <- tests/base.py PASSED
tests/steps/test_cve.py::TestCvePenalizationStep::test_super_pre_run <- tests/base.py PASSED
tests/steps/test_cve.py::TestCvePenalizationStep::test_default_multi_package_resolution <- tests/base.py PASSED
tests/steps/test_cve.py::TestCvePenalizationStep::test_verify_multiple_should_include PASSED
tests/steps/test_cve.py::TestCvePenalizationStep::test_cve_penalization PASSED
tests/steps/test_cve.py::TestCvePenalizationStep::test_no_cve_record PASSED
tests/steps/test_cve.py::TestCvePenalizationStep::test_cve_not_acceptable PASSED
tests/steps/test_dropout.py::mypy PASSED
tests/steps/test_dropout.py::TestDropoutStep::test_provided_unit_tested <- tests/base.py PASSED
tests/steps/test_dropout.py::TestDropoutStep::test_provided_package_version <- tests/base.py PASSED
tests/steps/test_dropout.py::TestDropoutStep::test_super_pre_run <- tests/base.py PASSED
tests/steps/test_dropout.py::TestDropoutStep::test_default_multi_package_resolution <- tests/base.py PASSED
tests/steps/test_dropout.py::TestDropoutStep::test_verify_multiple_should_include SKIPPED
tests/steps/test_dropout.py::TestDropoutStep::test_run_accept PASSED
tests/steps/test_dropout.py::TestDropoutStep::test_run_no_accept PASSED
tests/steps/test_dropout.py::TestDropoutStep::test_default_configuration PASSED
tests/steps/test_security_indicators.py::mypy PASSED
tests/steps/test_security_indicators.py::TestSecurityIndicatorStep::test_provided_unit_tested <- tests/base.py PASSED
tests/steps/test_security_indicators.py::TestSecurityIndicatorStep::test_provided_package_version <- tests/base.py PASSED
tests/steps/test_security_indicators.py::TestSecurityIndicatorStep::test_default_configuration <- tests/base.py PASSED
tests/steps/test_security_indicators.py::TestSecurityIndicatorStep::test_super_pre_run <- tests/base.py PASSED
tests/steps/test_security_indicators.py::TestSecurityIndicatorStep::test_default_multi_package_resolution <- tests/base.py PASSED
tests/steps/test_security_indicators.py::TestSecurityIndicatorStep::test_verify_multiple_should_include PASSED
tests/steps/test_security_indicators.py::TestSecurityIndicatorStep::test_include[RecommendationType.STABLE] PASSED
tests/steps/test_security_indicators.py::TestSecurityIndicatorStep::test_include[RecommendationType.SECURITY] PASSED
tests/steps/test_security_indicators.py::TestSecurityIndicatorStep::test_no_include[RecommendationType.LATEST] PASSED
tests/steps/test_security_indicators.py::TestSecurityIndicatorStep::test_no_include[RecommendationType.PERFORMANCE] PASSED
tests/steps/test_security_indicators.py::TestSecurityIndicatorStep::test_no_include[RecommendationType.TESTING] PASSED
tests/steps/test_security_indicators.py::TestSecurityIndicatorStep::test_security_indicator_scoring PASSED
tests/steps/test_security_indicators.py::TestSecurityIndicatorStep::test_security_indicator_scoring_missing_secure[RecommendationType.SECURITY] PASSED
tests/steps/test_security_indicators.py::TestSecurityIndicatorStep::test_security_indicator_scoring_missing_stable[RecommendationType.STABLE] PASSED
tests/steps/test_security_indicators.py::TestSecurityIndicatorStep::test_security_indicator_with_high_confidence PASSED
tests/steps/tensorflow/__init__.py::mypy PASSED
tests/steps/tensorflow/test_tf_113_numpy.py::mypy PASSED
tests/steps/tensorflow/test_tf_113_numpy.py::TestTensorFlow113NumPyStep::test_provided_unit_tested <- tests/base.py PASSED
tests/steps/tensorflow/test_tf_113_numpy.py::TestTensorFlow113NumPyStep::test_provided_package_version <- tests/base.py PASSED
tests/steps/tensorflow/test_tf_113_numpy.py::TestTensorFlow113NumPyStep::test_default_configuration <- tests/base.py PASSED
tests/steps/tensorflow/test_tf_113_numpy.py::TestTensorFlow113NumPyStep::test_super_pre_run <- tests/base.py PASSED
tests/steps/tensorflow/test_tf_113_numpy.py::TestTensorFlow113NumPyStep::test_default_multi_package_resolution <- tests/base.py PASSED
tests/steps/tensorflow/test_tf_113_numpy.py::TestTensorFlow113NumPyStep::test_verify_multiple_should_include PASSED
tests/steps/tensorflow/test_tf_113_numpy.py::TestTensorFlow113NumPyStep::test_include[RecommendationType.STABLE0] PASSED
tests/steps/tensorflow/test_tf_113_numpy.py::TestTensorFlow113NumPyStep::test_include[RecommendationType.TESTING] PASSED
tests/steps/tensorflow/test_tf_113_numpy.py::TestTensorFlow113NumPyStep::test_include[RecommendationType.PERFORMANCE] PASSED
tests/steps/tensorflow/test_tf_113_numpy.py::TestTensorFlow113NumPyStep::test_include[RecommendationType.STABLE1] PASSED
tests/steps/tensorflow/test_tf_113_numpy.py::TestTensorFlow113NumPyStep::test_no_include[RecommendationType.LATEST-None] PASSED
tests/steps/tensorflow/test_tf_113_numpy.py::TestTensorFlow113NumPyStep::test_no_include[None-DecisionType.RANDOM] PASSED
tests/steps/tensorflow/test_tf_113_numpy.py::TestTensorFlow113NumPyStep::test_run_not_acceptable[tensorflow-1.13.3] PASSED
tests/steps/tensorflow/test_tf_113_numpy.py::TestTensorFlow113NumPyStep::test_run_not_acceptable[tensorflow-1.14.0] PASSED
tests/steps/tensorflow/test_tf_113_numpy.py::TestTensorFlow113NumPyStep::test_run_not_acceptable[tensorflow-1.15.0] PASSED
tests/steps/tensorflow/test_tf_113_numpy.py::TestTensorFlow113NumPyStep::test_run_not_acceptable[tensorflow-1.15.5] PASSED
tests/steps/tensorflow/test_tf_113_numpy.py::TestTensorFlow113NumPyStep::test_run_not_acceptable[tensorflow-cpu-1.13.3] PASSED
tests/steps/tensorflow/test_tf_113_numpy.py::TestTensorFlow113NumPyStep::test_run_not_acceptable[tensorflow-cpu-1.14.0] PASSED
tests/steps/tensorflow/test_tf_113_numpy.py::TestTensorFlow113NumPyStep::test_run_not_acceptable[tensorflow-cpu-1.15.0] PASSED
tests/steps/tensorflow/test_tf_113_numpy.py::TestTensorFlow113NumPyStep::test_run_not_acceptable[tensorflow-cpu-1.15.5] PASSED
tests/steps/tensorflow/test_tf_113_numpy.py::TestTensorFlow113NumPyStep::test_run_not_acceptable[tensorflow-gpu-1.13.3] PASSED
tests/steps/tensorflow/test_tf_113_numpy.py::TestTensorFlow113NumPyStep::test_run_not_acceptable[tensorflow-gpu-1.14.0] PASSED
tests/steps/tensorflow/test_tf_113_numpy.py::TestTensorFlow113NumPyStep::test_run_not_acceptable[tensorflow-gpu-1.15.0] PASSED
tests/steps/tensorflow/test_tf_113_numpy.py::TestTensorFlow113NumPyStep::test_run_not_acceptable[tensorflow-gpu-1.15.5] PASSED
tests/steps/tensorflow/test_tf_113_numpy.py::TestTensorFlow113NumPyStep::test_run_noop[tensorflow-1.16.0] PASSED
tests/steps/tensorflow/test_tf_113_numpy.py::TestTensorFlow113NumPyStep::test_run_noop[tensorflow-1.17.0] PASSED
tests/steps/tensorflow/test_tf_113_numpy.py::TestTensorFlow113NumPyStep::test_run_noop[tensorflow-1.19.0] PASSED
tests/steps/tensorflow/test_tf_113_numpy.py::TestTensorFlow113NumPyStep::test_run_noop[tensorflow-cpu-1.16.0] PASSED
tests/steps/tensorflow/test_tf_113_numpy.py::TestTensorFlow113NumPyStep::test_run_noop[tensorflow-cpu-1.17.0] PASSED
tests/steps/tensorflow/test_tf_113_numpy.py::TestTensorFlow113NumPyStep::test_run_noop[tensorflow-cpu-1.19.0] PASSED
tests/steps/tensorflow/test_tf_113_numpy.py::TestTensorFlow113NumPyStep::test_run_noop[tensorflow-gpu-1.16.0] PASSED
tests/steps/tensorflow/test_tf_113_numpy.py::TestTensorFlow113NumPyStep::test_run_noop[tensorflow-gpu-1.17.0] PASSED
tests/steps/tensorflow/test_tf_113_numpy.py::TestTensorFlow113NumPyStep::test_run_noop[tensorflow-gpu-1.19.0] PASSED
tests/steps/tensorflow/test_tf_114_gast.py::mypy PASSED
tests/steps/tensorflow/test_tf_114_gast.py::TestTensorFlow114GastStep::test_provided_unit_tested <- tests/base.py PASSED
tests/steps/tensorflow/test_tf_114_gast.py::TestTensorFlow114GastStep::test_provided_package_version <- tests/base.py PASSED
tests/steps/tensorflow/test_tf_114_gast.py::TestTensorFlow114GastStep::test_default_configuration <- tests/base.py PASSED
tests/steps/tensorflow/test_tf_114_gast.py::TestTensorFlow114GastStep::test_super_pre_run <- tests/base.py PASSED
tests/steps/tensorflow/test_tf_114_gast.py::TestTensorFlow114GastStep::test_default_multi_package_resolution <- tests/base.py PASSED
tests/steps/tensorflow/test_tf_114_gast.py::TestTensorFlow114GastStep::test_verify_multiple_should_include PASSED
tests/steps/tensorflow/test_tf_114_gast.py::TestTensorFlow114GastStep::test_include[RecommendationType.STABLE0] PASSED
tests/steps/tensorflow/test_tf_114_gast.py::TestTensorFlow114GastStep::test_include[RecommendationType.TESTING] PASSED
tests/steps/tensorflow/test_tf_114_gast.py::TestTensorFlow114GastStep::test_include[RecommendationType.PERFORMANCE] PASSED
tests/steps/tensorflow/test_tf_114_gast.py::TestTensorFlow114GastStep::test_include[RecommendationType.STABLE1] PASSED
tests/steps/tensorflow/test_tf_114_gast.py::TestTensorFlow114GastStep::test_no_include[RecommendationType.LATEST-None] PASSED
tests/steps/tensorflow/test_tf_114_gast.py::TestTensorFlow114GastStep::test_no_include[None-DecisionType.RANDOM] PASSED
tests/steps/tensorflow/test_tf_114_gast.py::TestTensorFlow114GastStep::test_run_not_acceptable[tensorflow-1.13.3-0.3.0] PASSED
tests/steps/tensorflow/test_tf_114_gast.py::TestTensorFlow114GastStep::test_run_not_acceptable[tensorflow-1.13.3-0.3.1] PASSED
tests/steps/tensorflow/test_tf_114_gast.py::TestTensorFlow114GastStep::test_run_not_acceptable[tensorflow-1.13.3-0.2.3] PASSED
tests/steps/tensorflow/test_tf_114_gast.py::TestTensorFlow114GastStep::test_run_not_acceptable[tensorflow-1.14.0-0.3.0] PASSED
tests/steps/tensorflow/test_tf_114_gast.py::TestTensorFlow114GastStep::test_run_not_acceptable[tensorflow-1.14.0-0.3.1] PASSED
tests/steps/tensorflow/test_tf_114_gast.py::TestTensorFlow114GastStep::test_run_not_acceptable[tensorflow-1.14.0-0.2.3] PASSED
tests/steps/tensorflow/test_tf_114_gast.py::TestTensorFlow114GastStep::test_run_not_acceptable[tensorflow-1.14.1-0.3.0] PASSED
tests/steps/tensorflow/test_tf_114_gast.py::TestTensorFlow114GastStep::test_run_not_acceptable[tensorflow-1.14.1-0.3.1] PASSED
tests/steps/tensorflow/test_tf_114_gast.py::TestTensorFlow114GastStep::test_run_not_acceptable[tensorflow-1.14.1-0.2.3] PASSED
tests/steps/tensorflow/test_tf_114_gast.py::TestTensorFlow114GastStep::test_run_not_acceptable[tensorflow-1.5.1-0.3.0] PASSED
tests/steps/tensorflow/test_tf_114_gast.py::TestTensorFlow114GastStep::test_run_not_acceptable[tensorflow-1.5.1-0.3.1] PASSED
tests/steps/tensorflow/test_tf_114_gast.py::TestTensorFlow114GastStep::test_run_not_acceptable[tensorflow-1.5.1-0.2.3] PASSED
tests/steps/tensorflow/test_tf_114_gast.py::TestTensorFlow114GastStep::test_run_not_acceptable[tensorflow-cpu-1.13.3-0.3.0] PASSED
tests/steps/tensorflow/test_tf_114_gast.py::TestTensorFlow114GastStep::test_run_not_acceptable[tensorflow-cpu-1.13.3-0.3.1] PASSED
tests/steps/tensorflow/test_tf_114_gast.py::TestTensorFlow114GastStep::test_run_not_acceptable[tensorflow-cpu-1.13.3-0.2.3] PASSED
tests/steps/tensorflow/test_tf_114_gast.py::TestTensorFlow114GastStep::test_run_not_acceptable[tensorflow-cpu-1.14.0-0.3.0] PASSED
tests/steps/tensorflow/test_tf_114_gast.py::TestTensorFlow114GastStep::test_run_not_acceptable[tensorflow-cpu-1.14.0-0.3.1] PASSED
tests/steps/tensorflow/test_tf_114_gast.py::TestTensorFlow114GastStep::test_run_not_acceptable[tensorflow-cpu-1.14.0-0.2.3] PASSED
tests/steps/tensorflow/test_tf_114_gast.py::TestTensorFlow114GastStep::test_run_not_acceptable[tensorflow-cpu-1.14.1-0.3.0] PASSED
tests/steps/tensorflow/test_tf_114_gast.py::TestTensorFlow114GastStep::test_run_not_acceptable[tensorflow-cpu-1.14.1-0.3.1] PASSED
tests/steps/tensorflow/test_tf_114_gast.py::TestTensorFlow114GastStep::test_run_not_acceptable[tensorflow-cpu-1.14.1-0.2.3] PASSED
tests/steps/tensorflow/test_tf_114_gast.py::TestTensorFlow114GastStep::test_run_not_acceptable[tensorflow-cpu-1.5.1-0.3.0] PASSED
tests/steps/tensorflow/test_tf_114_gast.py::TestTensorFlow114GastStep::test_run_not_acceptable[tensorflow-cpu-1.5.1-0.3.1] PASSED
tests/steps/tensorflow/test_tf_114_gast.py::TestTensorFlow114GastStep::test_run_not_acceptable[tensorflow-cpu-1.5.1-0.2.3] PASSED
tests/steps/tensorflow/test_tf_114_gast.py::TestTensorFlow114GastStep::test_run_not_acceptable[tensorflow-gpu-1.13.3-0.3.0] PASSED
tests/steps/tensorflow/test_tf_114_gast.py::TestTensorFlow114GastStep::test_run_not_acceptable[tensorflow-gpu-1.13.3-0.3.1] PASSED
tests/steps/tensorflow/test_tf_114_gast.py::TestTensorFlow114GastStep::test_run_not_acceptable[tensorflow-gpu-1.13.3-0.2.3] PASSED
tests/steps/tensorflow/test_tf_114_gast.py::TestTensorFlow114GastStep::test_run_not_acceptable[tensorflow-gpu-1.14.0-0.3.0] PASSED
tests/steps/tensorflow/test_tf_114_gast.py::TestTensorFlow114GastStep::test_run_not_acceptable[tensorflow-gpu-1.14.0-0.3.1] PASSED
tests/steps/tensorflow/test_tf_114_gast.py::TestTensorFlow114GastStep::test_run_not_acceptable[tensorflow-gpu-1.14.0-0.2.3] PASSED
tests/steps/tensorflow/test_tf_114_gast.py::TestTensorFlow114GastStep::test_run_not_acceptable[tensorflow-gpu-1.14.1-0.3.0] PASSED
tests/steps/tensorflow/test_tf_114_gast.py::TestTensorFlow114GastStep::test_run_not_acceptable[tensorflow-gpu-1.14.1-0.3.1] PASSED
tests/steps/tensorflow/test_tf_114_gast.py::TestTensorFlow114GastStep::test_run_not_acceptable[tensorflow-gpu-1.14.1-0.2.3] PASSED
tests/steps/tensorflow/test_tf_114_gast.py::TestTensorFlow114GastStep::test_run_not_acceptable[tensorflow-gpu-1.5.1-0.3.0] PASSED
tests/steps/tensorflow/test_tf_114_gast.py::TestTensorFlow114GastStep::test_run_not_acceptable[tensorflow-gpu-1.5.1-0.3.1] PASSED
tests/steps/tensorflow/test_tf_114_gast.py::TestTensorFlow114GastStep::test_run_not_acceptable[tensorflow-gpu-1.5.1-0.2.3] PASSED
tests/steps/tensorflow/test_tf_114_gast.py::TestTensorFlow114GastStep::test_run_noop[tensorflow-1.13.0-0.2.2] PASSED
tests/steps/tensorflow/test_tf_114_gast.py::TestTensorFlow114GastStep::test_run_noop[tensorflow-cpu-2.0.0-0.3.0] PASSED
tests/steps/tensorflow/test_tf_114_gast.py::TestTensorFlow114GastStep::test_run_noop[tensorflow-gpu-1.14.0-0.2.0] PASSED
tests/steps/tensorflow/test_tf_21_h5py.py::mypy PASSED
tests/steps/tensorflow/test_tf_21_h5py.py::TestTensorFlow21H5PyStep::test_provided_unit_tested <- tests/base.py PASSED
tests/steps/tensorflow/test_tf_21_h5py.py::TestTensorFlow21H5PyStep::test_provided_package_version <- tests/base.py PASSED
tests/steps/tensorflow/test_tf_21_h5py.py::TestTensorFlow21H5PyStep::test_default_configuration <- tests/base.py PASSED
tests/steps/tensorflow/test_tf_21_h5py.py::TestTensorFlow21H5PyStep::test_super_pre_run <- tests/base.py PASSED
tests/steps/tensorflow/test_tf_21_h5py.py::TestTensorFlow21H5PyStep::test_default_multi_package_resolution <- tests/base.py PASSED
tests/steps/tensorflow/test_tf_21_h5py.py::TestTensorFlow21H5PyStep::test_verify_multiple_should_include PASSED
tests/steps/tensorflow/test_tf_21_h5py.py::TestTensorFlow21H5PyStep::test_tf_21[2.1.0-3.0.0] PASSED
tests/steps/tensorflow/test_tf_21_h5py.py::TestTensorFlow21H5PyStep::test_tf_21[2.1.0-3.0.1] PASSED
tests/steps/tensorflow/test_tf_21_h5py.py::TestTensorFlow21H5PyStep::test_tf_21[2.1.0-4.0.0] PASSED
tests/steps/tensorflow/test_tf_21_h5py.py::TestTensorFlow21H5PyStep::test_tf_21[2.1.0-3.2.0] PASSED
tests/steps/tensorflow/test_tf_21_h5py.py::TestTensorFlow21H5PyStep::test_tf_21[2.1.1-3.0.0] PASSED
tests/steps/tensorflow/test_tf_21_h5py.py::TestTensorFlow21H5PyStep::test_tf_21[2.1.1-3.0.1] PASSED
tests/steps/tensorflow/test_tf_21_h5py.py::TestTensorFlow21H5PyStep::test_tf_21[2.1.1-4.0.0] PASSED
tests/steps/tensorflow/test_tf_21_h5py.py::TestTensorFlow21H5PyStep::test_tf_21[2.1.1-3.2.0] PASSED
tests/steps/tensorflow/test_tf_21_h5py.py::TestTensorFlow21H5PyStep::test_tf_21[2.1.2-3.0.0] PASSED
tests/steps/tensorflow/test_tf_21_h5py.py::TestTensorFlow21H5PyStep::test_tf_21[2.1.2-3.0.1] PASSED
tests/steps/tensorflow/test_tf_21_h5py.py::TestTensorFlow21H5PyStep::test_tf_21[2.1.2-4.0.0] PASSED
tests/steps/tensorflow/test_tf_21_h5py.py::TestTensorFlow21H5PyStep::test_tf_21[2.1.2-3.2.0] PASSED
tests/steps/tensorflow/test_tf_21_h5py.py::TestTensorFlow21H5PyStep::test_tf_21[2.3.1-3.0.0] PASSED
tests/steps/tensorflow/test_tf_21_h5py.py::TestTensorFlow21H5PyStep::test_tf_21[2.3.1-3.0.1] PASSED
tests/steps/tensorflow/test_tf_21_h5py.py::TestTensorFlow21H5PyStep::test_tf_21[2.3.1-4.0.0] PASSED
tests/steps/tensorflow/test_tf_21_h5py.py::TestTensorFlow21H5PyStep::test_tf_21[2.3.1-3.2.0] PASSED
tests/steps/tensorflow/test_tf_21_h5py.py::TestTensorFlow21H5PyStep::test_no_tf_21[2.9-2.1.0] PASSED
tests/steps/tensorflow/test_tf_21_h5py.py::TestTensorFlow21H5PyStep::test_no_tf_21[3.0-2.4] PASSED
tests/steps/tensorflow/test_tf_21_urllib3.py::mypy PASSED
tests/steps/tensorflow/test_tf_21_urllib3.py::TestTensorFlow21Urllib32Step::test_provided_unit_tested <- tests/base.py PASSED
tests/steps/tensorflow/test_tf_21_urllib3.py::TestTensorFlow21Urllib32Step::test_provided_package_version <- tests/base.py PASSED
tests/steps/tensorflow/test_tf_21_urllib3.py::TestTensorFlow21Urllib32Step::test_default_configuration <- tests/base.py PASSED
tests/steps/tensorflow/test_tf_21_urllib3.py::TestTensorFlow21Urllib32Step::test_super_pre_run <- tests/base.py PASSED
tests/steps/tensorflow/test_tf_21_urllib3.py::TestTensorFlow21Urllib32Step::test_default_multi_package_resolution <- tests/base.py PASSED
tests/steps/tensorflow/test_tf_21_urllib3.py::TestTensorFlow21Urllib32Step::test_verify_multiple_should_include PASSED
tests/steps/tensorflow/test_tf_21_urllib3.py::TestTensorFlow21Urllib32Step::test_tf_21[1.2-2.1] PASSED
tests/steps/tensorflow/test_tf_21_urllib3.py::TestTensorFlow21Urllib32Step::test_tf_21[1.2.1-2.1.1] PASSED
tests/steps/tensorflow/test_tf_21_urllib3.py::TestTensorFlow21Urllib32Step::test_tf_21[1.2.2-2.1.0] PASSED
tests/steps/tensorflow/test_tf_21_urllib3.py::TestTensorFlow21Urllib32Step::test_tf_21[1.3-2.1] PASSED
tests/steps/tensorflow/test_tf_21_urllib3.py::TestTensorFlow21Urllib32Step::test_tf_21[1.4-2.1] PASSED
tests/steps/tensorflow/test_tf_21_urllib3.py::TestTensorFlow21Urllib32Step::test_tf_21[1.5-2.1.dev] PASSED
tests/steps/tensorflow/test_tf_21_urllib3.py::TestTensorFlow21Urllib32Step::test_no_tf_21[1.2-2.2.0] PASSED
tests/steps/tensorflow/test_tf_21_urllib3.py::TestTensorFlow21Urllib32Step::test_no_tf_21[1.25.10-2.1] PASSED
tests/steps/tensorflow/test_tf_22_numpy.py::mypy PASSED
tests/steps/tensorflow/test_tf_22_numpy.py::TestTensorFlow22NumPyStep::test_provided_unit_tested <- tests/base.py PASSED
tests/steps/tensorflow/test_tf_22_numpy.py::TestTensorFlow22NumPyStep::test_provided_package_version <- tests/base.py PASSED
tests/steps/tensorflow/test_tf_22_numpy.py::TestTensorFlow22NumPyStep::test_default_configuration <- tests/base.py PASSED
tests/steps/tensorflow/test_tf_22_numpy.py::TestTensorFlow22NumPyStep::test_super_pre_run <- tests/base.py PASSED
tests/steps/tensorflow/test_tf_22_numpy.py::TestTensorFlow22NumPyStep::test_default_multi_package_resolution <- tests/base.py PASSED
tests/steps/tensorflow/test_tf_22_numpy.py::TestTensorFlow22NumPyStep::test_verify_multiple_should_include PASSED
tests/steps/tensorflow/test_tf_22_numpy.py::TestTensorFlow22NumPyStep::test_include[RecommendationType.STABLE0] PASSED
tests/steps/tensorflow/test_tf_22_numpy.py::TestTensorFlow22NumPyStep::test_include[RecommendationType.TESTING] PASSED
tests/steps/tensorflow/test_tf_22_numpy.py::TestTensorFlow22NumPyStep::test_include[RecommendationType.PERFORMANCE] PASSED
tests/steps/tensorflow/test_tf_22_numpy.py::TestTensorFlow22NumPyStep::test_include[RecommendationType.STABLE1] PASSED
tests/steps/tensorflow/test_tf_22_numpy.py::TestTensorFlow22NumPyStep::test_no_include[RecommendationType.LATEST-None] PASSED
tests/steps/tensorflow/test_tf_22_numpy.py::TestTensorFlow22NumPyStep::test_no_include[None-DecisionType.RANDOM] PASSED
tests/steps/tensorflow/test_tf_22_numpy.py::TestTensorFlow22NumPyStep::test_run_not_acceptable[tensorflow-2.0.0-1.19.0] PASSED
tests/steps/tensorflow/test_tf_22_numpy.py::TestTensorFlow22NumPyStep::test_run_not_acceptable[tensorflow-2.0.0-1.20.0] PASSED
tests/steps/tensorflow/test_tf_22_numpy.py::TestTensorFlow22NumPyStep::test_run_not_acceptable[tensorflow-2.1.0-1.19.0] PASSED
tests/steps/tensorflow/test_tf_22_numpy.py::TestTensorFlow22NumPyStep::test_run_not_acceptable[tensorflow-2.1.0-1.20.0] PASSED
tests/steps/tensorflow/test_tf_22_numpy.py::TestTensorFlow22NumPyStep::test_run_not_acceptable[tensorflow-2.2.0-1.19.0] PASSED
tests/steps/tensorflow/test_tf_22_numpy.py::TestTensorFlow22NumPyStep::test_run_not_acceptable[tensorflow-2.2.0-1.20.0] PASSED
tests/steps/tensorflow/test_tf_22_numpy.py::TestTensorFlow22NumPyStep::test_run_not_acceptable[tensorflow-cpu-2.0.0-1.19.0] PASSED
tests/steps/tensorflow/test_tf_22_numpy.py::TestTensorFlow22NumPyStep::test_run_not_acceptable[tensorflow-cpu-2.0.0-1.20.0] PASSED
tests/steps/tensorflow/test_tf_22_numpy.py::TestTensorFlow22NumPyStep::test_run_not_acceptable[tensorflow-cpu-2.1.0-1.19.0] PASSED
tests/steps/tensorflow/test_tf_22_numpy.py::TestTensorFlow22NumPyStep::test_run_not_acceptable[tensorflow-cpu-2.1.0-1.20.0] PASSED
tests/steps/tensorflow/test_tf_22_numpy.py::TestTensorFlow22NumPyStep::test_run_not_acceptable[tensorflow-cpu-2.2.0-1.19.0] PASSED
tests/steps/tensorflow/test_tf_22_numpy.py::TestTensorFlow22NumPyStep::test_run_not_acceptable[tensorflow-cpu-2.2.0-1.20.0] PASSED
tests/steps/tensorflow/test_tf_22_numpy.py::TestTensorFlow22NumPyStep::test_run_not_acceptable[tensorflow-gpu-2.0.0-1.19.0] PASSED
tests/steps/tensorflow/test_tf_22_numpy.py::TestTensorFlow22NumPyStep::test_run_not_acceptable[tensorflow-gpu-2.0.0-1.20.0] PASSED
tests/steps/tensorflow/test_tf_22_numpy.py::TestTensorFlow22NumPyStep::test_run_not_acceptable[tensorflow-gpu-2.1.0-1.19.0] PASSED
tests/steps/tensorflow/test_tf_22_numpy.py::TestTensorFlow22NumPyStep::test_run_not_acceptable[tensorflow-gpu-2.1.0-1.20.0] PASSED
tests/steps/tensorflow/test_tf_22_numpy.py::TestTensorFlow22NumPyStep::test_run_not_acceptable[tensorflow-gpu-2.2.0-1.19.0] PASSED
tests/steps/tensorflow/test_tf_22_numpy.py::TestTensorFlow22NumPyStep::test_run_not_acceptable[tensorflow-gpu-2.2.0-1.20.0] PASSED
tests/steps/tensorflow/test_tf_22_numpy.py::TestTensorFlow22NumPyStep::test_run_not_acceptable[intel-tensorflow-2.0.0-1.19.0] PASSED
tests/steps/tensorflow/test_tf_22_numpy.py::TestTensorFlow22NumPyStep::test_run_not_acceptable[intel-tensorflow-2.0.0-1.20.0] PASSED
tests/steps/tensorflow/test_tf_22_numpy.py::TestTensorFlow22NumPyStep::test_run_not_acceptable[intel-tensorflow-2.1.0-1.19.0] PASSED
tests/steps/tensorflow/test_tf_22_numpy.py::TestTensorFlow22NumPyStep::test_run_not_acceptable[intel-tensorflow-2.1.0-1.20.0] PASSED
tests/steps/tensorflow/test_tf_22_numpy.py::TestTensorFlow22NumPyStep::test_run_not_acceptable[intel-tensorflow-2.2.0-1.19.0] PASSED
tests/steps/tensorflow/test_tf_22_numpy.py::TestTensorFlow22NumPyStep::test_run_not_acceptable[intel-tensorflow-2.2.0-1.20.0] PASSED
tests/steps/tensorflow/test_tf_22_prob.py::mypy PASSED
tests/steps/tensorflow/test_tf_22_prob.py::TestTensorFlow22ProbabilityStep::test_provided_unit_tested <- tests/base.py PASSED
tests/steps/tensorflow/test_tf_22_prob.py::TestTensorFlow22ProbabilityStep::test_provided_package_version <- tests/base.py PASSED
tests/steps/tensorflow/test_tf_22_prob.py::TestTensorFlow22ProbabilityStep::test_default_configuration <- tests/base.py PASSED
tests/steps/tensorflow/test_tf_22_prob.py::TestTensorFlow22ProbabilityStep::test_super_pre_run <- tests/base.py PASSED
tests/steps/tensorflow/test_tf_22_prob.py::TestTensorFlow22ProbabilityStep::test_default_multi_package_resolution <- tests/base.py PASSED
tests/steps/tensorflow/test_tf_22_prob.py::TestTensorFlow22ProbabilityStep::test_verify_multiple_should_include PASSED
tests/steps/tensorflow/test_tf_22_prob.py::TestTensorFlow22ProbabilityStep::test_include[RecommendationType.STABLE] PASSED
tests/steps/tensorflow/test_tf_22_prob.py::TestTensorFlow22ProbabilityStep::test_include[RecommendationType.TESTING] PASSED
tests/steps/tensorflow/test_tf_22_prob.py::TestTensorFlow22ProbabilityStep::test_no_include[RecommendationType.LATEST-None] PASSED
tests/steps/tensorflow/test_tf_22_prob.py::TestTensorFlow22ProbabilityStep::test_no_include[None-DecisionType.RANDOM] PASSED
tests/steps/tensorflow/test_tf_22_prob.py::TestTensorFlow22ProbabilityStep::test_run[tensorflow] PASSED
tests/steps/tensorflow/test_tf_22_prob.py::TestTensorFlow22ProbabilityStep::test_run[tensorflow-cpu] PASSED
tests/steps/tensorflow/test_tf_22_prob.py::TestTensorFlow22ProbabilityStep::test_run[tensorflow-gpu] PASSED
tests/steps/tensorflow/test_tf_22_prob.py::TestTensorFlow22ProbabilityStep::test_run_acceptable_tf PASSED
tests/steps/tensorflow/test_tf_avx2.py::mypy PASSED
tests/steps/tensorflow/test_tf_avx2.py::TestTensorFlowAVX2Step::test_provided_unit_tested <- tests/base.py PASSED
tests/steps/tensorflow/test_tf_avx2.py::TestTensorFlowAVX2Step::test_provided_package_version <- tests/base.py PASSED
tests/steps/tensorflow/test_tf_avx2.py::TestTensorFlowAVX2Step::test_default_configuration <- tests/base.py PASSED
tests/steps/tensorflow/test_tf_avx2.py::TestTensorFlowAVX2Step::test_super_pre_run <- tests/base.py PASSED
tests/steps/tensorflow/test_tf_avx2.py::TestTensorFlowAVX2Step::test_default_multi_package_resolution <- tests/base.py PASSED
tests/steps/tensorflow/test_tf_avx2.py::TestTensorFlowAVX2Step::test_verify_multiple_should_include PASSED
tests/steps/tensorflow/test_tf_avx2.py::TestTensorFlowAVX2Step::test_include[RecommendationType.STABLE] PASSED
tests/steps/tensorflow/test_tf_avx2.py::TestTensorFlowAVX2Step::test_include[RecommendationType.TESTING] PASSED
tests/steps/tensorflow/test_tf_avx2.py::TestTensorFlowAVX2Step::test_no_include[RecommendationType.STABLE-None-None-None] PASSED
tests/steps/tensorflow/test_tf_avx2.py::TestTensorFlowAVX2Step::test_no_include[RecommendationType.TESTING-None--1--1] PASSED
tests/steps/tensorflow/test_tf_avx2.py::TestTensorFlowAVX2Step::test_no_include[None-DecisionType.RANDOM-6-15] PASSED
tests/steps/tensorflow/test_tf_avx2.py::TestTensorFlowAVX2Step::test_tf_avx2 PASSED
tests/steps/tensorflow/test_tf_avx2.py::TestTensorFlowAVX2Step::test_no_tf_avx2 PASSED
tests/steps/tensorflow/test_tf_rm_scipy.py::mypy PASSED
tests/steps/tensorflow/test_tf_rm_scipy.py::TestTensorFlowRemoveSciPyStep::test_provided_unit_tested <- tests/base.py PASSED
tests/steps/tensorflow/test_tf_rm_scipy.py::TestTensorFlowRemoveSciPyStep::test_provided_package_version <- tests/base.py PASSED
tests/steps/tensorflow/test_tf_rm_scipy.py::TestTensorFlowRemoveSciPyStep::test_default_configuration <- tests/base.py PASSED
tests/steps/tensorflow/test_tf_rm_scipy.py::TestTensorFlowRemoveSciPyStep::test_super_pre_run <- tests/base.py PASSED
tests/steps/tensorflow/test_tf_rm_scipy.py::TestTensorFlowRemoveSciPyStep::test_default_multi_package_resolution <- tests/base.py PASSED
tests/steps/tensorflow/test_tf_rm_scipy.py::TestTensorFlowRemoveSciPyStep::test_verify_multiple_should_include PASSED
tests/steps/tensorflow/test_tf_rm_scipy.py::TestTensorFlowRemoveSciPyStep::test_include[RecommendationType.STABLE] PASSED
tests/steps/tensorflow/test_tf_rm_scipy.py::TestTensorFlowRemoveSciPyStep::test_include[RecommendationType.PERFORMANCE] PASSED
tests/steps/tensorflow/test_tf_rm_scipy.py::TestTensorFlowRemoveSciPyStep::test_include[RecommendationType.SECURITY] PASSED
tests/steps/tensorflow/test_tf_rm_scipy.py::TestTensorFlowRemoveSciPyStep::test_no_include[RecommendationType.LATEST-None-False] PASSED
tests/steps/tensorflow/test_tf_rm_scipy.py::TestTensorFlowRemoveSciPyStep::test_no_include[RecommendationType.TESTING-None-False] PASSED
tests/steps/tensorflow/test_tf_rm_scipy.py::TestTensorFlowRemoveSciPyStep::test_no_include[RecommendationType.STABLE-None-True] PASSED
tests/steps/tensorflow/test_tf_rm_scipy.py::TestTensorFlowRemoveSciPyStep::test_no_include[None-DecisionType.RANDOM-False] PASSED
tests/steps/tensorflow/test_tf_rm_scipy.py::TestTensorFlowRemoveSciPyStep::test_run_skip_package[tensorflow-2.1.0] PASSED
tests/steps/tensorflow/test_tf_rm_scipy.py::TestTensorFlowRemoveSciPyStep::test_run_skip_package[tensorflow-2.1.1] PASSED
tests/steps/tensorflow/test_tf_rm_scipy.py::TestTensorFlowRemoveSciPyStep::test_run_skip_package[tensorflow-2.2.0rc0] PASSED
tests/steps/tensorflow/test_tf_rm_scipy.py::TestTensorFlowRemoveSciPyStep::test_run_skip_package[tensorflow-2.2.0] PASSED
tests/steps/tensorflow/test_tf_rm_scipy.py::TestTensorFlowRemoveSciPyStep::test_run_skip_package[tensorflow-cpu-2.1.0] PASSED
tests/steps/tensorflow/test_tf_rm_scipy.py::TestTensorFlowRemoveSciPyStep::test_run_skip_package[tensorflow-cpu-2.1.1] PASSED
tests/steps/tensorflow/test_tf_rm_scipy.py::TestTensorFlowRemoveSciPyStep::test_run_skip_package[tensorflow-cpu-2.2.0rc0] PASSED
tests/steps/tensorflow/test_tf_rm_scipy.py::TestTensorFlowRemoveSciPyStep::test_run_skip_package[tensorflow-cpu-2.2.0] PASSED
tests/steps/tensorflow/test_tf_rm_scipy.py::TestTensorFlowRemoveSciPyStep::test_run_skip_package[tensorflow-gpu-2.1.0] PASSED
tests/steps/tensorflow/test_tf_rm_scipy.py::TestTensorFlowRemoveSciPyStep::test_run_skip_package[tensorflow-gpu-2.1.1] PASSED
tests/steps/tensorflow/test_tf_rm_scipy.py::TestTensorFlowRemoveSciPyStep::test_run_skip_package[tensorflow-gpu-2.2.0rc0] PASSED
tests/steps/tensorflow/test_tf_rm_scipy.py::TestTensorFlowRemoveSciPyStep::test_run_skip_package[tensorflow-gpu-2.2.0] PASSED
tests/steps/tensorflow/test_tf_rm_scipy.py::TestTensorFlowRemoveSciPyStep::test_run_skip_package[intel-tensorflow-2.1.0] PASSED
tests/steps/tensorflow/test_tf_rm_scipy.py::TestTensorFlowRemoveSciPyStep::test_run_skip_package[intel-tensorflow-2.1.1] PASSED
tests/steps/tensorflow/test_tf_rm_scipy.py::TestTensorFlowRemoveSciPyStep::test_run_skip_package[intel-tensorflow-2.2.0rc0] PASSED
tests/steps/tensorflow/test_tf_rm_scipy.py::TestTensorFlowRemoveSciPyStep::test_run_skip_package[intel-tensorflow-2.2.0] PASSED
tests/steps/tensorflow/test_tf_rm_scipy.py::TestTensorFlowRemoveSciPyStep::test_run_noop[tensorflow-2.0.0] PASSED
tests/steps/tensorflow/test_tf_rm_scipy.py::TestTensorFlowRemoveSciPyStep::test_run_noop[tensorflow-1.9.1] PASSED
tests/steps/tensorflow/test_tf_rm_scipy.py::TestTensorFlowRemoveSciPyStep::test_run_noop[tensorflow-1.15.3] PASSED
tests/steps/tensorflow/test_tf_rm_scipy.py::TestTensorFlowRemoveSciPyStep::test_run_noop[tensorflow-2.3.0] PASSED
tests/steps/tensorflow/test_tf_rm_scipy.py::TestTensorFlowRemoveSciPyStep::test_run_noop[tensorflow-cpu-2.0.0] PASSED
tests/steps/tensorflow/test_tf_rm_scipy.py::TestTensorFlowRemoveSciPyStep::test_run_noop[tensorflow-cpu-1.9.1] PASSED
tests/steps/tensorflow/test_tf_rm_scipy.py::TestTensorFlowRemoveSciPyStep::test_run_noop[tensorflow-cpu-1.15.3] PASSED
tests/steps/tensorflow/test_tf_rm_scipy.py::TestTensorFlowRemoveSciPyStep::test_run_noop[tensorflow-cpu-2.3.0] PASSED
tests/steps/tensorflow/test_tf_rm_scipy.py::TestTensorFlowRemoveSciPyStep::test_run_noop[tensorflow-gpu-2.0.0] PASSED
tests/steps/tensorflow/test_tf_rm_scipy.py::TestTensorFlowRemoveSciPyStep::test_run_noop[tensorflow-gpu-1.9.1] PASSED
tests/steps/tensorflow/test_tf_rm_scipy.py::TestTensorFlowRemoveSciPyStep::test_run_noop[tensorflow-gpu-1.15.3] PASSED
tests/steps/tensorflow/test_tf_rm_scipy.py::TestTensorFlowRemoveSciPyStep::test_run_noop[tensorflow-gpu-2.3.0] PASSED
tests/steps/tensorflow/test_tf_rm_scipy.py::TestTensorFlowRemoveSciPyStep::test_run_noop[intel-tensorflow-2.0.0] PASSED
tests/steps/tensorflow/test_tf_rm_scipy.py::TestTensorFlowRemoveSciPyStep::test_run_noop[intel-tensorflow-1.9.1] PASSED
tests/steps/tensorflow/test_tf_rm_scipy.py::TestTensorFlowRemoveSciPyStep::test_run_noop[intel-tensorflow-1.15.3] PASSED
tests/steps/tensorflow/test_tf_rm_scipy.py::TestTensorFlowRemoveSciPyStep::test_run_noop[intel-tensorflow-2.3.0] PASSED
tests/steps/tensorflow/test_tf_rm_scipy.py::TestTensorFlowRemoveSciPyStep::test_run_deps PASSED
tests/strides/__init__.py::mypy PASSED
tests/strides/test_one_version.py::mypy PASSED
tests/strides/test_one_version.py::TestOneVersionStride::test_provided_unit_tested <- tests/base.py PASSED
tests/strides/test_one_version.py::TestOneVersionStride::test_provided_package_version <- tests/base.py SKIPPED
tests/strides/test_one_version.py::TestOneVersionStride::test_super_pre_run <- tests/base.py SKIPPED
tests/strides/test_one_version.py::TestOneVersionStride::test_default_multi_package_resolution <- tests/base.py SKIPPED
tests/strides/test_one_version.py::TestOneVersionStride::test_verify_multiple_should_include SKIPPED
tests/strides/test_one_version.py::TestOneVersionStride::test_default_configuration PASSED
tests/strides/test_one_version.py::TestOneVersionStride::test_should_include PASSED
tests/strides/test_one_version.py::TestOneVersionStride::test_pre_run_error PASSED
tests/strides/test_one_version.py::TestOneVersionStride::test_configuration_default PASSED
tests/strides/test_one_version.py::TestOneVersionStride::test_run_only_once PASSED
tests/strides/test_one_version.py::TestOneVersionStride::test_run_no_only_once PASSED
tests/strides/test_random_decision.py::mypy PASSED
tests/strides/test_random_decision.py::TestRandomDecision::test_provided_unit_tested <- tests/base.py PASSED
tests/strides/test_random_decision.py::TestRandomDecision::test_provided_package_version <- tests/base.py SKIPPED
tests/strides/test_random_decision.py::TestRandomDecision::test_default_configuration <- tests/base.py PASSED
tests/strides/test_random_decision.py::TestRandomDecision::test_super_pre_run <- tests/base.py SKIPPED
tests/strides/test_random_decision.py::TestRandomDecision::test_default_multi_package_resolution <- tests/base.py SKIPPED
tests/strides/test_random_decision.py::TestRandomDecision::test_verify_multiple_should_include SKIPPED
tests/strides/test_random_decision.py::TestRandomDecision::test_accept PASSED
tests/strides/test_random_decision.py::TestRandomDecision::test_reject PASSED
tests/strides/test_unique_stack.py::mypy PASSED
tests/strides/test_unique_stack.py::TestUniqueStackStride::test_provided_unit_tested <- tests/base.py PASSED
tests/strides/test_unique_stack.py::TestUniqueStackStride::test_provided_package_version <- tests/base.py SKIPPED
tests/strides/test_unique_stack.py::TestUniqueStackStride::test_default_configuration <- tests/base.py PASSED
tests/strides/test_unique_stack.py::TestUniqueStackStride::test_super_pre_run <- tests/base.py SKIPPED
tests/strides/test_unique_stack.py::TestUniqueStackStride::test_default_multi_package_resolution <- tests/base.py SKIPPED
tests/strides/test_unique_stack.py::TestUniqueStackStride::test_verify_multiple_should_include SKIPPED
tests/strides/test_unique_stack.py::TestUniqueStackStride::test_should_include[STABLE-None] PASSED
tests/strides/test_unique_stack.py::TestUniqueStackStride::test_should_include[TESTING-None] PASSED
tests/strides/test_unique_stack.py::TestUniqueStackStride::test_should_include[LATEST-None] PASSED
tests/strides/test_unique_stack.py::TestUniqueStackStride::test_should_include[PERFORMANCE-None] PASSED
tests/strides/test_unique_stack.py::TestUniqueStackStride::test_should_include[SECURITY-None] PASSED
tests/strides/test_unique_stack.py::TestUniqueStackStride::test_should_include[None-ALL] PASSED
tests/strides/test_unique_stack.py::TestUniqueStackStride::test_should_include[None-RANDOM] PASSED
tests/strides/test_unique_stack.py::TestUniqueStackStride::test_run PASSED
tests/units/__init__.py::mypy PASSED
tests/units/boots.py::mypy PASSED
tests/units/pseudonyms.py::mypy PASSED
tests/units/sieves.py::mypy PASSED
tests/units/steps.py::mypy PASSED
tests/units/strides.py::mypy PASSED
tests/units/wraps.py::mypy PASSED
tests/wraps/__init__.py::mypy PASSED
tests/wraps/test_no_observation.py::mypy PASSED
tests/wraps/test_no_observation.py::TestNoObservationWrap::test_provided_unit_tested <- tests/base.py PASSED
tests/wraps/test_no_observation.py::TestNoObservationWrap::test_provided_package_version <- tests/base.py SKIPPED
tests/wraps/test_no_observation.py::TestNoObservationWrap::test_default_configuration <- tests/base.py PASSED
tests/wraps/test_no_observation.py::TestNoObservationWrap::test_super_pre_run <- tests/base.py SKIPPED
tests/wraps/test_no_observation.py::TestNoObservationWrap::test_default_multi_package_resolution <- tests/base.py SKIPPED
tests/wraps/test_no_observation.py::TestNoObservationWrap::test_verify_multiple_should_include PASSED
tests/wraps/test_no_observation.py::TestNoObservationWrap::test_run_justification_noop PASSED
tests/wraps/test_no_observation.py::TestNoObservationWrap::test_run_no_justification PASSED
tests/wraps/test_thoth_s2i.py::mypy PASSED
tests/wraps/test_thoth_s2i.py::TestThothS2IWrap::test_provided_unit_tested <- tests/base.py PASSED
tests/wraps/test_thoth_s2i.py::TestThothS2IWrap::test_provided_package_version <- tests/base.py SKIPPED
tests/wraps/test_thoth_s2i.py::TestThothS2IWrap::test_default_configuration <- tests/base.py PASSED
tests/wraps/test_thoth_s2i.py::TestThothS2IWrap::test_super_pre_run <- tests/base.py SKIPPED
tests/wraps/test_thoth_s2i.py::TestThothS2IWrap::test_default_multi_package_resolution <- tests/base.py SKIPPED
tests/wraps/test_thoth_s2i.py::TestThothS2IWrap::test_verify_multiple_should_include PASSED
tests/wraps/test_thoth_s2i.py::TestThothS2IWrap::test_include[None] PASSED
tests/wraps/test_thoth_s2i.py::TestThothS2IWrap::test_include[fedora:33] PASSED
tests/wraps/test_thoth_s2i.py::TestThothS2IWrap::test_include[quay.io/thoth-station/solver-ubi8-py38:v0.23.0] PASSED
tests/wraps/test_thoth_s2i.py::TestThothS2IWrap::test_run PASSED
tests/wraps/test_thoth_s2i_info.py::mypy PASSED
tests/wraps/test_thoth_s2i_info.py::TestThothS2IWrap::test_provided_unit_tested <- tests/base.py PASSED
tests/wraps/test_thoth_s2i_info.py::TestThothS2IWrap::test_provided_package_version <- tests/base.py SKIPPED
tests/wraps/test_thoth_s2i_info.py::TestThothS2IWrap::test_super_pre_run <- tests/base.py SKIPPED
tests/wraps/test_thoth_s2i_info.py::TestThothS2IWrap::test_default_multi_package_resolution <- tests/base.py SKIPPED
tests/wraps/test_thoth_s2i_info.py::TestThothS2IWrap::test_verify_multiple_should_include PASSED
tests/wraps/test_thoth_s2i_info.py::TestThothS2IWrap::test_no_include[None] PASSED
tests/wraps/test_thoth_s2i_info.py::TestThothS2IWrap::test_no_include[fedora:33] PASSED
tests/wraps/test_thoth_s2i_info.py::TestThothS2IWrap::test_no_include[quay.io/thoth-station/solver-ubi8-py38:v0.23.0] PASSED
tests/wraps/test_thoth_s2i_info.py::TestThothS2IWrap::test_run PASSED
tests/wraps/test_thoth_s2i_info.py::TestThothS2IWrap::test_default_configuration PASSED
tests/wraps/python/__init__.py::mypy PASSED
tests/wraps/python/test_no_semantic_interposition.py::mypy PASSED
tests/wraps/python/test_no_semantic_interposition.py::TestNoSemanticInterpositionWrap::test_provided_unit_tested <- tests/base.py PASSED
tests/wraps/python/test_no_semantic_interposition.py::TestNoSemanticInterpositionWrap::test_provided_package_version <- tests/base.py SKIPPED
tests/wraps/python/test_no_semantic_interposition.py::TestNoSemanticInterpositionWrap::test_default_configuration <- tests/base.py PASSED
tests/wraps/python/test_no_semantic_interposition.py::TestNoSemanticInterpositionWrap::test_super_pre_run <- tests/base.py SKIPPED
tests/wraps/python/test_no_semantic_interposition.py::TestNoSemanticInterpositionWrap::test_default_multi_package_resolution <- tests/base.py SKIPPED
tests/wraps/python/test_no_semantic_interposition.py::TestNoSemanticInterpositionWrap::test_verify_multiple_should_include PASSED
tests/wraps/python/test_no_semantic_interposition.py::TestNoSemanticInterpositionWrap::test_include[rhel-8.2-3.6] PASSED
tests/wraps/python/test_no_semantic_interposition.py::TestNoSemanticInterpositionWrap::test_include[ubi-8.2-3.7] PASSED
tests/wraps/python/test_no_semantic_interposition.py::TestNoSemanticInterpositionWrap::test_no_include[None-RecommendationType.LATEST-rhel-8.0-3.8] PASSED
tests/wraps/python/test_no_semantic_interposition.py::TestNoSemanticInterpositionWrap::test_no_include[None-RecommendationType.STABLE-ubi-8.0-3.8] PASSED
tests/wraps/python/test_no_semantic_interposition.py::TestNoSemanticInterpositionWrap::test_no_include[None-RecommendationType.LATEST-rhel-8.2-3.8] PASSED
tests/wraps/python/test_no_semantic_interposition.py::TestNoSemanticInterpositionWrap::test_no_include[None-RecommendationType.STABLE-fedora-32-3.8] PASSED
tests/wraps/python/test_no_semantic_interposition.py::TestNoSemanticInterpositionWrap::test_no_include[DecisionType.RANDOM-None-rhel-8.2-3.6] PASSED
tests/wraps/python/test_no_semantic_interposition.py::TestNoSemanticInterpositionWrap::test_run PASSED
tests/wraps/pytorch/__init__.py::mypy PASSED
tests/wraps/tensorflow/__init__.py::mypy PASSED
tests/wraps/tensorflow/test_intel.py::mypy PASSED
tests/wraps/tensorflow/test_intel.py::TestIntelTensorflowWrap::test_provided_unit_tested <- tests/base.py PASSED
tests/wraps/tensorflow/test_intel.py::TestIntelTensorflowWrap::test_provided_package_version <- tests/base.py SKIPPED
tests/wraps/tensorflow/test_intel.py::TestIntelTensorflowWrap::test_default_configuration <- tests/base.py PASSED
tests/wraps/tensorflow/test_intel.py::TestIntelTensorflowWrap::test_super_pre_run <- tests/base.py SKIPPED
tests/wraps/tensorflow/test_intel.py::TestIntelTensorflowWrap::test_default_multi_package_resolution <- tests/base.py SKIPPED
tests/wraps/tensorflow/test_intel.py::TestIntelTensorflowWrap::test_verify_multiple_should_include PASSED
tests/wraps/tensorflow/test_intel.py::TestIntelTensorflowWrap::test_include[13-6-RecommendationType.STABLE] PASSED
tests/wraps/tensorflow/test_intel.py::TestIntelTensorflowWrap::test_include[13-6-RecommendationType.TESTING] PASSED
tests/wraps/tensorflow/test_intel.py::TestIntelTensorflowWrap::test_include[13-6-RecommendationType.LATEST] PASSED
tests/wraps/tensorflow/test_intel.py::TestIntelTensorflowWrap::test_include[13-6-RecommendationType.PERFORMANCE] PASSED
tests/wraps/tensorflow/test_intel.py::TestIntelTensorflowWrap::test_include[13-6-RecommendationType.SECURITY] PASSED
tests/wraps/tensorflow/test_intel.py::TestIntelTensorflowWrap::test_no_include[None-RecommendationType.LATEST-666-6-linux-x86_64] PASSED
tests/wraps/tensorflow/test_intel.py::TestIntelTensorflowWrap::test_no_include[None-RecommendationType.STABLE-13-666-linux-x86_64] PASSED
tests/wraps/tensorflow/test_intel.py::TestIntelTensorflowWrap::test_no_include[None-RecommendationType.LATEST-13-6-win-amd64] PASSED
tests/wraps/tensorflow/test_intel.py::TestIntelTensorflowWrap::test_no_include[DecisionType.RANDOM-None-13-6-linux-x86_64] PASSED
tests/wraps/tensorflow/test_intel.py::TestIntelTensorflowWrap::test_run PASSED
tests/wraps/tensorflow/test_mkl_threads.py::mypy PASSED
tests/wraps/tensorflow/test_mkl_threads.py::TestMKLThreadsWrap::test_provided_unit_tested <- tests/base.py PASSED
tests/wraps/tensorflow/test_mkl_threads.py::TestMKLThreadsWrap::test_provided_package_version <- tests/base.py SKIPPED
tests/wraps/tensorflow/test_mkl_threads.py::TestMKLThreadsWrap::test_default_configuration <- tests/base.py PASSED
tests/wraps/tensorflow/test_mkl_threads.py::TestMKLThreadsWrap::test_super_pre_run <- tests/base.py SKIPPED
tests/wraps/tensorflow/test_mkl_threads.py::TestMKLThreadsWrap::test_default_multi_package_resolution <- tests/base.py SKIPPED
tests/wraps/tensorflow/test_mkl_threads.py::TestMKLThreadsWrap::test_verify_multiple_should_include PASSED
tests/wraps/tensorflow/test_mkl_threads.py::TestMKLThreadsWrap::test_run_justification_noop PASSED
tests/wraps/tensorflow/test_mkl_threads.py::TestMKLThreadsWrap::test_run_add_justification PASSED
tests/wraps/tensorflow/test_tf_23_accuracy.py::mypy PASSED
tests/wraps/tensorflow/test_tf_23_accuracy.py::TestTensorFlow23Accuracy::test_provided_unit_tested <- tests/base.py PASSED
tests/wraps/tensorflow/test_tf_23_accuracy.py::TestTensorFlow23Accuracy::test_provided_package_version <- tests/base.py SKIPPED
tests/wraps/tensorflow/test_tf_23_accuracy.py::TestTensorFlow23Accuracy::test_default_configuration <- tests/base.py PASSED
tests/wraps/tensorflow/test_tf_23_accuracy.py::TestTensorFlow23Accuracy::test_super_pre_run <- tests/base.py SKIPPED
tests/wraps/tensorflow/test_tf_23_accuracy.py::TestTensorFlow23Accuracy::test_default_multi_package_resolution <- tests/base.py SKIPPED
tests/wraps/tensorflow/test_tf_23_accuracy.py::TestTensorFlow23Accuracy::test_verify_multiple_should_include PASSED
tests/wraps/tensorflow/test_tf_23_accuracy.py::TestTensorFlow23Accuracy::test_run_noop PASSED
tests/wraps/tensorflow/test_tf_23_accuracy.py::TestTensorFlow23Accuracy::test_run[2.3.0] PASSED
tests/wraps/tensorflow/test_tf_23_dict_bug.py::mypy PASSED
tests/wraps/tensorflow/test_tf_23_dict_bug.py::TestTensorFlow23DictSummary::test_provided_unit_tested <- tests/base.py PASSED
tests/wraps/tensorflow/test_tf_23_dict_bug.py::TestTensorFlow23DictSummary::test_provided_package_version <- tests/base.py SKIPPED
tests/wraps/tensorflow/test_tf_23_dict_bug.py::TestTensorFlow23DictSummary::test_default_configuration <- tests/base.py PASSED
tests/wraps/tensorflow/test_tf_23_dict_bug.py::TestTensorFlow23DictSummary::test_super_pre_run <- tests/base.py SKIPPED
tests/wraps/tensorflow/test_tf_23_dict_bug.py::TestTensorFlow23DictSummary::test_default_multi_package_resolution <- tests/base.py SKIPPED
tests/wraps/tensorflow/test_tf_23_dict_bug.py::TestTensorFlow23DictSummary::test_verify_multiple_should_include PASSED
tests/wraps/tensorflow/test_tf_23_dict_bug.py::TestTensorFlow23DictSummary::test_run_noop PASSED
tests/wraps/tensorflow/test_tf_23_dict_bug.py::TestTensorFlow23DictSummary::test_run[2.3.0] PASSED
tests/wraps/tensorflow/test_tf_38518.py::mypy PASSED
tests/wraps/tensorflow/test_tf_38518.py::TestIntelTensorflowWrap::test_provided_unit_tested <- tests/base.py PASSED
tests/wraps/tensorflow/test_tf_38518.py::TestIntelTensorflowWrap::test_provided_package_version <- tests/base.py SKIPPED
tests/wraps/tensorflow/test_tf_38518.py::TestIntelTensorflowWrap::test_default_configuration <- tests/base.py PASSED
tests/wraps/tensorflow/test_tf_38518.py::TestIntelTensorflowWrap::test_super_pre_run <- tests/base.py SKIPPED
tests/wraps/tensorflow/test_tf_38518.py::TestIntelTensorflowWrap::test_default_multi_package_resolution <- tests/base.py SKIPPED
tests/wraps/tensorflow/test_tf_38518.py::TestIntelTensorflowWrap::test_verify_multiple_should_include PASSED
tests/wraps/tensorflow/test_tf_38518.py::TestIntelTensorflowWrap::test_include PASSED
tests/wraps/tensorflow/test_tf_38518.py::TestIntelTensorflowWrap::test_no_include PASSED
tests/wraps/tensorflow/test_tf_38518.py::TestIntelTensorflowWrap::test_run PASSED
tests/wraps/tensorflow/test_tf_38518.py::TestIntelTensorflowWrap::test_run_no_justification PASSED
tests/wraps/tensorflow/test_tf_42475.py::mypy PASSED
tests/wraps/tensorflow/test_tf_42475.py::TestIntelTensorflowWrap::test_provided_unit_tested <- tests/base.py PASSED
tests/wraps/tensorflow/test_tf_42475.py::TestIntelTensorflowWrap::test_provided_package_version <- tests/base.py SKIPPED
tests/wraps/tensorflow/test_tf_42475.py::TestIntelTensorflowWrap::test_default_configuration <- tests/base.py PASSED
tests/wraps/tensorflow/test_tf_42475.py::TestIntelTensorflowWrap::test_super_pre_run <- tests/base.py SKIPPED
tests/wraps/tensorflow/test_tf_42475.py::TestIntelTensorflowWrap::test_default_multi_package_resolution <- tests/base.py SKIPPED
tests/wraps/tensorflow/test_tf_42475.py::TestIntelTensorflowWrap::test_verify_multiple_should_include PASSED
tests/wraps/tensorflow/test_tf_42475.py::TestIntelTensorflowWrap::test_include PASSED
tests/wraps/tensorflow/test_tf_42475.py::TestIntelTensorflowWrap::test_include_library_usage PASSED
tests/wraps/tensorflow/test_tf_42475.py::TestIntelTensorflowWrap::test_no_include PASSED
tests/wraps/tensorflow/test_tf_42475.py::TestIntelTensorflowWrap::test_no_include_library_usage PASSED
tests/wraps/tensorflow/test_tf_42475.py::TestIntelTensorflowWrap::test_run PASSED
tests/wraps/tensorflow/test_tf_42475.py::TestIntelTensorflowWrap::test_run_no_justification PASSED
tests/wraps/tensorflow/test_tf_intel.py::mypy PASSED
tests/wraps/tensorflow/test_tf_intel.py::TestIntelTensorflowWrap::test_provided_unit_tested <- tests/base.py PASSED
tests/wraps/tensorflow/test_tf_intel.py::TestIntelTensorflowWrap::test_provided_package_version <- tests/base.py SKIPPED
tests/wraps/tensorflow/test_tf_intel.py::TestIntelTensorflowWrap::test_default_configuration <- tests/base.py PASSED
tests/wraps/tensorflow/test_tf_intel.py::TestIntelTensorflowWrap::test_super_pre_run <- tests/base.py SKIPPED
tests/wraps/tensorflow/test_tf_intel.py::TestIntelTensorflowWrap::test_default_multi_package_resolution <- tests/base.py SKIPPED
tests/wraps/tensorflow/test_tf_intel.py::TestIntelTensorflowWrap::test_verify_multiple_should_include PASSED
tests/wraps/tensorflow/test_tf_intel.py::TestIntelTensorflowWrap::test_include[13-6-RecommendationType.STABLE] PASSED
tests/wraps/tensorflow/test_tf_intel.py::TestIntelTensorflowWrap::test_include[13-6-RecommendationType.TESTING] PASSED
tests/wraps/tensorflow/test_tf_intel.py::TestIntelTensorflowWrap::test_include[13-6-RecommendationType.LATEST] PASSED
tests/wraps/tensorflow/test_tf_intel.py::TestIntelTensorflowWrap::test_include[13-6-RecommendationType.PERFORMANCE] PASSED
tests/wraps/tensorflow/test_tf_intel.py::TestIntelTensorflowWrap::test_include[13-6-RecommendationType.SECURITY] PASSED
tests/wraps/tensorflow/test_tf_intel.py::TestIntelTensorflowWrap::test_no_include[None-RecommendationType.LATEST-666-6-linux-x86_64] PASSED
tests/wraps/tensorflow/test_tf_intel.py::TestIntelTensorflowWrap::test_no_include[None-RecommendationType.STABLE-13-666-linux-x86_64] PASSED
tests/wraps/tensorflow/test_tf_intel.py::TestIntelTensorflowWrap::test_no_include[None-RecommendationType.LATEST-13-6-win-amd64] PASSED
tests/wraps/tensorflow/test_tf_intel.py::TestIntelTensorflowWrap::test_no_include[DecisionType.RANDOM-None-13-6-linux-x86_64] PASSED
tests/wraps/tensorflow/test_tf_intel.py::TestIntelTensorflowWrap::test_run PASSED
tests/wraps/tensorflow/test_tf_mkl_threads.py::mypy PASSED
tests/wraps/tensorflow/test_tf_mkl_threads.py::TestMKLThreadsWrap::test_provided_unit_tested <- tests/base.py PASSED
tests/wraps/tensorflow/test_tf_mkl_threads.py::TestMKLThreadsWrap::test_provided_package_version <- tests/base.py SKIPPED
tests/wraps/tensorflow/test_tf_mkl_threads.py::TestMKLThreadsWrap::test_default_configuration <- tests/base.py PASSED
tests/wraps/tensorflow/test_tf_mkl_threads.py::TestMKLThreadsWrap::test_super_pre_run <- tests/base.py SKIPPED
tests/wraps/tensorflow/test_tf_mkl_threads.py::TestMKLThreadsWrap::test_default_multi_package_resolution <- tests/base.py SKIPPED
tests/wraps/tensorflow/test_tf_mkl_threads.py::TestMKLThreadsWrap::test_verify_multiple_should_include PASSED
tests/wraps/tensorflow/test_tf_mkl_threads.py::TestMKLThreadsWrap::test_run_justification_noop PASSED
tests/wraps/tensorflow/test_tf_mkl_threads.py::TestMKLThreadsWrap::test_run_add_justification PASSED
tests/wraps/tensorflow/test_tf_mkl_threads.py::TestMKLThreadsWrap::test_run_add_justification_intel_tf PASSED

=================================== FAILURES ===================================
___ TestSelctiveCutPreReleasesSieve.test_include[RecommendationType.STABLE] ____

self = <tests.sieves.test_experimental_prereleases.TestSelctiveCutPreReleasesSieve object at 0x7fbca5061820>
builder_context = PipelineBuilderContext(graph=GraphDatabase(_engine=None, _sessionmaker=None), project=Project(pipfile=Pipfile(packages...ncluded={}, _pseudonyms_included={}, _sieves_included={}, _steps_included={}, _strides_included={}, _wraps_included={})
recommendation_type = <RecommendationType.STABLE: 1>

    @pytest.mark.parametrize(
        "recommendation_type",
        [
            RecommendationType.STABLE,
            RecommendationType.PERFORMANCE,
            RecommendationType.SECURITY,
            RecommendationType.LATEST,
            RecommendationType.TESTING,
        ],
    )
    def test_include(
        self,
        builder_context: PipelineBuilderContext,
        recommendation_type: RecommendationType,
    ) -> None:
        """Test including this pipeline unit."""
        builder_context.recommendation_type = recommendation_type
        builder_context.project = Project.from_strings(self._CASE_GLOBAL_DISALLOWED_PIPFILE)
    
        assert builder_context.is_adviser_pipeline()
>       assert self.UNIT_TESTED.should_include(builder_context) == {
            "package_name": None,
            "allow_prereleases": {
                "tensorflow": True,
                "flask": False,
            },
        }

builder_context = PipelineBuilderContext(graph=GraphDatabase(_engine=None, _sessionmaker=None), project=Project(pipfile=Pipfile(packages=Packages(develop=False, packages={'tensorflow': PackageVersion(name='tensorflow', version='*', develop=False, index=None, hashes=[], markers=None, extras=[], _semantic_version=None, _locked_version=None, _package_tuple=None, _package_tuple_locked=None)}), dev_packages=Packages(develop=True, packages={}), meta=PipfileMeta(sources={'pypi': Source(url='https://pypi.org/simple', name='pypi', verify_ssl=True, warehouse=True, warehouse_api_url=None)}, requires={}, pipenv={'allow_prereleases': False}, hash=None, pipfile_spec=None)), pipfile_lock=None, runtime_environment=RuntimeEnvironment(hardware=HardwareInformation(cpu_family=None, cpu_model=None, gpu_model=None), operating_system=OperatingSystem(name=None, version=None), python_version=None, cuda_version=None, openblas_version=None, openmpi_version=None, cudnn_version=None, mkl_version=None, base_image=None, name=None, platform=None, _python_version_tuple=None), _graph_db=None, _workdir=None), library_usage=None, decision_type=None, recommendation_type=<RecommendationType.STABLE: 1>, _boots={}, _pseudonyms={}, _sieves={}, _steps={}, _strides={}, _wraps={}, _boots_included={}, _pseudonyms_included={}, _sieves_included={}, _steps_included={}, _strides_included={}, _wraps_included={})
recommendation_type = <RecommendationType.STABLE: 1>
self       = <tests.sieves.test_experimental_prereleases.TestSelctiveCutPreReleasesSieve object at 0x7fbca5061820>

tests/sieves/test_experimental_prereleases.py:107: 
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 

cls = <class 'thoth.adviser.sieves.experimental_prereleases.SelectiveCutPreReleasesSieve'>
builder_context = PipelineBuilderContext(graph=GraphDatabase(_engine=None, _sessionmaker=None), project=Project(pipfile=Pipfile(packages...ncluded={}, _pseudonyms_included={}, _sieves_included={}, _steps_included={}, _strides_included={}, _wraps_included={})

    @classmethod
    def should_include(cls, builder_context: "PipelineBuilderContext") -> Optional[Dict[str, Any]]:
        """Enable or disable specific pre-releases for the given set of packages.."""
        if builder_context.project.prereleases_allowed:
            if builder_context.project.prereleases_allowed:
                msg = "Ignoring selective pre-releases in [thoth] section as global allow_prereleases flag is set"
                _LOGGER.warning(msg)
    
            return None
    
>       if builder_context.is_included(cls) or not builder_context.project.pipfile.thoth.allow_prereleases:
E       AttributeError: 'Pipfile' object has no attribute 'thoth'

builder_context = PipelineBuilderContext(graph=GraphDatabase(_engine=None, _sessionmaker=None), project=Project(pipfile=Pipfile(packages=Packages(develop=False, packages={'tensorflow': PackageVersion(name='tensorflow', version='*', develop=False, index=None, hashes=[], markers=None, extras=[], _semantic_version=None, _locked_version=None, _package_tuple=None, _package_tuple_locked=None)}), dev_packages=Packages(develop=True, packages={}), meta=PipfileMeta(sources={'pypi': Source(url='https://pypi.org/simple', name='pypi', verify_ssl=True, warehouse=True, warehouse_api_url=None)}, requires={}, pipenv={'allow_prereleases': False}, hash=None, pipfile_spec=None)), pipfile_lock=None, runtime_environment=RuntimeEnvironment(hardware=HardwareInformation(cpu_family=None, cpu_model=None, gpu_model=None), operating_system=OperatingSystem(name=None, version=None), python_version=None, cuda_version=None, openblas_version=None, openmpi_version=None, cudnn_version=None, mkl_version=None, base_image=None, name=None, platform=None, _python_version_tuple=None), _graph_db=None, _workdir=None), library_usage=None, decision_type=None, recommendation_type=<RecommendationType.STABLE: 1>, _boots={}, _pseudonyms={}, _sieves={}, _steps={}, _strides={}, _wraps={}, _boots_included={}, _pseudonyms_included={}, _sieves_included={}, _steps_included={}, _strides_included={}, _wraps_included={})
cls        = <class 'thoth.adviser.sieves.experimental_prereleases.SelectiveCutPreReleasesSieve'>

thoth/adviser/sieves/experimental_prereleases.py:59: AttributeError
------------------------------ Captured log call -------------------------------
WARNING  thoth.python.pipfile:pipfile.py:76 Metadata ignored in Pipfile or Pipfile.lock: {'thoth': {'allow_prereleases': {'tensorflow': True, 'flask': False}}}
_ TestSelctiveCutPreReleasesSieve.test_include[RecommendationType.PERFORMANCE] _

self = <tests.sieves.test_experimental_prereleases.TestSelctiveCutPreReleasesSieve object at 0x7fbc98e8d730>
builder_context = PipelineBuilderContext(graph=GraphDatabase(_engine=None, _sessionmaker=None), project=Project(pipfile=Pipfile(packages...ncluded={}, _pseudonyms_included={}, _sieves_included={}, _steps_included={}, _strides_included={}, _wraps_included={})
recommendation_type = <RecommendationType.PERFORMANCE: 4>

    @pytest.mark.parametrize(
        "recommendation_type",
        [
            RecommendationType.STABLE,
            RecommendationType.PERFORMANCE,
            RecommendationType.SECURITY,
            RecommendationType.LATEST,
            RecommendationType.TESTING,
        ],
    )
    def test_include(
        self,
        builder_context: PipelineBuilderContext,
        recommendation_type: RecommendationType,
    ) -> None:
        """Test including this pipeline unit."""
        builder_context.recommendation_type = recommendation_type
        builder_context.project = Project.from_strings(self._CASE_GLOBAL_DISALLOWED_PIPFILE)
    
        assert builder_context.is_adviser_pipeline()
>       assert self.UNIT_TESTED.should_include(builder_context) == {
            "package_name": None,
            "allow_prereleases": {
                "tensorflow": True,
                "flask": False,
            },
        }

builder_context = PipelineBuilderContext(graph=GraphDatabase(_engine=None, _sessionmaker=None), project=Project(pipfile=Pipfile(packages=Packages(develop=False, packages={'tensorflow': PackageVersion(name='tensorflow', version='*', develop=False, index=None, hashes=[], markers=None, extras=[], _semantic_version=None, _locked_version=None, _package_tuple=None, _package_tuple_locked=None)}), dev_packages=Packages(develop=True, packages={}), meta=PipfileMeta(sources={'pypi': Source(url='https://pypi.org/simple', name='pypi', verify_ssl=True, warehouse=True, warehouse_api_url=None)}, requires={}, pipenv={'allow_prereleases': False}, hash=None, pipfile_spec=None)), pipfile_lock=None, runtime_environment=RuntimeEnvironment(hardware=HardwareInformation(cpu_family=None, cpu_model=None, gpu_model=None), operating_system=OperatingSystem(name=None, version=None), python_version=None, cuda_version=None, openblas_version=None, openmpi_version=None, cudnn_version=None, mkl_version=None, base_image=None, name=None, platform=None, _python_version_tuple=None), _graph_db=None, _workdir=None), library_usage=None, decision_type=None, recommendation_type=<RecommendationType.PERFORMANCE: 4>, _boots={}, _pseudonyms={}, _sieves={}, _steps={}, _strides={}, _wraps={}, _boots_included={}, _pseudonyms_included={}, _sieves_included={}, _steps_included={}, _strides_included={}, _wraps_included={})
recommendation_type = <RecommendationType.PERFORMANCE: 4>
self       = <tests.sieves.test_experimental_prereleases.TestSelctiveCutPreReleasesSieve object at 0x7fbc98e8d730>

tests/sieves/test_experimental_prereleases.py:107: 
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 

cls = <class 'thoth.adviser.sieves.experimental_prereleases.SelectiveCutPreReleasesSieve'>
builder_context = PipelineBuilderContext(graph=GraphDatabase(_engine=None, _sessionmaker=None), project=Project(pipfile=Pipfile(packages...ncluded={}, _pseudonyms_included={}, _sieves_included={}, _steps_included={}, _strides_included={}, _wraps_included={})

    @classmethod
    def should_include(cls, builder_context: "PipelineBuilderContext") -> Optional[Dict[str, Any]]:
        """Enable or disable specific pre-releases for the given set of packages.."""
        if builder_context.project.prereleases_allowed:
            if builder_context.project.prereleases_allowed:
                msg = "Ignoring selective pre-releases in [thoth] section as global allow_prereleases flag is set"
                _LOGGER.warning(msg)
    
            return None
    
>       if builder_context.is_included(cls) or not builder_context.project.pipfile.thoth.allow_prereleases:
E       AttributeError: 'Pipfile' object has no attribute 'thoth'

builder_context = PipelineBuilderContext(graph=GraphDatabase(_engine=None, _sessionmaker=None), project=Project(pipfile=Pipfile(packages=Packages(develop=False, packages={'tensorflow': PackageVersion(name='tensorflow', version='*', develop=False, index=None, hashes=[], markers=None, extras=[], _semantic_version=None, _locked_version=None, _package_tuple=None, _package_tuple_locked=None)}), dev_packages=Packages(develop=True, packages={}), meta=PipfileMeta(sources={'pypi': Source(url='https://pypi.org/simple', name='pypi', verify_ssl=True, warehouse=True, warehouse_api_url=None)}, requires={}, pipenv={'allow_prereleases': False}, hash=None, pipfile_spec=None)), pipfile_lock=None, runtime_environment=RuntimeEnvironment(hardware=HardwareInformation(cpu_family=None, cpu_model=None, gpu_model=None), operating_system=OperatingSystem(name=None, version=None), python_version=None, cuda_version=None, openblas_version=None, openmpi_version=None, cudnn_version=None, mkl_version=None, base_image=None, name=None, platform=None, _python_version_tuple=None), _graph_db=None, _workdir=None), library_usage=None, decision_type=None, recommendation_type=<RecommendationType.PERFORMANCE: 4>, _boots={}, _pseudonyms={}, _sieves={}, _steps={}, _strides={}, _wraps={}, _boots_included={}, _pseudonyms_included={}, _sieves_included={}, _steps_included={}, _strides_included={}, _wraps_included={})
cls        = <class 'thoth.adviser.sieves.experimental_prereleases.SelectiveCutPreReleasesSieve'>

thoth/adviser/sieves/experimental_prereleases.py:59: AttributeError
------------------------------ Captured log call -------------------------------
WARNING  thoth.python.pipfile:pipfile.py:76 Metadata ignored in Pipfile or Pipfile.lock: {'thoth': {'allow_prereleases': {'tensorflow': True, 'flask': False}}}
__ TestSelctiveCutPreReleasesSieve.test_include[RecommendationType.SECURITY] ___

self = <tests.sieves.test_experimental_prereleases.TestSelctiveCutPreReleasesSieve object at 0x7fbca2a13f10>
builder_context = PipelineBuilderContext(graph=GraphDatabase(_engine=None, _sessionmaker=None), project=Project(pipfile=Pipfile(packages...ncluded={}, _pseudonyms_included={}, _sieves_included={}, _steps_included={}, _strides_included={}, _wraps_included={})
recommendation_type = <RecommendationType.SECURITY: 5>

    @pytest.mark.parametrize(
        "recommendation_type",
        [
            RecommendationType.STABLE,
            RecommendationType.PERFORMANCE,
            RecommendationType.SECURITY,
            RecommendationType.LATEST,
            RecommendationType.TESTING,
        ],
    )
    def test_include(
        self,
        builder_context: PipelineBuilderContext,
        recommendation_type: RecommendationType,
    ) -> None:
        """Test including this pipeline unit."""
        builder_context.recommendation_type = recommendation_type
        builder_context.project = Project.from_strings(self._CASE_GLOBAL_DISALLOWED_PIPFILE)
    
        assert builder_context.is_adviser_pipeline()
>       assert self.UNIT_TESTED.should_include(builder_context) == {
            "package_name": None,
            "allow_prereleases": {
                "tensorflow": True,
                "flask": False,
            },
        }

builder_context = PipelineBuilderContext(graph=GraphDatabase(_engine=None, _sessionmaker=None), project=Project(pipfile=Pipfile(packages=Packages(develop=False, packages={'tensorflow': PackageVersion(name='tensorflow', version='*', develop=False, index=None, hashes=[], markers=None, extras=[], _semantic_version=None, _locked_version=None, _package_tuple=None, _package_tuple_locked=None)}), dev_packages=Packages(develop=True, packages={}), meta=PipfileMeta(sources={'pypi': Source(url='https://pypi.org/simple', name='pypi', verify_ssl=True, warehouse=True, warehouse_api_url=None)}, requires={}, pipenv={'allow_prereleases': False}, hash=None, pipfile_spec=None)), pipfile_lock=None, runtime_environment=RuntimeEnvironment(hardware=HardwareInformation(cpu_family=None, cpu_model=None, gpu_model=None), operating_system=OperatingSystem(name=None, version=None), python_version=None, cuda_version=None, openblas_version=None, openmpi_version=None, cudnn_version=None, mkl_version=None, base_image=None, name=None, platform=None, _python_version_tuple=None), _graph_db=None, _workdir=None), library_usage=None, decision_type=None, recommendation_type=<RecommendationType.SECURITY: 5>, _boots={}, _pseudonyms={}, _sieves={}, _steps={}, _strides={}, _wraps={}, _boots_included={}, _pseudonyms_included={}, _sieves_included={}, _steps_included={}, _strides_included={}, _wraps_included={})
recommendation_type = <RecommendationType.SECURITY: 5>
self       = <tests.sieves.test_experimental_prereleases.TestSelctiveCutPreReleasesSieve object at 0x7fbca2a13f10>

tests/sieves/test_experimental_prereleases.py:107: 
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 

cls = <class 'thoth.adviser.sieves.experimental_prereleases.SelectiveCutPreReleasesSieve'>
builder_context = PipelineBuilderContext(graph=GraphDatabase(_engine=None, _sessionmaker=None), project=Project(pipfile=Pipfile(packages...ncluded={}, _pseudonyms_included={}, _sieves_included={}, _steps_included={}, _strides_included={}, _wraps_included={})

    @classmethod
    def should_include(cls, builder_context: "PipelineBuilderContext") -> Optional[Dict[str, Any]]:
        """Enable or disable specific pre-releases for the given set of packages.."""
        if builder_context.project.prereleases_allowed:
            if builder_context.project.prereleases_allowed:
                msg = "Ignoring selective pre-releases in [thoth] section as global allow_prereleases flag is set"
                _LOGGER.warning(msg)
    
            return None
    
>       if builder_context.is_included(cls) or not builder_context.project.pipfile.thoth.allow_prereleases:
E       AttributeError: 'Pipfile' object has no attribute 'thoth'

builder_context = PipelineBuilderContext(graph=GraphDatabase(_engine=None, _sessionmaker=None), project=Project(pipfile=Pipfile(packages=Packages(develop=False, packages={'tensorflow': PackageVersion(name='tensorflow', version='*', develop=False, index=None, hashes=[], markers=None, extras=[], _semantic_version=None, _locked_version=None, _package_tuple=None, _package_tuple_locked=None)}), dev_packages=Packages(develop=True, packages={}), meta=PipfileMeta(sources={'pypi': Source(url='https://pypi.org/simple', name='pypi', verify_ssl=True, warehouse=True, warehouse_api_url=None)}, requires={}, pipenv={'allow_prereleases': False}, hash=None, pipfile_spec=None)), pipfile_lock=None, runtime_environment=RuntimeEnvironment(hardware=HardwareInformation(cpu_family=None, cpu_model=None, gpu_model=None), operating_system=OperatingSystem(name=None, version=None), python_version=None, cuda_version=None, openblas_version=None, openmpi_version=None, cudnn_version=None, mkl_version=None, base_image=None, name=None, platform=None, _python_version_tuple=None), _graph_db=None, _workdir=None), library_usage=None, decision_type=None, recommendation_type=<RecommendationType.SECURITY: 5>, _boots={}, _pseudonyms={}, _sieves={}, _steps={}, _strides={}, _wraps={}, _boots_included={}, _pseudonyms_included={}, _sieves_included={}, _steps_included={}, _strides_included={}, _wraps_included={})
cls        = <class 'thoth.adviser.sieves.experimental_prereleases.SelectiveCutPreReleasesSieve'>

thoth/adviser/sieves/experimental_prereleases.py:59: AttributeError
------------------------------ Captured log call -------------------------------
WARNING  thoth.python.pipfile:pipfile.py:76 Metadata ignored in Pipfile or Pipfile.lock: {'thoth': {'allow_prereleases': {'tensorflow': True, 'flask': False}}}
___ TestSelctiveCutPreReleasesSieve.test_include[RecommendationType.LATEST] ____

self = <tests.sieves.test_experimental_prereleases.TestSelctiveCutPreReleasesSieve object at 0x7fbc826bb700>
builder_context = PipelineBuilderContext(graph=GraphDatabase(_engine=None, _sessionmaker=None), project=Project(pipfile=Pipfile(packages...ncluded={}, _pseudonyms_included={}, _sieves_included={}, _steps_included={}, _strides_included={}, _wraps_included={})
recommendation_type = <RecommendationType.LATEST: 3>

    @pytest.mark.parametrize(
        "recommendation_type",
        [
            RecommendationType.STABLE,
            RecommendationType.PERFORMANCE,
            RecommendationType.SECURITY,
            RecommendationType.LATEST,
            RecommendationType.TESTING,
        ],
    )
    def test_include(
        self,
        builder_context: PipelineBuilderContext,
        recommendation_type: RecommendationType,
    ) -> None:
        """Test including this pipeline unit."""
        builder_context.recommendation_type = recommendation_type
        builder_context.project = Project.from_strings(self._CASE_GLOBAL_DISALLOWED_PIPFILE)
    
        assert builder_context.is_adviser_pipeline()
>       assert self.UNIT_TESTED.should_include(builder_context) == {
            "package_name": None,
            "allow_prereleases": {
                "tensorflow": True,
                "flask": False,
            },
        }

builder_context = PipelineBuilderContext(graph=GraphDatabase(_engine=None, _sessionmaker=None), project=Project(pipfile=Pipfile(packages=Packages(develop=False, packages={'tensorflow': PackageVersion(name='tensorflow', version='*', develop=False, index=None, hashes=[], markers=None, extras=[], _semantic_version=None, _locked_version=None, _package_tuple=None, _package_tuple_locked=None)}), dev_packages=Packages(develop=True, packages={}), meta=PipfileMeta(sources={'pypi': Source(url='https://pypi.org/simple', name='pypi', verify_ssl=True, warehouse=True, warehouse_api_url=None)}, requires={}, pipenv={'allow_prereleases': False}, hash=None, pipfile_spec=None)), pipfile_lock=None, runtime_environment=RuntimeEnvironment(hardware=HardwareInformation(cpu_family=None, cpu_model=None, gpu_model=None), operating_system=OperatingSystem(name=None, version=None), python_version=None, cuda_version=None, openblas_version=None, openmpi_version=None, cudnn_version=None, mkl_version=None, base_image=None, name=None, platform=None, _python_version_tuple=None), _graph_db=None, _workdir=None), library_usage=None, decision_type=None, recommendation_type=<RecommendationType.LATEST: 3>, _boots={}, _pseudonyms={}, _sieves={}, _steps={}, _strides={}, _wraps={}, _boots_included={}, _pseudonyms_included={}, _sieves_included={}, _steps_included={}, _strides_included={}, _wraps_included={})
recommendation_type = <RecommendationType.LATEST: 3>
self       = <tests.sieves.test_experimental_prereleases.TestSelctiveCutPreReleasesSieve object at 0x7fbc826bb700>

tests/sieves/test_experimental_prereleases.py:107: 
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 

cls = <class 'thoth.adviser.sieves.experimental_prereleases.SelectiveCutPreReleasesSieve'>
builder_context = PipelineBuilderContext(graph=GraphDatabase(_engine=None, _sessionmaker=None), project=Project(pipfile=Pipfile(packages...ncluded={}, _pseudonyms_included={}, _sieves_included={}, _steps_included={}, _strides_included={}, _wraps_included={})

    @classmethod
    def should_include(cls, builder_context: "PipelineBuilderContext") -> Optional[Dict[str, Any]]:
        """Enable or disable specific pre-releases for the given set of packages.."""
        if builder_context.project.prereleases_allowed:
            if builder_context.project.prereleases_allowed:
                msg = "Ignoring selective pre-releases in [thoth] section as global allow_prereleases flag is set"
                _LOGGER.warning(msg)
    
            return None
    
>       if builder_context.is_included(cls) or not builder_context.project.pipfile.thoth.allow_prereleases:
E       AttributeError: 'Pipfile' object has no attribute 'thoth'

builder_context = PipelineBuilderContext(graph=GraphDatabase(_engine=None, _sessionmaker=None), project=Project(pipfile=Pipfile(packages=Packages(develop=False, packages={'tensorflow': PackageVersion(name='tensorflow', version='*', develop=False, index=None, hashes=[], markers=None, extras=[], _semantic_version=None, _locked_version=None, _package_tuple=None, _package_tuple_locked=None)}), dev_packages=Packages(develop=True, packages={}), meta=PipfileMeta(sources={'pypi': Source(url='https://pypi.org/simple', name='pypi', verify_ssl=True, warehouse=True, warehouse_api_url=None)}, requires={}, pipenv={'allow_prereleases': False}, hash=None, pipfile_spec=None)), pipfile_lock=None, runtime_environment=RuntimeEnvironment(hardware=HardwareInformation(cpu_family=None, cpu_model=None, gpu_model=None), operating_system=OperatingSystem(name=None, version=None), python_version=None, cuda_version=None, openblas_version=None, openmpi_version=None, cudnn_version=None, mkl_version=None, base_image=None, name=None, platform=None, _python_version_tuple=None), _graph_db=None, _workdir=None), library_usage=None, decision_type=None, recommendation_type=<RecommendationType.LATEST: 3>, _boots={}, _pseudonyms={}, _sieves={}, _steps={}, _strides={}, _wraps={}, _boots_included={}, _pseudonyms_included={}, _sieves_included={}, _steps_included={}, _strides_included={}, _wraps_included={})
cls        = <class 'thoth.adviser.sieves.experimental_prereleases.SelectiveCutPreReleasesSieve'>

thoth/adviser/sieves/experimental_prereleases.py:59: AttributeError
------------------------------ Captured log call -------------------------------
WARNING  thoth.python.pipfile:pipfile.py:76 Metadata ignored in Pipfile or Pipfile.lock: {'thoth': {'allow_prereleases': {'tensorflow': True, 'flask': False}}}
___ TestSelctiveCutPreReleasesSieve.test_include[RecommendationType.TESTING] ___

self = <tests.sieves.test_experimental_prereleases.TestSelctiveCutPreReleasesSieve object at 0x7fbc990a3e50>
builder_context = PipelineBuilderContext(graph=GraphDatabase(_engine=None, _sessionmaker=None), project=Project(pipfile=Pipfile(packages...ncluded={}, _pseudonyms_included={}, _sieves_included={}, _steps_included={}, _strides_included={}, _wraps_included={})
recommendation_type = <RecommendationType.TESTING: 2>

    @pytest.mark.parametrize(
        "recommendation_type",
        [
            RecommendationType.STABLE,
            RecommendationType.PERFORMANCE,
            RecommendationType.SECURITY,
            RecommendationType.LATEST,
            RecommendationType.TESTING,
        ],
    )
    def test_include(
        self,
        builder_context: PipelineBuilderContext,
        recommendation_type: RecommendationType,
    ) -> None:
        """Test including this pipeline unit."""
        builder_context.recommendation_type = recommendation_type
        builder_context.project = Project.from_strings(self._CASE_GLOBAL_DISALLOWED_PIPFILE)
    
        assert builder_context.is_adviser_pipeline()
>       assert self.UNIT_TESTED.should_include(builder_context) == {
            "package_name": None,
            "allow_prereleases": {
                "tensorflow": True,
                "flask": False,
            },
        }

builder_context = PipelineBuilderContext(graph=GraphDatabase(_engine=None, _sessionmaker=None), project=Project(pipfile=Pipfile(packages=Packages(develop=False, packages={'tensorflow': PackageVersion(name='tensorflow', version='*', develop=False, index=None, hashes=[], markers=None, extras=[], _semantic_version=None, _locked_version=None, _package_tuple=None, _package_tuple_locked=None)}), dev_packages=Packages(develop=True, packages={}), meta=PipfileMeta(sources={'pypi': Source(url='https://pypi.org/simple', name='pypi', verify_ssl=True, warehouse=True, warehouse_api_url=None)}, requires={}, pipenv={'allow_prereleases': False}, hash=None, pipfile_spec=None)), pipfile_lock=None, runtime_environment=RuntimeEnvironment(hardware=HardwareInformation(cpu_family=None, cpu_model=None, gpu_model=None), operating_system=OperatingSystem(name=None, version=None), python_version=None, cuda_version=None, openblas_version=None, openmpi_version=None, cudnn_version=None, mkl_version=None, base_image=None, name=None, platform=None, _python_version_tuple=None), _graph_db=None, _workdir=None), library_usage=None, decision_type=None, recommendation_type=<RecommendationType.TESTING: 2>, _boots={}, _pseudonyms={}, _sieves={}, _steps={}, _strides={}, _wraps={}, _boots_included={}, _pseudonyms_included={}, _sieves_included={}, _steps_included={}, _strides_included={}, _wraps_included={})
recommendation_type = <RecommendationType.TESTING: 2>
self       = <tests.sieves.test_experimental_prereleases.TestSelctiveCutPreReleasesSieve object at 0x7fbc990a3e50>

tests/sieves/test_experimental_prereleases.py:107: 
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 

cls = <class 'thoth.adviser.sieves.experimental_prereleases.SelectiveCutPreReleasesSieve'>
builder_context = PipelineBuilderContext(graph=GraphDatabase(_engine=None, _sessionmaker=None), project=Project(pipfile=Pipfile(packages...ncluded={}, _pseudonyms_included={}, _sieves_included={}, _steps_included={}, _strides_included={}, _wraps_included={})

    @classmethod
    def should_include(cls, builder_context: "PipelineBuilderContext") -> Optional[Dict[str, Any]]:
        """Enable or disable specific pre-releases for the given set of packages.."""
        if builder_context.project.prereleases_allowed:
            if builder_context.project.prereleases_allowed:
                msg = "Ignoring selective pre-releases in [thoth] section as global allow_prereleases flag is set"
                _LOGGER.warning(msg)
    
            return None
    
>       if builder_context.is_included(cls) or not builder_context.project.pipfile.thoth.allow_prereleases:
E       AttributeError: 'Pipfile' object has no attribute 'thoth'

builder_context = PipelineBuilderContext(graph=GraphDatabase(_engine=None, _sessionmaker=None), project=Project(pipfile=Pipfile(packages=Packages(develop=False, packages={'tensorflow': PackageVersion(name='tensorflow', version='*', develop=False, index=None, hashes=[], markers=None, extras=[], _semantic_version=None, _locked_version=None, _package_tuple=None, _package_tuple_locked=None)}), dev_packages=Packages(develop=True, packages={}), meta=PipfileMeta(sources={'pypi': Source(url='https://pypi.org/simple', name='pypi', verify_ssl=True, warehouse=True, warehouse_api_url=None)}, requires={}, pipenv={'allow_prereleases': False}, hash=None, pipfile_spec=None)), pipfile_lock=None, runtime_environment=RuntimeEnvironment(hardware=HardwareInformation(cpu_family=None, cpu_model=None, gpu_model=None), operating_system=OperatingSystem(name=None, version=None), python_version=None, cuda_version=None, openblas_version=None, openmpi_version=None, cudnn_version=None, mkl_version=None, base_image=None, name=None, platform=None, _python_version_tuple=None), _graph_db=None, _workdir=None), library_usage=None, decision_type=None, recommendation_type=<RecommendationType.TESTING: 2>, _boots={}, _pseudonyms={}, _sieves={}, _steps={}, _strides={}, _wraps={}, _boots_included={}, _pseudonyms_included={}, _sieves_included={}, _steps_included={}, _strides_included={}, _wraps_included={})
cls        = <class 'thoth.adviser.sieves.experimental_prereleases.SelectiveCutPreReleasesSieve'>

thoth/adviser/sieves/experimental_prereleases.py:59: AttributeError
------------------------------ Captured log call -------------------------------
WARNING  thoth.python.pipfile:pipfile.py:76 Metadata ignored in Pipfile or Pipfile.lock: {'thoth': {'allow_prereleases': {'tensorflow': True, 'flask': False}}}
_____ TestSelctiveCutPreReleasesSieve.test_verify_multiple_should_include ______

self = <tests.sieves.test_experimental_prereleases.TestSelctiveCutPreReleasesSieve object at 0x7fbca23d09a0>
builder_context = PipelineBuilderContext(graph=GraphDatabase(_engine=None, _sessionmaker=None), project=Project(pipfile=Pipfile(packages...ncluded={}, _pseudonyms_included={}, _sieves_included={}, _steps_included={}, _strides_included={}, _wraps_included={})

    def test_verify_multiple_should_include(self, builder_context: PipelineBuilderContext) -> None:
        """Verify multiple should_include calls do not loop endlessly."""
        builder_context.recommendation_type = RecommendationType.LATEST
        builder_context.project = Project.from_strings(self._CASE_GLOBAL_DISALLOWED_PIPFILE)
>       self.verify_multiple_should_include(builder_context)

builder_context = PipelineBuilderContext(graph=GraphDatabase(_engine=None, _sessionmaker=None), project=Project(pipfile=Pipfile(packages=Packages(develop=False, packages={'tensorflow': PackageVersion(name='tensorflow', version='*', develop=False, index=None, hashes=[], markers=None, extras=[], _semantic_version=None, _locked_version=None, _package_tuple=None, _package_tuple_locked=None)}), dev_packages=Packages(develop=True, packages={}), meta=PipfileMeta(sources={'pypi': Source(url='https://pypi.org/simple', name='pypi', verify_ssl=True, warehouse=True, warehouse_api_url=None)}, requires={}, pipenv={'allow_prereleases': False}, hash=None, pipfile_spec=None)), pipfile_lock=None, runtime_environment=RuntimeEnvironment(hardware=HardwareInformation(cpu_family=None, cpu_model=None, gpu_model=None), operating_system=OperatingSystem(name=None, version=None), python_version=None, cuda_version=None, openblas_version=None, openmpi_version=None, cudnn_version=None, mkl_version=None, base_image=None, name=None, platform=None, _python_version_tuple=None), _graph_db=None, _workdir=None), library_usage=None, decision_type=None, recommendation_type=<RecommendationType.LATEST: 3>, _boots={}, _pseudonyms={}, _sieves={}, _steps={}, _strides={}, _wraps={}, _boots_included={}, _pseudonyms_included={}, _sieves_included={}, _steps_included={}, _strides_included={}, _wraps_included={})
self       = <tests.sieves.test_experimental_prereleases.TestSelctiveCutPreReleasesSieve object at 0x7fbca23d09a0>

tests/sieves/test_experimental_prereleases.py:119: 
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 
tests/base.py:122: in verify_multiple_should_include
    pipeline_config = cls.UNIT_TESTED.should_include(builder_context)
        builder_context = PipelineBuilderContext(graph=GraphDatabase(_engine=None, _sessionmaker=None), project=Project(pipfile=Pipfile(packages=Packages(develop=False, packages={'tensorflow': PackageVersion(name='tensorflow', version='*', develop=False, index=None, hashes=[], markers=None, extras=[], _semantic_version=None, _locked_version=None, _package_tuple=None, _package_tuple_locked=None)}), dev_packages=Packages(develop=True, packages={}), meta=PipfileMeta(sources={'pypi': Source(url='https://pypi.org/simple', name='pypi', verify_ssl=True, warehouse=True, warehouse_api_url=None)}, requires={}, pipenv={'allow_prereleases': False}, hash=None, pipfile_spec=None)), pipfile_lock=None, runtime_environment=RuntimeEnvironment(hardware=HardwareInformation(cpu_family=None, cpu_model=None, gpu_model=None), operating_system=OperatingSystem(name=None, version=None), python_version=None, cuda_version=None, openblas_version=None, openmpi_version=None, cudnn_version=None, mkl_version=None, base_image=None, name=None, platform=None, _python_version_tuple=None), _graph_db=None, _workdir=None), library_usage=None, decision_type=None, recommendation_type=<RecommendationType.LATEST: 3>, _boots={}, _pseudonyms={}, _sieves={}, _steps={}, _strides={}, _wraps={}, _boots_included={}, _pseudonyms_included={}, _sieves_included={}, _steps_included={}, _strides_included={}, _wraps_included={})
        cls        = <class 'tests.sieves.test_experimental_prereleases.TestSelctiveCutPreReleasesSieve'>
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 

cls = <class 'thoth.adviser.sieves.experimental_prereleases.SelectiveCutPreReleasesSieve'>
builder_context = PipelineBuilderContext(graph=GraphDatabase(_engine=None, _sessionmaker=None), project=Project(pipfile=Pipfile(packages...ncluded={}, _pseudonyms_included={}, _sieves_included={}, _steps_included={}, _strides_included={}, _wraps_included={})

    @classmethod
    def should_include(cls, builder_context: "PipelineBuilderContext") -> Optional[Dict[str, Any]]:
        """Enable or disable specific pre-releases for the given set of packages.."""
        if builder_context.project.prereleases_allowed:
            if builder_context.project.prereleases_allowed:
                msg = "Ignoring selective pre-releases in [thoth] section as global allow_prereleases flag is set"
                _LOGGER.warning(msg)
    
            return None
    
>       if builder_context.is_included(cls) or not builder_context.project.pipfile.thoth.allow_prereleases:
E       AttributeError: 'Pipfile' object has no attribute 'thoth'

builder_context = PipelineBuilderContext(graph=GraphDatabase(_engine=None, _sessionmaker=None), project=Project(pipfile=Pipfile(packages=Packages(develop=False, packages={'tensorflow': PackageVersion(name='tensorflow', version='*', develop=False, index=None, hashes=[], markers=None, extras=[], _semantic_version=None, _locked_version=None, _package_tuple=None, _package_tuple_locked=None)}), dev_packages=Packages(develop=True, packages={}), meta=PipfileMeta(sources={'pypi': Source(url='https://pypi.org/simple', name='pypi', verify_ssl=True, warehouse=True, warehouse_api_url=None)}, requires={}, pipenv={'allow_prereleases': False}, hash=None, pipfile_spec=None)), pipfile_lock=None, runtime_environment=RuntimeEnvironment(hardware=HardwareInformation(cpu_family=None, cpu_model=None, gpu_model=None), operating_system=OperatingSystem(name=None, version=None), python_version=None, cuda_version=None, openblas_version=None, openmpi_version=None, cudnn_version=None, mkl_version=None, base_image=None, name=None, platform=None, _python_version_tuple=None), _graph_db=None, _workdir=None), library_usage=None, decision_type=None, recommendation_type=<RecommendationType.LATEST: 3>, _boots={}, _pseudonyms={}, _sieves={}, _steps={}, _strides={}, _wraps={}, _boots_included={}, _pseudonyms_included={}, _sieves_included={}, _steps_included={}, _strides_included={}, _wraps_included={})
cls        = <class 'thoth.adviser.sieves.experimental_prereleases.SelectiveCutPreReleasesSieve'>

thoth/adviser/sieves/experimental_prereleases.py:59: AttributeError
------------------------------ Captured log call -------------------------------
WARNING  thoth.python.pipfile:pipfile.py:76 Metadata ignored in Pipfile or Pipfile.lock: {'thoth': {'allow_prereleases': {'tensorflow': True, 'flask': False}}}
_ TestSelctiveCutPreReleasesSieve.test_remove_pre_releases_disallowed_noop[tensorflow-2.4.0rc1] _

self = <tests.sieves.test_experimental_prereleases.TestSelctiveCutPreReleasesSieve object at 0x7fbc850eaaf0>
package_name = 'tensorflow', package_version = '2.4.0rc1'

    @pytest.mark.parametrize("package_name,package_version", [("tensorflow", "2.4.0rc1"), ("flask", "1.0")])
    def test_remove_pre_releases_disallowed_noop(self, package_name: str, package_version: str) -> None:
        """Test NOT removing dependencies based on pre-release configuration."""
        pv = PackageVersion(
            name=package_name,
            version=f"=={package_version}",
            index=Source("https://pypi.org/simple"),
            develop=False,
        )
    
        project = Project.from_strings(self._CASE_GLOBAL_DISALLOWED_PIPFILE)
        context = flexmock(project=project)
        sieve = self.UNIT_TESTED()
>       sieve.update_configuration({"package_name": None, "allow_prereleases": project.pipfile.thoth.allow_prereleases})
E       AttributeError: 'Pipfile' object has no attribute 'thoth'

context    = <flexmock.MockClass object at 0x7fbc850ea370>
package_name = 'tensorflow'
package_version = '2.4.0rc1'
project    = Project(pipfile=Pipfile(packages=Packages(develop=False, packages={'tensorflow': PackageVersion(name='tensorflow', version='*', develop=False, index=None, hashes=[], markers=None, extras=[], _semantic_version=None, _locked_version=None, _package_tuple=None, _package_tuple_locked=None)}), dev_packages=Packages(develop=True, packages={}), meta=PipfileMeta(sources={'pypi': Source(url='https://pypi.org/simple', name='pypi', verify_ssl=True, warehouse=True, warehouse_api_url=None)}, requires={}, pipenv={'allow_prereleases': False}, hash=None, pipfile_spec=None)), pipfile_lock=None, runtime_environment=RuntimeEnvironment(hardware=HardwareInformation(cpu_family=None, cpu_model=None, gpu_model=None), operating_system=OperatingSystem(name=None, version=None), python_version=None, cuda_version=None, openblas_version=None, openmpi_version=None, cudnn_version=None, mkl_version=None, base_image=None, name=None, platform=None, _python_version_tuple=None), _graph_db=None, _workdir=None)
pv         = PackageVersion(name='tensorflow', version='==2.4.0rc1', develop=False, index=Source(url='https://pypi.org/simple', name='pypi-org-simple', verify_ssl=True, warehouse=True, warehouse_api_url=None), hashes=[], markers=None, extras=[], _semantic_version=None, _locked_version=None, _package_tuple=None, _package_tuple_locked=None)
self       = <tests.sieves.test_experimental_prereleases.TestSelctiveCutPreReleasesSieve object at 0x7fbc850eaaf0>
sieve      = SelectiveCutPreReleasesSieve(_configuration={'package_name': None, 'allow_prereleases': None}, _name=None, unit_run=False)

tests/sieves/test_experimental_prereleases.py:164: AttributeError
------------------------------ Captured log call -------------------------------
WARNING  thoth.python.pipfile:pipfile.py:76 Metadata ignored in Pipfile or Pipfile.lock: {'thoth': {'allow_prereleases': {'tensorflow': True, 'flask': False}}}
_ TestSelctiveCutPreReleasesSieve.test_remove_pre_releases_disallowed_noop[flask-1.0] _

self = <tests.sieves.test_experimental_prereleases.TestSelctiveCutPreReleasesSieve object at 0x7fbc8a00b1f0>
package_name = 'flask', package_version = '1.0'

    @pytest.mark.parametrize("package_name,package_version", [("tensorflow", "2.4.0rc1"), ("flask", "1.0")])
    def test_remove_pre_releases_disallowed_noop(self, package_name: str, package_version: str) -> None:
        """Test NOT removing dependencies based on pre-release configuration."""
        pv = PackageVersion(
            name=package_name,
            version=f"=={package_version}",
            index=Source("https://pypi.org/simple"),
            develop=False,
        )
    
        project = Project.from_strings(self._CASE_GLOBAL_DISALLOWED_PIPFILE)
        context = flexmock(project=project)
        sieve = self.UNIT_TESTED()
>       sieve.update_configuration({"package_name": None, "allow_prereleases": project.pipfile.thoth.allow_prereleases})
E       AttributeError: 'Pipfile' object has no attribute 'thoth'

context    = <flexmock.MockClass object at 0x7fbc8a00b5e0>
package_name = 'flask'
package_version = '1.0'
project    = Project(pipfile=Pipfile(packages=Packages(develop=False, packages={'tensorflow': PackageVersion(name='tensorflow', version='*', develop=False, index=None, hashes=[], markers=None, extras=[], _semantic_version=None, _locked_version=None, _package_tuple=None, _package_tuple_locked=None)}), dev_packages=Packages(develop=True, packages={}), meta=PipfileMeta(sources={'pypi': Source(url='https://pypi.org/simple', name='pypi', verify_ssl=True, warehouse=True, warehouse_api_url=None)}, requires={}, pipenv={'allow_prereleases': False}, hash=None, pipfile_spec=None)), pipfile_lock=None, runtime_environment=RuntimeEnvironment(hardware=HardwareInformation(cpu_family=None, cpu_model=None, gpu_model=None), operating_system=OperatingSystem(name=None, version=None), python_version=None, cuda_version=None, openblas_version=None, openmpi_version=None, cudnn_version=None, mkl_version=None, base_image=None, name=None, platform=None, _python_version_tuple=None), _graph_db=None, _workdir=None)
pv         = PackageVersion(name='flask', version='==1.0', develop=False, index=Source(url='https://pypi.org/simple', name='pypi-org-simple', verify_ssl=True, warehouse=True, warehouse_api_url=None), hashes=[], markers=None, extras=[], _semantic_version=None, _locked_version=None, _package_tuple=None, _package_tuple_locked=None)
self       = <tests.sieves.test_experimental_prereleases.TestSelctiveCutPreReleasesSieve object at 0x7fbc8a00b1f0>
sieve      = SelectiveCutPreReleasesSieve(_configuration={'package_name': None, 'allow_prereleases': None}, _name=None, unit_run=False)

tests/sieves/test_experimental_prereleases.py:164: AttributeError
------------------------------ Captured log call -------------------------------
WARNING  thoth.python.pipfile:pipfile.py:76 Metadata ignored in Pipfile or Pipfile.lock: {'thoth': {'allow_prereleases': {'tensorflow': True, 'flask': False}}}
_ TestSelctiveCutPreReleasesSieve.test_pre_releases_disallowed_removal[flask-1.0dev0] _

self = <tests.sieves.test_experimental_prereleases.TestSelctiveCutPreReleasesSieve object at 0x7fbc82abe430>
package_name = 'flask', package_version = '1.0dev0'

    @pytest.mark.parametrize(
        "package_name,package_version",
        [
            ("flask", "1.0dev0"),  # Disabled explicitly.
            ("numpy", "1.0dev0"),  # Disabled implicitly.
        ],
    )
    def test_pre_releases_disallowed_removal(self, package_name: str, package_version: str) -> None:
        """Test no removals if pre-releases are allowed."""
        pv = PackageVersion(
            name=package_name,
            version=f"=={package_version}",
            index=Source("https://pypi.org/simple"),
            develop=False,
        )
    
        project = Project.from_strings(self._CASE_GLOBAL_DISALLOWED_PIPFILE)
        context = flexmock(project=project)
        sieve = self.UNIT_TESTED()
>       sieve.update_configuration({"package_name": None, "allow_prereleases": project.pipfile.thoth.allow_prereleases})
E       AttributeError: 'Pipfile' object has no attribute 'thoth'

context    = <flexmock.MockClass object at 0x7fbc82abe7f0>
package_name = 'flask'
package_version = '1.0dev0'
project    = Project(pipfile=Pipfile(packages=Packages(develop=False, packages={'tensorflow': PackageVersion(name='tensorflow', version='*', develop=False, index=None, hashes=[], markers=None, extras=[], _semantic_version=None, _locked_version=None, _package_tuple=None, _package_tuple_locked=None)}), dev_packages=Packages(develop=True, packages={}), meta=PipfileMeta(sources={'pypi': Source(url='https://pypi.org/simple', name='pypi', verify_ssl=True, warehouse=True, warehouse_api_url=None)}, requires={}, pipenv={'allow_prereleases': False}, hash=None, pipfile_spec=None)), pipfile_lock=None, runtime_environment=RuntimeEnvironment(hardware=HardwareInformation(cpu_family=None, cpu_model=None, gpu_model=None), operating_system=OperatingSystem(name=None, version=None), python_version=None, cuda_version=None, openblas_version=None, openmpi_version=None, cudnn_version=None, mkl_version=None, base_image=None, name=None, platform=None, _python_version_tuple=None), _graph_db=None, _workdir=None)
pv         = PackageVersion(name='flask', version='==1.0dev0', develop=False, index=Source(url='https://pypi.org/simple', name='pypi-org-simple', verify_ssl=True, warehouse=True, warehouse_api_url=None), hashes=[], markers=None, extras=[], _semantic_version=None, _locked_version=None, _package_tuple=None, _package_tuple_locked=None)
self       = <tests.sieves.test_experimental_prereleases.TestSelctiveCutPreReleasesSieve object at 0x7fbc82abe430>
sieve      = SelectiveCutPreReleasesSieve(_configuration={'package_name': None, 'allow_prereleases': None}, _name=None, unit_run=False)

tests/sieves/test_experimental_prereleases.py:188: AttributeError
------------------------------ Captured log call -------------------------------
WARNING  thoth.python.pipfile:pipfile.py:76 Metadata ignored in Pipfile or Pipfile.lock: {'thoth': {'allow_prereleases': {'tensorflow': True, 'flask': False}}}
_ TestSelctiveCutPreReleasesSieve.test_pre_releases_disallowed_removal[numpy-1.0dev0] _

self = <tests.sieves.test_experimental_prereleases.TestSelctiveCutPreReleasesSieve object at 0x7fbca2aae880>
package_name = 'numpy', package_version = '1.0dev0'

    @pytest.mark.parametrize(
        "package_name,package_version",
        [
            ("flask", "1.0dev0"),  # Disabled explicitly.
            ("numpy", "1.0dev0"),  # Disabled implicitly.
        ],
    )
    def test_pre_releases_disallowed_removal(self, package_name: str, package_version: str) -> None:
        """Test no removals if pre-releases are allowed."""
        pv = PackageVersion(
            name=package_name,
            version=f"=={package_version}",
            index=Source("https://pypi.org/simple"),
            develop=False,
        )
    
        project = Project.from_strings(self._CASE_GLOBAL_DISALLOWED_PIPFILE)
        context = flexmock(project=project)
        sieve = self.UNIT_TESTED()
>       sieve.update_configuration({"package_name": None, "allow_prereleases": project.pipfile.thoth.allow_prereleases})
E       AttributeError: 'Pipfile' object has no attribute 'thoth'

context    = <flexmock.MockClass object at 0x7fbca2aae5b0>
package_name = 'numpy'
package_version = '1.0dev0'
project    = Project(pipfile=Pipfile(packages=Packages(develop=False, packages={'tensorflow': PackageVersion(name='tensorflow', version='*', develop=False, index=None, hashes=[], markers=None, extras=[], _semantic_version=None, _locked_version=None, _package_tuple=None, _package_tuple_locked=None)}), dev_packages=Packages(develop=True, packages={}), meta=PipfileMeta(sources={'pypi': Source(url='https://pypi.org/simple', name='pypi', verify_ssl=True, warehouse=True, warehouse_api_url=None)}, requires={}, pipenv={'allow_prereleases': False}, hash=None, pipfile_spec=None)), pipfile_lock=None, runtime_environment=RuntimeEnvironment(hardware=HardwareInformation(cpu_family=None, cpu_model=None, gpu_model=None), operating_system=OperatingSystem(name=None, version=None), python_version=None, cuda_version=None, openblas_version=None, openmpi_version=None, cudnn_version=None, mkl_version=None, base_image=None, name=None, platform=None, _python_version_tuple=None), _graph_db=None, _workdir=None)
pv         = PackageVersion(name='numpy', version='==1.0dev0', develop=False, index=Source(url='https://pypi.org/simple', name='pypi-org-simple', verify_ssl=True, warehouse=True, warehouse_api_url=None), hashes=[], markers=None, extras=[], _semantic_version=None, _locked_version=None, _package_tuple=None, _package_tuple_locked=None)
self       = <tests.sieves.test_experimental_prereleases.TestSelctiveCutPreReleasesSieve object at 0x7fbca2aae880>
sieve      = SelectiveCutPreReleasesSieve(_configuration={'package_name': None, 'allow_prereleases': None}, _name=None, unit_run=False)

tests/sieves/test_experimental_prereleases.py:188: AttributeError
------------------------------ Captured log call -------------------------------
WARNING  thoth.python.pipfile:pipfile.py:76 Metadata ignored in Pipfile or Pipfile.lock: {'thoth': {'allow_prereleases': {'tensorflow': True, 'flask': False}}}
=============================== warnings summary ===============================
tests/test_context.py: 167 warnings
tests/test_pipeline_builder.py: 20 warnings
tests/test_product.py: 74 warnings
tests/test_resolver.py: 2196 warnings
tests/test_solver.py: 18 warnings
tests/boots/test_fully_specified_environment.py: 100 warnings
tests/boots/test_gpu.py: 120 warnings
tests/boots/test_pipfile_hash.py: 127 warnings
tests/boots/test_platform.py: 100 warnings
tests/boots/test_python_version.py: 23 warnings
tests/boots/test_rhel_version.py: 23 warnings
tests/boots/test_solved_software_environment.py: 120 warnings
tests/boots/test_ubi.py: 42 warnings
tests/predictors/test_mcts.py: 100 warnings
tests/predictors/test_td.py: 80 warnings
tests/pseudonyms/test_intel_tensorflow.py: 263 warnings
tests/pseudonyms/test_tensorflow_gpu.py: 263 warnings
tests/pseudonyms/_debug/test_alias.py: 229 warnings
tests/sieves/test_experimental_prereleases.py: 364 warnings
tests/sieves/test_filter_index.py: 23 warnings
tests/sieves/test_index_enabled.py: 23 warnings
tests/sieves/test_locked.py: 38 warnings
tests/sieves/test_prereleases.py: 255 warnings
tests/sieves/test_solved.py: 46 warnings
tests/sieves/test_thoth_s2i_abi_compat.py: 162 warnings
tests/sieves/test_version_constraint.py: 22 warnings
tests/sieves/backports/test_enum34.py: 281 warnings
tests/sieves/backports/test_functools32.py: 281 warnings
tests/sieves/backports/test_importlib_metadata.py: 261 warnings
tests/sieves/backports/test_importlib_resources.py: 261 warnings
tests/sieves/backports/test_mock.py: 261 warnings
tests/sieves/pandas/test_py36_drop.py: 245 warnings
tests/sieves/setuptools/test_py36.py: 204 warnings
tests/sieves/tensorflow/test_tf_240_avx2.py: 182 warnings
tests/sieves/tensorflow/test_tf_api.py: 270 warnings
tests/sieves/tensorflow/test_tf_cuda.py: 2557 warnings
tests/sieves/tensorflow/test_tf_py39.py: 538 warnings
tests/steps/test_aicoe.py: 42 warnings
tests/steps/test_cve.py: 43 warnings
tests/steps/test_dropout.py: 20 warnings
tests/steps/test_security_indicators.py: 144 warnings
tests/steps/tensorflow/test_tf_113_numpy.py: 421 warnings
tests/steps/tensorflow/test_tf_114_gast.py: 1018 warnings
tests/steps/tensorflow/test_tf_21_h5py.py: 436 warnings
tests/steps/tensorflow/test_tf_21_urllib3.py: 176 warnings
tests/steps/tensorflow/test_tf_22_numpy.py: 688 warnings
tests/steps/tensorflow/test_tf_22_prob.py: 185 warnings
tests/steps/tensorflow/test_tf_avx2.py: 142 warnings
tests/steps/tensorflow/test_tf_rm_scipy.py: 908 warnings
tests/strides/test_one_version.py: 40 warnings
tests/strides/test_random_decision.py: 20 warnings
tests/strides/test_unique_stack.py: 160 warnings
tests/wraps/test_no_observation.py: 20 warnings
tests/wraps/test_thoth_s2i.py: 120 warnings
tests/wraps/test_thoth_s2i_info.py: 120 warnings
tests/wraps/python/test_no_semantic_interposition.py: 180 warnings
tests/wraps/tensorflow/test_intel.py: 220 warnings
tests/wraps/tensorflow/test_mkl_threads.py: 40 warnings
tests/wraps/tensorflow/test_tf_23_accuracy.py: 20 warnings
tests/wraps/tensorflow/test_tf_23_dict_bug.py: 20 warnings
tests/wraps/tensorflow/test_tf_38518.py: 101 warnings
tests/wraps/tensorflow/test_tf_42475.py: 141 warnings
tests/wraps/tensorflow/test_tf_intel.py: 220 warnings
tests/wraps/tensorflow/test_tf_mkl_threads.py: 40 warnings
  /opt/app-root/lib64/python3.8/site-packages/packaging/version.py:127: DeprecationWarning: Creating a LegacyVersion has been deprecated and will be removed in the next major release
    warnings.warn(

-- Docs: https://docs.pytest.org/en/stable/warnings.html

----------- coverage: platform linux, python 3.8.3-final-0 -----------
Name                                                      Stmts   Miss  Cover
-----------------------------------------------------------------------------
thoth/adviser/__init__.py                                    26      0   100%
thoth/adviser/beam.py                                       114     39    66%
thoth/adviser/boot.py                                         8      0   100%
thoth/adviser/boots/__init__.py                              10      0   100%
thoth/adviser/boots/_debug/__init__.py                        3      3     0%
thoth/adviser/boots/_debug/memtrace.py                       49     49     0%
thoth/adviser/boots/fully_specified_environment.py           24      1    96%
thoth/adviser/boots/gpu.py                                   33      2    94%
thoth/adviser/boots/pipfile_hash.py                          29      1    97%
thoth/adviser/boots/platform.py                              34      1    97%
thoth/adviser/boots/python_version.py                        41      2    95%
thoth/adviser/boots/rhel_version.py                          27      1    96%
thoth/adviser/boots/solved_software_environment.py           35      1    97%
thoth/adviser/boots/ubi.py                                   26      1    96%
thoth/adviser/cli.py                                        241    241     0%
thoth/adviser/context.py                                    109      0   100%
thoth/adviser/dependency_monkey.py                           90     11    88%
thoth/adviser/digests_fetcher.py                             23     23     0%
thoth/adviser/dm_report.py                                   17      0   100%
thoth/adviser/enums.py                                       24      4    83%
thoth/adviser/exceptions.py                                  45      3    93%
thoth/adviser/pipeline_builder.py                           277     10    96%
thoth/adviser/pipeline_config.py                             94      6    94%
thoth/adviser/predictor.py                                   50      7    86%
thoth/adviser/predictors/__init__.py                         10      0   100%
thoth/adviser/predictors/annealing.py                       100     47    53%
thoth/adviser/predictors/hill_climbing.py                    51     29    43%
thoth/adviser/predictors/latest.py                           73     25    66%
thoth/adviser/predictors/mcts.py                             44      5    89%
thoth/adviser/predictors/package_combinations.py             22      7    68%
thoth/adviser/predictors/random_walk.py                      58     32    45%
thoth/adviser/predictors/sampling.py                         51     29    43%
thoth/adviser/predictors/td.py                              103     18    83%
thoth/adviser/product.py                                     61      4    93%
thoth/adviser/pseudonym.py                                   14      0   100%
thoth/adviser/pseudonyms/__init__.py                          5      0   100%
thoth/adviser/pseudonyms/_debug/__init__.py                   3      0   100%
thoth/adviser/pseudonyms/_debug/alias.py                     32      1    97%
thoth/adviser/pseudonyms/intel_tensorflow.py                 47      2    96%
thoth/adviser/pseudonyms/tensorflow_gpu.py                   41      2    95%
thoth/adviser/report.py                                      45      1    98%
thoth/adviser/resolver.py                                   677     93    86%
thoth/adviser/run.py                                         91     91     0%
thoth/adviser/sieve.py                                       10      0   100%
thoth/adviser/sieves/__init__.py                             21      0   100%
thoth/adviser/sieves/backports/__init__.py                    7      0   100%
thoth/adviser/sieves/backports/enum34.py                     36      1    97%
thoth/adviser/sieves/backports/functools32.py                36      1    97%
thoth/adviser/sieves/backports/importlib_metadata.py         36      1    97%
thoth/adviser/sieves/backports/importlib_resources.py        36      1    97%
thoth/adviser/sieves/backports/mock.py                       36      1    97%
thoth/adviser/sieves/experimental_prereleases.py             36      9    75%
thoth/adviser/sieves/filter_index.py                         30      3    90%
thoth/adviser/sieves/index_enabled.py                        39      2    95%
thoth/adviser/sieves/locked.py                               33      2    94%
thoth/adviser/sieves/pandas/__init__.py                       3      0   100%
thoth/adviser/sieves/pandas/py36_drop.py                     41      1    98%
thoth/adviser/sieves/prereleases.py                          30      1    97%
thoth/adviser/sieves/setuptools/__init__.py                   3      0   100%
thoth/adviser/sieves/setuptools/py36.py                      37      1    97%
thoth/adviser/sieves/solved.py                               50      1    98%
thoth/adviser/sieves/tensorflow/__init__.py                   6      0   100%
thoth/adviser/sieves/tensorflow/tf_240_avx2.py               38      2    95%
thoth/adviser/sieves/tensorflow/tf_api.py                    76      1    99%
thoth/adviser/sieves/tensorflow/tf_cuda.py                  116      2    98%
thoth/adviser/sieves/tensorflow/tf_py39.py                   51      2    96%
thoth/adviser/sieves/thoth_s2i_abi_compat.py                 60      4    93%
thoth/adviser/sieves/version_constraint.py                   35      3    91%
thoth/adviser/solver.py                                      74      1    99%
thoth/adviser/state.py                                      124     24    81%
thoth/adviser/step.py                                        22      0   100%
thoth/adviser/steps/__init__.py                              17      0   100%
thoth/adviser/steps/_debug/__init__.py                        5      0   100%
thoth/adviser/steps/_debug/generate_score.py                 53     21    60%
thoth/adviser/steps/_debug/mock_score.py                     48     17    65%
thoth/adviser/steps/_debug/set_score.py                      35      8    77%
thoth/adviser/steps/aicoe.py                                 35      3    91%
thoth/adviser/steps/cve.py                                   63      6    90%
thoth/adviser/steps/dropout.py                               28      2    93%
thoth/adviser/steps/security_indicators.py                   65      2    97%
thoth/adviser/steps/tensorflow/__init__.py                   10      0   100%
thoth/adviser/steps/tensorflow/tf_113_numpy.py               45      2    96%
thoth/adviser/steps/tensorflow/tf_114_gast.py                48      2    96%
thoth/adviser/steps/tensorflow/tf_21_h5py.py                 48      3    94%
thoth/adviser/steps/tensorflow/tf_21_urllib3.py              46      2    96%
thoth/adviser/steps/tensorflow/tf_22_numpy.py                48      4    92%
thoth/adviser/steps/tensorflow/tf_22_prob.py                 43      1    98%
thoth/adviser/steps/tensorflow/tf_avx2.py                    38      2    95%
thoth/adviser/steps/tensorflow/tf_rm_scipy.py                56      3    95%
thoth/adviser/stride.py                                       9      0   100%
thoth/adviser/strides/__init__.py                             5      0   100%
thoth/adviser/strides/one_version.py                         37      2    95%
thoth/adviser/strides/random_decision.py                     22      2    91%
thoth/adviser/strides/unique_stack.py                        29      2    93%
thoth/adviser/unit.py                                       104     14    87%
thoth/adviser/utils.py                                       16      2    88%
thoth/adviser/wrap.py                                         9      0   100%
thoth/adviser/wraps/__init__.py                              12      0   100%
thoth/adviser/wraps/no_onservation.py                        18      1    94%
thoth/adviser/wraps/python/__init__.py                        3      0   100%
thoth/adviser/wraps/python/no_semantic_interposition.py      23      1    96%
thoth/adviser/wraps/pytorch/__init__.py                       3      3     0%
thoth/adviser/wraps/tensorflow/__init__.py                    8      0   100%
thoth/adviser/wraps/tensorflow/tf_23_accuracy.py             35      4    89%
thoth/adviser/wraps/tensorflow/tf_23_dict_bug.py             35      4    89%
thoth/adviser/wraps/tensorflow/tf_38518.py                   33      2    94%
thoth/adviser/wraps/tensorflow/tf_42475.py                   39      2    95%
thoth/adviser/wraps/tensorflow/tf_intel.py                   28      1    96%
thoth/adviser/wraps/tensorflow/tf_mkl_threads.py             32      2    94%
thoth/adviser/wraps/thoth_s2i.py                             21      2    90%
thoth/adviser/wraps/thoth_s2i_info.py                        27      1    96%
-----------------------------------------------------------------------------
TOTAL                                                      5358    979    82%

===================================== mypy =====================================
Success: no issues found in 108 source files
============================ Hypothesis Statistics =============================
tests/test_beam.py::TestBeam::test_initialization_positive:

  - during generate phase (0.13 seconds):
    - Typical runtimes: < 1ms, ~ 42% in data generation
    - 100 passing examples, 0 failing examples, 0 invalid examples

  - Stopped because settings.max_examples=100


tests/test_beam.py::TestBeam::test_initialization_not_positive_error:

  - during generate phase (0.12 seconds):
    - Typical runtimes: < 1ms, ~ 40% in data generation
    - 100 passing examples, 0 failing examples, 0 invalid examples

  - Stopped because settings.max_examples=100


tests/predictors/test_annealing.py::TestAdaptiveSimulatedAnnealing::test_temperature_function:

  - during generate phase (0.27 seconds):
    - Typical runtimes: ~ 1ms, ~ 65% in data generation
    - 100 passing examples, 0 failing examples, 0 invalid examples

  - Stopped because settings.max_examples=100


tests/predictors/test_annealing.py::TestAdaptiveSimulatedAnnealing::test_acceptance_probability:

  - during generate phase (0.38 seconds):
    - Typical runtimes: 0-1 ms, ~ 68% in data generation
    - 100 passing examples, 0 failing examples, 68 invalid examples

  - Stopped because settings.max_examples=100


tests/predictors/test_annealing.py::TestAdaptiveSimulatedAnnealing::test_run:

  - during generate phase (3.95 seconds):
    - Typical runtimes: 1-91 ms, ~ 9% in data generation
    - 100 passing examples, 0 failing examples, 0 invalid examples

  - Stopped because settings.max_examples=100


tests/predictors/test_hill_climbing.py::TestHillClimbing::test_run:

  - during generate phase (4.74 seconds):
    - Typical runtimes: 8-80 ms, ~ 1% in data generation
    - 100 passing examples, 0 failing examples, 0 invalid examples

  - Stopped because settings.max_examples=100


tests/predictors/test_latest.py::TestApproximatingLatest::test_run:

  - during generate phase (4.40 seconds):
    - Typical runtimes: 3-88 ms, ~ 2% in data generation
    - 100 passing examples, 0 failing examples, 0 invalid examples

  - Stopped because settings.max_examples=100


tests/predictors/test_random_walk.py::TestRandomWalk::test_run:

  - during generate phase (4.85 seconds):
    - Typical runtimes: 10-96 ms, ~ 1% in data generation
    - 100 passing examples, 0 failing examples, 0 invalid examples

  - Stopped because settings.max_examples=100


tests/predictors/test_sampling.py::TestSampling::test_run:

  - during generate phase (4.18 seconds):
    - Typical runtimes: 6-75 ms, ~ 1% in data generation
    - 100 passing examples, 0 failing examples, 0 invalid examples

  - Stopped because settings.max_examples=100


tests/predictors/test_td.py::TestTemporalDifference::test_acceptance_probability:

  - during generate phase (0.29 seconds):
    - Typical runtimes: 0-1 ms, ~ 68% in data generation
    - 100 passing examples, 0 failing examples, 37 invalid examples

  - Stopped because settings.max_examples=100


tests/predictors/test_td.py::TestTemporalDifference::test_temperature_function:

  - during generate phase (0.26 seconds):
    - Typical runtimes: ~ 1ms, ~ 66% in data generation
    - 100 passing examples, 0 failing examples, 0 invalid examples

  - Stopped because settings.max_examples=100


=========================== short test summary info ============================
FAILED tests/sieves/test_experimental_prereleases.py::TestSelctiveCutPreReleasesSieve::test_include[RecommendationType.STABLE]
FAILED tests/sieves/test_experimental_prereleases.py::TestSelctiveCutPreReleasesSieve::test_include[RecommendationType.PERFORMANCE]
FAILED tests/sieves/test_experimental_prereleases.py::TestSelctiveCutPreReleasesSieve::test_include[RecommendationType.SECURITY]
FAILED tests/sieves/test_experimental_prereleases.py::TestSelctiveCutPreReleasesSieve::test_include[RecommendationType.LATEST]
FAILED tests/sieves/test_experimental_prereleases.py::TestSelctiveCutPreReleasesSieve::test_include[RecommendationType.TESTING]
FAILED tests/sieves/test_experimental_prereleases.py::TestSelctiveCutPreReleasesSieve::test_verify_multiple_should_include
FAILED tests/sieves/test_experimental_prereleases.py::TestSelctiveCutPreReleasesSieve::test_remove_pre_releases_disallowed_noop[tensorflow-2.4.0rc1]
FAILED tests/sieves/test_experimental_prereleases.py::TestSelctiveCutPreReleasesSieve::test_remove_pre_releases_disallowed_noop[flask-1.0]
FAILED tests/sieves/test_experimental_prereleases.py::TestSelctiveCutPreReleasesSieve::test_pre_releases_disallowed_removal[flask-1.0dev0]
FAILED tests/sieves/test_experimental_prereleases.py::TestSelctiveCutPreReleasesSieve::test_pre_releases_disallowed_removal[numpy-1.0dev0]
======== 10 failed, 1210 passed, 101 skipped, 16024 warnings in 47.19s =========

[fridex]

/unhold

Docs in #1650, thoth-python update already landed.

[KPostOffice]

/approve

[sesheta]

[APPROVALNOTIFIER] This PR is APPROVED

This pull-request has been approved by: KPostOffice

The full list of commands accepted by this bot can be found here.

The pull request process is described here

Needs approval from an approver in each of these files:

• OWNERS [KPostOffice]

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment