Code

Feature 685 group pytests#1692

Code

Merged

georgemccabe merged 36 commits intodevelopdtcenter/METplus:developfrom feature_685_group_pytestsdtcenter/METplus:feature_685_group_pytestsCopy head branch name to clipboardJul 14, 2022

+1,075-1,314

Commits

Commits on Jul 7, 2022

• per #685, added custom pytest markers for many tests so we can run groups of tests in automation to speed things up. removed unused imports from tests and removed parenthesis from assert statements…

  Show description for 4e2c4bc
  georgemccabe

  committed
  4e2c4bc

  Copy full SHA for 4e2c4bc

• per #685, change logic to check if test category is not equal to 'pytest' to does not start with 'pytest' to allow groups of pytests

  georgemccabe

  committed
  46104ba

  Copy full SHA for 46104ba

• per #685, run pytests with markers to subset tests into groups

  georgemccabe

  committed
  b509fee

  Copy full SHA for b509fee

• fixed check if string starts with pytests

  georgemccabe

  committed
  57c8dde

  Copy full SHA for 57c8dde

• added missing pytest marker name

  georgemccabe

  committed
  811b256

  Copy full SHA for 811b256

• added logic to support running all pytests that do not match a given marker with the 'not <marker>' syntax

  georgemccabe

  committed
  c487568

  Copy full SHA for c487568

• change pytest group to wrapper because the test expects another test to have run prior to running

  georgemccabe

  committed
  f5b31da

  Copy full SHA for f5b31da

• fix 'not' logic by adding quotation marks around value

  georgemccabe

  committed
  95ef58e

  Copy full SHA for 95ef58e

• another approach to fixing not functionality for tests

  georgemccabe

  committed
  3bdab1e

  Copy full SHA for 3bdab1e

• added util marker to more tests

  georgemccabe

  committed
  b66448e

  Copy full SHA for b66448e

• fixed typo in not logic

  georgemccabe

  committed
  6afeaec

  Copy full SHA for 6afeaec

• added util marker to more tests again

  georgemccabe

  committed
  aed62bd

  Copy full SHA for aed62bd

• fixed logic to split string

  georgemccabe

  committed
  c6607c3

  Copy full SHA for c6607c3

• marked rest of util tests with util marker

  georgemccabe

  committed
  831037a

  Copy full SHA for 831037a

• fixed another typo in string splitting logic

  georgemccabe

  committed
  71eb108

  Copy full SHA for 71eb108

• tested change that should properly split strings

  georgemccabe

  committed
  166a0a2

  Copy full SHA for 166a0a2

• moved wrapper tests into wrapper directory

  georgemccabe

  committed
  b01dec1

  Copy full SHA for b01dec1

• changed marker for plotting tests

  georgemccabe

  committed
  0df52e6

  Copy full SHA for 0df52e6

• added plotting marker

  georgemccabe

  committed
  552d2ec

  Copy full SHA for 552d2ec

• improved logic for removing underscore after 'not' and around 'or' to specify more complex marker strings

  georgemccabe

  committed
  5e96988

  Copy full SHA for 5e96988

• test running group of 3 markers

  georgemccabe

  committed
  4bf56ae

  Copy full SHA for 4bf56ae

• fixed path the broke when test file was moved into a lower directory

  georgemccabe

  committed
  d8169db

  Copy full SHA for d8169db

• Changed StatAnalysis tests to use plotting marker because some of the tests involve plotting but the other StatAnalysis tests produce output that are used in the plotting tests

  georgemccabe

  committed
  a252858

  Copy full SHA for a252858

• changed some tests from marker 'wrapper' to 'wrapper_a' to split up some of these tests into separate runs

  georgemccabe

  committed
  d9c391a

  Copy full SHA for d9c391a

• merged develop and resolved conflicts

  georgemccabe

  committed
  6e71a21

  Copy full SHA for 6e71a21

• test to see if running pytests in single job but split into groups by marker will improve the timing enough

  georgemccabe

  committed
  1f1d0b0

  Copy full SHA for 1f1d0b0

• fixed typos in new logic

  georgemccabe

  committed
  dc82111

  Copy full SHA for dc82111

• removed code that is no longer needed (added comment in issue #685 if this logic is desired in the future)

  georgemccabe

  committed
  69b0cce

  Copy full SHA for 69b0cce

• per #685, divided pytests into smaller groups

  georgemccabe

  committed
  050c1a2

  Copy full SHA for 050c1a2

• added a test that will fail to test that the entire pytest job will fail as expected

  georgemccabe

  committed
  038d049

  Copy full SHA for 038d049

• add error message if any pytests failed to help reviewer search for failed tests

  georgemccabe

  committed
  23fe0ee

  Copy full SHA for 23fe0ee

• removed failing test after confirming that entire pytest job properly reports an error if any test fails

  georgemccabe

  committed
  e7860cd

  Copy full SHA for e7860cd

• turn on single use case group to make sure logic to build matrix of test jobs to run still works as expected

  georgemccabe

  committed
  3cf5b91

  Copy full SHA for 3cf5b91

• turn off use case after confirming tests were created properly

  georgemccabe

  committed
  962cd22

  Copy full SHA for 962cd22

• added documentation to contributor's guide to describe changes to unit test logic

  georgemccabe

  committed
  0a4ed3f

  Copy full SHA for 0a4ed3f

• added note about adding new pytest markers

  georgemccabe

  committed
  d1a3b55

  Copy full SHA for d1a3b55