-
Notifications
You must be signed in to change notification settings - Fork 318
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
[ci-visibility] Change test.type
in browser tests
#3358
Conversation
Overall package sizeSelf size: 4.79 MB Dependency sizes
🤖 This report was automatically generated by heaviest-objects-in-the-universe |
Codecov Report
@@ Coverage Diff @@
## master #3358 +/- ##
==========================================
- Coverage 84.18% 84.15% -0.04%
==========================================
Files 205 205
Lines 8061 8064 +3
Branches 33 33
==========================================
Hits 6786 6786
- Misses 1275 1278 +3
... and 1 file with indirect coverage changes 📣 We’re building smart automated test selection to slash your CI/CD build times. Learn more |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
good job! Most of the comments are just for moving certain things around, but the logic is good
Co-authored-by: Juan Antonio Fernández de Alba <[email protected]>
BenchmarksBenchmark execution time: 2023-07-07 14:48:31 Comparing candidate commit d3f4b18 in PR branch Found 0 performance improvements and 0 performance regressions! Performance is the same for 464 metrics, 28 unstable metrics. |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
we're almost there :-)
additionally, cypress tests are failing because we need to update this https://github.com/DataDog/dd-trace-js/blob/master/packages/datadog-plugin-cypress/test/index.spec.js#L81 and this https://github.com/DataDog/dd-trace-js/blob/master/packages/datadog-plugin-cypress/test/index.spec.js#L106
we could also optionally expand this test integration-tests/playwright/playwright.spec.js
to include TEST_TYPE
assertion, but that's up to you 😄
Co-authored-by: Juan Antonio Fernández de Alba <[email protected]>
test.type
in browser tests
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
I just noticed that we're missing a TEST_TYPE
update in https://github.com/DataDog/dd-trace-js/blob/master/packages/dd-trace/src/plugins/util/test.js#L277.
The tests are correctly set but session, modules and suites are still being reported with test.type='test'
that's why the integration test is failing: https://github.com/DataDog/dd-trace-js/actions/runs/5487302751/jobs/9998579728?pr=3358. Good thing we added that! 😄 |
* Add framework type checking * Improve code readability Co-authored-by: Juan Antonio Fernández de Alba <[email protected]> * Fix imports * Fix styling Co-authored-by: Juan Antonio Fernández de Alba <[email protected]> * Add cypress and playwright tests * Change browser conditions to detect all playwright instances * Fix include string * Fix some suites still being reported as test type --------- Co-authored-by: Juan Antonio Fernández de Alba <[email protected]>
* Add framework type checking * Improve code readability Co-authored-by: Juan Antonio Fernández de Alba <[email protected]> * Fix imports * Fix styling Co-authored-by: Juan Antonio Fernández de Alba <[email protected]> * Add cypress and playwright tests * Change browser conditions to detect all playwright instances * Fix include string * Fix some suites still being reported as test type --------- Co-authored-by: Juan Antonio Fernández de Alba <[email protected]>
* Add framework type checking * Improve code readability Co-authored-by: Juan Antonio Fernández de Alba <[email protected]> * Fix imports * Fix styling Co-authored-by: Juan Antonio Fernández de Alba <[email protected]> * Add cypress and playwright tests * Change browser conditions to detect all playwright instances * Fix include string * Fix some suites still being reported as test type --------- Co-authored-by: Juan Antonio Fernández de Alba <[email protected]>
* Add framework type checking * Improve code readability Co-authored-by: Juan Antonio Fernández de Alba <[email protected]> * Fix imports * Fix styling Co-authored-by: Juan Antonio Fernández de Alba <[email protected]> * Add cypress and playwright tests * Change browser conditions to detect all playwright instances * Fix include string * Fix some suites still being reported as test type --------- Co-authored-by: Juan Antonio Fernández de Alba <[email protected]>
* Add framework type checking * Improve code readability Co-authored-by: Juan Antonio Fernández de Alba <[email protected]> * Fix imports * Fix styling Co-authored-by: Juan Antonio Fernández de Alba <[email protected]> * Add cypress and playwright tests * Change browser conditions to detect all playwright instances * Fix include string * Fix some suites still being reported as test type --------- Co-authored-by: Juan Antonio Fernández de Alba <[email protected]>
* Add framework type checking * Improve code readability Co-authored-by: Juan Antonio Fernández de Alba <[email protected]> * Fix imports * Fix styling Co-authored-by: Juan Antonio Fernández de Alba <[email protected]> * Add cypress and playwright tests * Change browser conditions to detect all playwright instances * Fix include string * Fix some suites still being reported as test type --------- Co-authored-by: Juan Antonio Fernández de Alba <[email protected]>
* Add framework type checking * Improve code readability Co-authored-by: Juan Antonio Fernández de Alba <[email protected]> * Fix imports * Fix styling Co-authored-by: Juan Antonio Fernández de Alba <[email protected]> * Add cypress and playwright tests * Change browser conditions to detect all playwright instances * Fix include string * Fix some suites still being reported as test type --------- Co-authored-by: Juan Antonio Fernández de Alba <[email protected]>
* Add framework type checking * Improve code readability Co-authored-by: Juan Antonio Fernández de Alba <[email protected]> * Fix imports * Fix styling Co-authored-by: Juan Antonio Fernández de Alba <[email protected]> * Add cypress and playwright tests * Change browser conditions to detect all playwright instances * Fix include string * Fix some suites still being reported as test type --------- Co-authored-by: Juan Antonio Fernández de Alba <[email protected]>
* Add framework type checking * Improve code readability Co-authored-by: Juan Antonio Fernández de Alba <[email protected]> * Fix imports * Fix styling Co-authored-by: Juan Antonio Fernández de Alba <[email protected]> * Add cypress and playwright tests * Change browser conditions to detect all playwright instances * Fix include string * Fix some suites still being reported as test type --------- Co-authored-by: Juan Antonio Fernández de Alba <[email protected]>
What does this PR do?
Adds a new test type:
browser
which is only enabled when testing using Cypress or Playwright.Motivation
It adds more flexibility to test types
Plugin Checklist