-
Notifications
You must be signed in to change notification settings - Fork 8.3k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
run page_load_metrics tests in visual regresssion jobs #68570
run page_load_metrics tests in visual regresssion jobs #68570
Conversation
86534cf
to
9772a6f
Compare
@@ -11,8 +11,7 @@ mkdir -p "$installDir" | |||
tar -xzf "$linuxBuild" -C "$installDir" --strip=1 | |||
|
|||
echo " -> running visual regression tests from kibana directory" | |||
checks-reporter-with-killswitch "X-Pack visual regression tests" \ |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
When this job is actually run in a PR it fails because of the -- --
, there's apparently too many or not enough escapes or something to pass through the --
just to the percy exec
call, which requires it... Since the visual regression stuff isn't currently run in PRs I just removed the checks reporter here.
Successful build with |
This reverts commit 9772a6f.
Pinging @elastic/kibana-operations (Team:Operations) |
💚 Build SucceededTo update your PR or re-run it, just comment with: |
Co-authored-by: spalger <[email protected]>
Co-authored-by: spalger <[email protected]>
…#68676) Co-authored-by: spalger <[email protected]> Co-authored-by: spalger <[email protected]>
…#68675) Co-authored-by: spalger <[email protected]>
* master: (22 commits) Partial revert of "Sync Kerberos + Anonymous access tests with the latest `security/_authenticate` API (user roles now include roles of anonymous user)." (elastic#68624) adapt some snapshot test (elastic#68489) [APM] Service maps - Fix missing ML status for services with jobs but no anomalies (elastic#68486) [skip test] apis Kerberos security Kerberos authentication finishing SPNEGO should properly set cookie and authenticate user [SIEM][Exceptions] - ExceptionsViewer UI component part 2 (elastic#68294) Surface data streams in Index Management. (elastic#67806) Fix edit datasource not working following changes in elastic#67234 (elastic#68583) [Logs + Metrics UI] Clean up async plugin initialization (elastic#67654) APM Storybook fixes (elastic#68671) Upgrade EUI to v24.1.0 (elastic#68141) [ML] DF Analytics: Creation wizard part 2 (elastic#68462) [Uptime] Fix race on overview page query (elastic#67843) Prefer using npm_execpath when spawning Yarn (elastic#68673) [Security] [Cases] Attach timeline to existing case (elastic#68580) Use Search API in Vega (elastic#68257) [Component templates] Table view (elastic#68031) [Uptime] Added relative date info in cert status column (elastic#67612) [Endpoint] Re-enable Functional test case for Endpoint related pages (elastic#68445) run page_load_metrics tests in visual regresssion jobs (elastic#68570) Enable exhaustive-deps; correct any lint warnings (elastic#68453) ...
In order to establish a baseline for every commit we must run the page_load_metrics "tests" on every commit to tracked branches. We do that by adding tasks to the visual baseline job, which has been repurposed a little bit to establish several different types of baseline (though we haven't renamed that job yet).