Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Reduce the amount of time we spend running gh workflows #10691

Merged
merged 4 commits into from
Mar 26, 2024

Conversation

richard-cox
Copy link
Member

@richard-cox richard-cox commented Mar 25, 2024

Summary

Reduce the amount of time we spend running gh workflows

Occurred changes and/or fixed issues

  • We have a matrix job that splits out e2e tests into multiple jobs
  • Previously each job had a step to build the UI.
  • Now there's a dependent job that builds the ui and shares it to the matrix job
  • If all e2e tests pass first time this adds a smidge of time on to the total (see further optimisations) BUT it reduces the amount of time we consume workers by about 15 x 5 minutes
  • If not all e2e tests pass first time it reduces the churn of re-runs by 5 minutes AND the amount of time we consume workers by failed test x 5 minutes
  • Further optimisations
    • Total time could be reduced by only installing cypress deps when running matrix step. this at the moment contains all deps to build the ui ... which now doesn't happen there
    • We could also look at pulling & sharing the rancher image in a pre-job, though i'm not sure if this would help that much (1 x image pull from docker vs 1 x image pull from gh)
    • The retention for the build artefacts has been set to 10 days. We can lower this to something like a day. If the artefact is removed the e2e workflow just needs to be re-run again, or just the build step

Technical notes summary

  • This is not meant to replace the need for more runners, only to assist until we do

Areas which could experience regressions

  • Running code from rancher image and not from build (though tested and this doesn't happen)

Screenshots

Before

image

After

image

Checklist

  • The PR is linked to an issue and the linked issue has a Milestone, or no issue is needed
  • The PR has a Milestone
  • The PR template has been filled out
  • The PR has been self reviewed
  • The PR has a reviewer assigned
  • The PR has automated tests or clear instructions for manual tests and the linked issue has appropriate QA labels, or tests are not needed
  • The PR has reviewed with UX and tested in light and dark mode, or there are no UX changes

@richard-cox richard-cox changed the title Move e2e build out from each e2e step to a single pre e2e job Reduce the amount of time we spend running gh workflows Mar 25, 2024
@richard-cox richard-cox added this to the v2.9.0 milestone Mar 25, 2024
@richard-cox richard-cox marked this pull request as ready for review March 25, 2024 12:40
@richard-cox richard-cox requested a review from nwmac March 25, 2024 12:41
…hing crd chart

- pin it for the moment to 03.0.2%2Bup45.31.1
Copy link
Member

@nwmac nwmac left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants