Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Smoke Test Pipeline Metrics should compare against last release sizes #4113

Open
5 tasks
michael-hawker opened this issue Jul 15, 2021 · 1 comment
Open
5 tasks
Labels
CI/pipeline 🔬 help wanted Issues identified as good community contribution opportunities improvements ✨ optimization ☄ Performance or memory usage improvements testing 🏗️
Milestone

Comments

@michael-hawker
Copy link
Member

@azchohfi Hmm, was just messing with the DownloadPipelineArtifact wondering if we published it as an Artifact if we could use the specific flag to somehow grab the latest pipeline artifact from the main branch? Not sure if we can get that specific with the project guid? runVersion latestFromBranch maybe? 🤔 That looks promising. I can try it out later once I get the base script running.

Ref: https://docs.microsoft.com/en-us/azure/devops/pipelines/tasks/utility/download-pipeline-artifact?view=azure-devops

Originally posted by @michael-hawker in #3600 (comment)

  • The current script should save it's results to a file for that pipeline in DevOps
  • Before the script runs the data for the last release branch (or main to start) should be fetched
  • The script needs to take that data file as a potential input
  • If it has input, it needs to also compare each project against the last size for that project
  • If there's a change above ~15kb(TBD?), a new dependency, or a new binary, it should post a comment to the PR with a message/details of change
@michael-hawker michael-hawker added CI/pipeline 🔬 help wanted Issues identified as good community contribution opportunities improvements ✨ optimization ☄ Performance or memory usage improvements testing 🏗️ labels Jul 15, 2021
@michael-hawker
Copy link
Member Author

We should also investigate the retention policy on the DevOps and figure out how to ensure we retain artifacts for our rel/* branches if we start comparing against those. For a first pass of this comparing against main is acceptable as we'll be auditing it moving forward.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
CI/pipeline 🔬 help wanted Issues identified as good community contribution opportunities improvements ✨ optimization ☄ Performance or memory usage improvements testing 🏗️
Projects
None yet
Development

No branches or pull requests

1 participant