Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[Fleet Synthetics] Upgrade to 0.10.1 #137667

Merged
merged 4 commits into from
Aug 2, 2022
Merged

[Fleet Synthetics] Upgrade to 0.10.1 #137667

merged 4 commits into from
Aug 2, 2022

Conversation

shahzad31
Copy link
Contributor

@shahzad31 shahzad31 commented Aug 1, 2022 •
edited by kibanamachine
Loading

Summary

Upgrading synthetics package to 0.10.0 for kibana v^8.4.0

Release Note - Breaking

The Elastic Synthetics Integration package 0.10.1 will segment ILM policies for the synthetics-* datastreams by dataset. These changes will automatically apply these ILM policy settings to all existing synthetics-* datastreams. This includes:

  • synthetics-browser.network-*
  • synthetics-browser.network-*
  • synthetics-browser.network-*
  • synthetics-http-*
  • synthetics-tcp-*
  • synthetics-icmp-*

This change will dramatically reduce the data retention period for the synthetics-browser.screenshot-* and synthetics-browser-network in particular. We've found that that data tends to be quite large in these datasets, with our customers desiring to store this costly data for a period.

The new ILM settings will be

Hot phase

HTTP TCP ICMP Browser core Browser screenshot Browser network
Max age 30 days 30 days 30 days 30 days 1 day 1 day
Max size 50gb 50gb 50gb 50gb

Delete phase

HTTP TCP ICMP Browser core Browser screenshot Browser network
Min age 365 days 365 days 365 days 365 days 14 days 14 days

TLDR

The important thing to note is that screenshots and network data for browser monitors run via Uptime Monitor Management, Elastic Synthetics Integration, and Heartbeat 8.4.0 will now be deleted after 14 days by default.

More information elastic/uptime#462

@shahzad31 shahzad31 requested a review from a team as a code owner August 1, 2022 09:09
@shahzad31 shahzad31 requested a review from a team August 1, 2022 09:09
@shahzad31 shahzad31 self-assigned this Aug 1, 2022
@shahzad31 shahzad31 added Team:Uptime - DEPRECATED Synthetics & RUM sub-team of Application Observability v8.4.0 v8.5.0 labels Aug 1, 2022
@elasticmachine
Copy link
Contributor

Pinging @elastic/uptime (Team:uptime)

@shahzad31 shahzad31 added the release_note:skip Skip the PR/issue when compiling release notes label Aug 1, 2022
@nchaulet
Copy link
Member

nchaulet commented Aug 1, 2022

@elasticmachine merge upstream

@kpollich
Copy link
Member

kpollich commented Aug 1, 2022

The docker image used in CI likely needs to be upgraded to include Synthetics 0.10.0. Tests are failing because the package doesn't exist in the dockerized registry.

@kpollich
Copy link
Member

kpollich commented Aug 1, 2022

See the instructions in the Fleet README to update the docker image used in tests https://github.com/elastic/kibana/tree/main/x-pack/plugins/fleet#bundled-packages

@botelastic botelastic bot added the Team:Fleet Team label for Observability Data Collection Fleet team label Aug 2, 2022
@elasticmachine
Copy link
Contributor

Pinging @elastic/fleet (Team:Fleet)

@shahzad31 shahzad31 changed the title [Fleet Synthetics] Upgrade to 0.10.0 [Fleet Synthetics] Upgrade to 0.10.1 Aug 2, 2022
@shahzad31 shahzad31 force-pushed the upgrade-sythetics-package-version branch from b324dd9 to e7084f1 Compare August 2, 2022 13:38
@kibana-ci
Copy link
Collaborator

💚 Build Succeeded

Metrics [docs]

✅ unchanged

History

To update your PR or re-run it, just comment with:
@elasticmachine merge upstream

cc @shahzad31

@dominiqueclarke dominiqueclarke added release_note:breaking and removed release_note:breaking release_note:skip Skip the PR/issue when compiling release notes labels Aug 2, 2022
dominiqueclarke
dominiqueclarke approved these changes Aug 2, 2022
View reviewed changes
Copy link
Contributor

@dominiqueclarke dominiqueclarke left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@dominiqueclarke dominiqueclarke merged commit e5aa1b4 into elastic:main Aug 2, 2022
@dominiqueclarke dominiqueclarke deleted the upgrade-sythetics-package-version branch August 2, 2022 22:01
@dominiqueclarke dominiqueclarke mentioned this pull request Aug 2, 2022
Closed
kibanamachine pushed a commit to kibanamachine/kibana that referenced this pull request Aug 2, 2022
@shahzad31
[Fleet Synthetics] Upgrade to 0.10.1 (elastic#137667)
8a28e1e 
* update to 0.10.1

* fix integeration test

* update policy test

(cherry picked from commit e5aa1b4)
@kibanamachine kibanamachine mentioned this pull request Aug 2, 2022
Merged
@kibanamachine
Copy link
Contributor

💚 All backports created successfully

Status Branch Result
✅ 8.4

Note: Successful backport PRs will be merged automatically after passing CI.

Questions ?

Please refer to the Backport tool documentation

@kibanamachine kibanamachine mentioned this pull request Aug 3, 2022
Merged
@kibanamachine kibanamachine added the backport missing Added to PRs automatically when the are determined to be missing a backport. label Aug 4, 2022
@kibanamachine
Copy link
Contributor

Looks like this PR has a backport PR but it still hasn't been merged. Please merge it ASAP to keep the branches relatively in sync.

1 similar comment
@kibanamachine
Copy link
Contributor

Looks like this PR has a backport PR but it still hasn't been merged. Please merge it ASAP to keep the branches relatively in sync.

@kibanamachine kibanamachine removed the backport missing Added to PRs automatically when the are determined to be missing a backport. label Aug 8, 2022
kibanamachine added a commit to kibanamachine/kibana that referenced this pull request Aug 8, 2022
@kibanamachine @shahzad31
@juliaElastic @dominiqueclarke
[8.4] [Fleet Synthetics] Upgrade to 0.10.1 (elastic#137667) (elastic#…
9a3d8e4 
…137922)

* [Fleet Synthetics] Upgrade to 0.10.1 (elastic#137667)

* update to 0.10.1

* fix integeration test

* update policy test

(cherry picked from commit e5aa1b4)

* Update config.ts

* Update x-pack/test/functional_synthetics/apps/uptime/synthetics_integration.ts

* Update x-pack/test/functional/config.base.js

* Update x-pack/test/functional/config.base.js

* Apply suggestions from code review

* [CI] Auto-commit changed files from 'node scripts/precommit_hook.js --ref HEAD~1..HEAD --fix'

Co-authored-by: Shahzad <[email protected]>
Co-authored-by: Julia Bardi <[email protected]>
Co-authored-by: Dominique Clarke <[email protected]>
@kpollich kpollich mentioned this pull request Aug 8, 2022
Closed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@nchaulet nchaulet nchaulet approved these changes

@dominiqueclarke dominiqueclarke dominiqueclarke approved these changes

Assignees

@shahzad31 shahzad31

Labels
release_note:breaking Team:Fleet Team label for Observability Data Collection Fleet team Team:Uptime - DEPRECATED Synthetics & RUM sub-team of Application Observability v8.4.0 v8.5.0
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
7 participants
@shahzad31 @elasticmachine @nchaulet @kpollich @kibana-ci @kibanamachine @dominiqueclarke