Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Failing test: X-Pack Cloud Security Posture Functional Tests.x-pack/test/cloud_security_posture_functional/pages/cis_integrations/cspm/cis_integration_aws·ts - Cloud Security Posture Test adding Cloud Security Posture Integrations CSPM AWS CIS_AWS Organization Cloud Formation Clicking on Launch CloudFormation on post intall modal should lead user to Cloud Formation page #186438

Closed
kibanamachine opened this issue Jun 19, 2024 · 24 comments · Fixed by #188616
Closed

Failing test: X-Pack Cloud Security Posture Functional Tests.x-pack/test/cloud_security_posture_functional/pages/cis_integrations/cspm/cis_integration_aws·ts - Cloud Security Posture Test adding Cloud Security Posture Integrations CSPM AWS CIS_AWS Organization Cloud Formation Clicking on Launch CloudFormation on post intall modal should lead user to Cloud Formation page #186438

kibanamachine opened this issue Jun 19, 2024 · 24 comments · Fixed by #188616
Assignees
@alexreal1314
Labels
failed-test A test failure on a tracked branch, potentially flaky-test Team:Cloud Security Cloud Security team related
Milestone
8.18

Comments

@kibanamachine
Copy link
Contributor

kibanamachine commented Jun 19, 2024 •
edited
Loading

A test failed on a tracked branch

Error: Out of existing tabs bounds
    at Proxy.switchTab (browser.ts:543:13)
    at processTicksAndRejections (node:internal/process/task_queues:95:5)
    at Object.clickLaunchAndGetCurrentUrl (add_cis_integration_form_page.ts:165:5)
    at Context.<anonymous> (cis_integration_aws.ts:78:13)
    at Object.apply (wrap_function.js:73:16)

First failure: kibana-on-merge - main
@kibanamachine kibanamachine added the failed-test A test failure on a tracked branch, potentially flaky-test label Jun 19, 2024
@botelastic botelastic bot added the needs-team Issues missing a team label label Jun 19, 2024
@kibanamachine kibanamachine added the Team:Cloud Security Cloud Security team related label Jun 19, 2024
@elasticmachine
Copy link
Contributor

Pinging @elastic/kibana-cloud-security-posture (Team:Cloud Security)

@botelastic botelastic bot removed the needs-team Issues missing a team label label Jun 19, 2024
@kibanamachine
Copy link
Contributor Author

New failure: kibana-on-merge - main

@kibanamachine
Copy link
Contributor Author

New failure: kibana-on-merge - main

@kibanamachine
Copy link
Contributor Author

New failure: kibana-on-merge - main

@kibanamachine
Copy link
Contributor Author

New failure: kibana-on-merge - main

@kibanamachine
Copy link
Contributor Author

New failure: kibana-on-merge - main

@kibanamachine
Copy link
Contributor Author

New failure: kibana-on-merge - main

@kibanamachine
Copy link
Contributor Author

New failure: kibana-on-merge - main

@kibanamachine
Copy link
Contributor Author

New failure: kibana-on-merge - main

@kibanamachine
Copy link
Contributor Author

New failure: kibana-on-merge - main

@kibanamachine
Copy link
Contributor Author

New failure: kibana-on-merge - main

mistic added a commit that referenced this issue Jun 19, 2024
@mistic
skip flaky suite (#186438)
ff19b29
@mistic
Copy link
Member

mistic commented Jun 19, 2024

Skipped.

main: ff19b29

@kibanamachine
Copy link
Contributor Author

New failure: kibana-on-merge - main

@animehart animehart self-assigned this Jul 15, 2024
@animehart animehart linked a pull request Jul 15, 2024 that will close this issue
[Cloud Security] Fix for Flaky FTR #188289
Merged
@kibanamachine kibanamachine reopened this Jul 17, 2024
@animehart animehart linked a pull request Jul 18, 2024 that will close this issue
[Cloud Security] AWS FTR Flaky fix #188616
Merged
@animehart animehart removed a link to a pull request Jul 18, 2024
[Cloud Security] Fix for Flaky FTR #188289
Merged
@kibanamachine kibanamachine reopened this Aug 22, 2024
@kibanamachine
Copy link
Contributor Author

New failure: kibana-on-merge - main

@kibanamachine
Copy link
Contributor Author

New failure: kibana-on-merge - 8.x

@kibanamachine
Copy link
Contributor Author

New failure: kibana-on-merge - main

@kibanamachine
Copy link
Contributor Author

New failure: kibana-on-merge - main

@kibanamachine
Copy link
Contributor Author

New failure: kibana-on-merge - main

@acorretti acorretti added this to the 8.18 milestone Nov 21, 2024
@alexreal1314 alexreal1314 mentioned this issue Jan 28, 2025
Merged
2 tasks
alexreal1314 added a commit that referenced this issue Jan 30, 2025
@alexreal1314
[Cloud Security] 10973 migrate flaky e2e tests to jest (#208345)
cd9096c 
## Summary

This PR tries to fix the following issues - which are flaky FTR tests:

- #197143 - convert to unit test
- #190967 - fixed
- #187470 - fixed
- #186302 - convert to unit test
- #186438 - convert to unit test


There will be an RFC document which is going to be released to help us
better understand and decide which tests are more suitable to make as
E2E tests and which as unit tests.

### Checklist
- [x] [Unit or functional
tests](https://www.elastic.co/guide/en/kibana/master/development-tests.html)
were updated or added to match the most common scenarios
- [x] [Flaky Test
Runner](https://ci-stats.kibana.dev/trigger_flaky_test_runner/1) was
used on any tests changed

### Closes
this PR closes the above mentioned issues in relation for this ticket -
elastic/security-team#10973
@alexreal1314
Copy link
Contributor

closed by #208345

@kibanamachine kibanamachine reopened this Feb 18, 2025
@kibanamachine
Copy link
Contributor Author

New failure: kibana-on-merge - 8.18

@alexreal1314 alexreal1314 mentioned this issue Feb 19, 2025
Merged
alexreal1314 added a commit that referenced this issue Feb 20, 2025
@alexreal1314
[8.18] [Cloud Security] skip flaky tests (#186438) (#211818)
5a32c71 
# Backport

This will skip the following tests in version `8.18`:
 - #186438

### Questions ?
Please refer to the [Backport tool
documentation](https://github.com/sorenlouv/backport)
@alexreal1314
Copy link
Contributor

closed by #211818

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@alexreal1314 alexreal1314

Labels
failed-test A test failure on a tracked branch, potentially flaky-test Team:Cloud Security Cloud Security team related
Projects
None yet
Milestone
8.18
8 participants
@acorretti @mistic @animehart @elasticmachine @opauloh @alexreal1314 @kibanamachine @kfirpeled