Skip to content

End to End Tests

End to End Tests #5539

Triggered via merge group February 27, 2025 12:13
Status Success
Total duration 12m 27s
Artifacts 8

end-to-end-tests.yaml

on: merge_group
Build Element-Web
2m 2s
Build Element-Web
Matrix: playwright
end-to-end-tests
42s
end-to-end-tests
Fit to window
Zoom out
Zoom in

Annotations

9 errors, 29 warnings, and 6 notices
[Chrome] › playwright/e2e/read-receipts/new-messages-main-timeline.spec.ts:53:17 › Read receipts › new messages › in the main timeline › Reading an older message leaves the room unread @mergequeue: playwright/e2e/read-receipts/index.ts#L488
1) [Chrome] › playwright/e2e/read-receipts/new-messages-main-timeline.spec.ts:53:17 › Read receipts › new messages › in the main timeline › Reading an older message leaves the room unread @mergequeue Error: expect(received).toBeLessThan(expected) Expected: < 30 Received: 30 Call Log: - Timeout 5000ms exceeded while waiting on the predicate at read-receipts/index.ts:488 486 | // https://playwright.dev/docs/test-assertions#expectpoll 487 | // .toBeLessThan doesn't have a retry mechanism, so we use .poll > 488 | await expect | ^ 489 | .poll(async () => { 490 | return parseInt(await tile.locator(".mx_NotificationBadge_count").textContent(), 10); 491 | }) at Helpers.assertUnreadLessThan (/home/runner/work/element-web/element-web/playwright/e2e/read-receipts/index.ts:488:9) at /home/runner/work/element-web/element-web/playwright/e2e/read-receipts/new-messages-main-timeline.spec.ts:68:17
[Chrome] › playwright/e2e/crypto/device-verification.spec.ts:121:9 › Device verification › Verify device with QR code during login @no-webkit: playwright/e2e/crypto/device-verification.spec.ts#L96
1) [Chrome] › playwright/e2e/crypto/device-verification.spec.ts:121:9 › Device verification › Verify device with QR code during login @no-webkit Error: "route.fetch: Test ended." while running route callback. Consider awaiting `await page.unrouteAll({ behavior: 'ignoreErrors' })` before the end of the test to ignore remaining routes in flight. 94 | await route.fulfill({ json: {} }); 95 | await new Promise((f) => setTimeout(f, 1000)); > 96 | await route.fetch(); | ^ 97 | }); 98 | 99 | await logIntoElement(page, credentials); at /home/runner/work/element-web/element-web/playwright/e2e/crypto/device-verification.spec.ts:96:25
[Chrome] › playwright/e2e/crypto/device-verification.spec.ts:121:9 › Device verification › Verify device with QR code during login @no-webkit: playwright/plugins/utils/api.ts#L27
1) [Chrome] › playwright/e2e/crypto/device-verification.spec.ts:121:9 › Device verification › Verify device with QR code during login @no-webkit Error: apiRequestContext.fetch: Target page, context or browser has been closed Call log: - → POST http://localhost:38103/_synapse/admin/v1/register - user-agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/133.0.6943.16 Safari/537.36 - accept: */* - accept-encoding: gzip,deflate,br - content-type: application/json - content-length: 308 at ../plugins/utils/api.ts:27 25 | public async request<R extends {}>(verb: Verb, path: string, token?: string, data?: object): Promise<R> { 26 | const url = `${this.baseUrl}${path}`; > 27 | const res = await this._request.fetch(url, { | ^ 28 | data, 29 | method: verb, 30 | headers: token at Api.request (/home/runner/work/element-web/element-web/playwright/plugins/utils/api.ts:27:41) at StartedSynapseContainer.registerUserInternal (/home/runner/work/element-web/element-web/playwright/testcontainers/synapse.ts:306:42) at Object.credentials (/home/runner/work/element-web/element-web/playwright/element-web-test.ts:162:29)
[Chrome] › playwright/e2e/timeline/timeline.spec.ts:160:13 › Timeline › configure room › should have an expanded generic event list summary (GELS) on IRC layout @screenshot: playwright/e2e/timeline/timeline.spec.ts#L1
1) [Chrome] › playwright/e2e/timeline/timeline.spec.ts:160:13 › Timeline › configure room › should have an expanded generic event list summary (GELS) on IRC layout @screenshot Test timeout of 30000ms exceeded.
[Chrome] › playwright/e2e/timeline/timeline.spec.ts:160:13 › Timeline › configure room › should have an expanded generic event list summary (GELS) on IRC layout @screenshot: playwright/e2e/timeline/timeline.spec.ts#L177
1) [Chrome] › playwright/e2e/timeline/timeline.spec.ts:160:13 › Timeline › configure room › should have an expanded generic event list summary (GELS) on IRC layout @screenshot Error: locator.click: Test timeout of 30000ms exceeded. Call log: - waiting for locator('.mx_GenericEventListSummary').getByRole('button', { name: 'Expand' }) - locator resolved to <div tabindex="0" role="button" aria-expanded="false" class="mx_AccessibleButton mx_GenericEventListSummary_toggle mx_AccessibleButton_hasKind mx_AccessibleButton_kind_link_inline">Expand</div> - attempting click action 2 × waiting for element to be visible, enabled and stable - element is visible, enabled and stable - scrolling into view if needed - done scrolling - <div tabindex="0" role="button" aria-label="Scroll to most recent messages" class="mx_AccessibleButton mx_JumpToBottomButton_scrollDown"></div> from <div class="mx_JumpToBottomButton">…</div> subtree intercepts pointer events - retrying click action - waiting 20ms 2 × waiting for element to be visible, enabled and stable - element is visible, enabled and stable - scrolling into view if needed - done scrolling - <div tabindex="0" role="button" aria-label="Scroll to most recent messages" class="mx_AccessibleButton mx_JumpToBottomButton_scrollDown"></div> from <div class="mx_JumpToBottomButton">…</div> subtree intercepts pointer events - retrying click action - waiting 100ms 53 × waiting for element to be visible, enabled and stable - element is visible, enabled and stable - scrolling into view if needed - done scrolling - <div tabindex="0" role="button" aria-label="Scroll to most recent messages" class="mx_AccessibleButton mx_JumpToBottomButton_scrollDown"></div> from <div class="mx_JumpToBottomButton">…</div> subtree intercepts pointer events - retrying click action - waiting 500ms 175 | const gels = page.locator(".mx_GenericEventListSummary"); 176 | // Click "expand" link button > 177 | await gels.getByRole("button", { name: "Expand" }).click(); | ^ 178 | // Assert that the "expand" link button worked 179 | await expect(gels.getByRole("button", { name: "Collapse" })).toBeVisible(); 180 | at /home/runner/work/element-web/element-web/playwright/e2e/timeline/timeline.spec.ts:177:68
[Chrome] › playwright/e2e/timeline/timeline.spec.ts:226:13 › Timeline › configure room › should click 'collapse' on the first hovered info event line inside GELS on bubble layout @screenshot: playwright/e2e/timeline/timeline.spec.ts#L254
2) [Chrome] › playwright/e2e/timeline/timeline.spec.ts:226:13 › Timeline › configure room › should click 'collapse' on the first hovered info event line inside GELS on bubble layout @screenshot Error: expect(locator).toHaveScreenshot(expected) 210 pixels (ratio 0.01 of all image pixels) are different. Expected: /home/runner/work/element-web/element-web/playwright/snapshots/timeline/timeline.spec.ts/expanded-gels-bubble-layout-linux.png Received: /home/runner/work/element-web/element-web/playwright/test-results/timeline-timeline-Timeline-d0f12-nside-GELS-on-bubble-layout-Chrome/expanded-gels-bubble-layout-actual.png Diff: /home/runner/work/element-web/element-web/playwright/test-results/timeline-timeline-Timeline-d0f12-nside-GELS-on-bubble-layout-Chrome/expanded-gels-bubble-layout-diff.png Call log: - expect.toHaveScreenshot(expanded-gels-bubble-layout.png) with timeout 5000ms - verifying given screenshot expectation - waiting for locator('.mx_MainSplit') - locator resolved to <div class="mx_MainSplit">…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - 210 pixels (ratio 0.01 of all image pixels) are different. - waiting 100ms before taking screenshot - waiting for locator('.mx_MainSplit') - locator resolved to <div class="mx_MainSplit">…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - captured a stable screenshot - 210 pixels (ratio 0.01 of all image pixels) are different. 252 | 253 | // Save snapshot of expanded generic event list summary on bubble layout > 254 | await expect(page.locator(".mx_MainSplit")).toMatchScreenshot("expanded-gels-bubble-layout.png", { | ^ 255 | // Exclude timestamp from snapshot 256 | mask: [page.locator(".mx_MessageTimestamp")], 257 | }); at /home/runner/work/element-web/element-web/playwright/e2e/timeline/timeline.spec.ts:254:61
[Chrome] › playwright/e2e/timeline/timeline.spec.ts:343:13 › Timeline › message displaying › should align generic event list summary with messages and emote on IRC layout @screenshot: playwright/e2e/timeline/timeline.spec.ts#L425
3) [Chrome] › playwright/e2e/timeline/timeline.spec.ts:343:13 › Timeline › message displaying › should align generic event list summary with messages and emote on IRC layout @screenshot Error: expect(locator).toHaveScreenshot(expected) 210 pixels (ratio 0.01 of all image pixels) are different. Expected: /home/runner/work/element-web/element-web/playwright/snapshots/timeline/timeline.spec.ts/expanded-gels-and-messages-irc-layout-linux.png Received: /home/runner/work/element-web/element-web/playwright/test-results/timeline-timeline-Timeline-5dcf4-ges-and-emote-on-IRC-layout-Chrome/expanded-gels-and-messages-irc-layout-actual.png Diff: /home/runner/work/element-web/element-web/playwright/test-results/timeline-timeline-Timeline-5dcf4-ges-and-emote-on-IRC-layout-Chrome/expanded-gels-and-messages-irc-layout-diff.png Call log: - expect.toHaveScreenshot(expanded-gels-and-messages-irc-layout.png) with timeout 5000ms - verifying given screenshot expectation - waiting for locator('.mx_MainSplit') - locator resolved to <div class="mx_MainSplit">…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - 210 pixels (ratio 0.01 of all image pixels) are different. - waiting 100ms before taking screenshot - waiting for locator('.mx_MainSplit') - locator resolved to <div class="mx_MainSplit">…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - captured a stable screenshot - 210 pixels (ratio 0.01 of all image pixels) are different. 423 | ).toHaveCSS("margin-inline-start", "99px"); 424 | // Record alignment of expanded GELS and messages on messagePanel > 425 | await expect(page.locator(".mx_MainSplit")).toMatchScreenshot( | ^ 426 | "expanded-gels-and-messages-irc-layout.png", 427 | { 428 | // Exclude timestamp from snapshot of mx_MainSplit at /home/runner/work/element-web/element-web/playwright/e2e/timeline/timeline.spec.ts:425:61
[Chrome] › playwright/e2e/sliding-sync/sliding-sync.spec.ts:365:5 › Sliding Sync › should send unsubscribe_rooms for every room switch: playwright/e2e/sliding-sync/sliding-sync.spec.ts#L1
1) [Chrome] › playwright/e2e/sliding-sync/sliding-sync.spec.ts:365:5 › Sliding Sync › should send unsubscribe_rooms for every room switch Test timeout of 30000ms exceeded.
[Chrome] › playwright/e2e/sliding-sync/sliding-sync.spec.ts:365:5 › Sliding Sync › should send unsubscribe_rooms for every room switch: playwright/e2e/sliding-sync/sliding-sync.spec.ts#L406
1) [Chrome] › playwright/e2e/sliding-sync/sliding-sync.spec.ts:365:5 › Sliding Sync › should send unsubscribe_rooms for every room switch Error: page.waitForRequest: Test timeout of 30000ms exceeded. 404 | await Promise.all([ 405 | page.waitForRequest(matchRoomSubRequest(roomOId)), > 406 | page.waitForRequest(matchRoomUnsubRequest(roomPId)), | ^ 407 | page.getByRole("treeitem", { name: "Orange", exact: true }).click(), 408 | ]); 409 | at /home/runner/work/element-web/element-web/playwright/e2e/sliding-sync/sliding-sync.spec.ts:406:18
Slow Test: [Chrome] › playwright/e2e/messages/messages.spec.ts#L1
[Chrome] › playwright/e2e/messages/messages.spec.ts took 58.2s
Slow Test: [Chrome] › playwright/e2e/pinned-messages/pinned-messages.spec.ts#L1
[Chrome] › playwright/e2e/pinned-messages/pinned-messages.spec.ts took 57.8s
Slow Test: [Chrome] › playwright/e2e/read-receipts/editing-messages-main-timeline.spec.ts#L1
[Chrome] › playwright/e2e/read-receipts/editing-messages-main-timeline.spec.ts took 39.6s
Slow Test: [Chrome] › playwright/e2e/read-receipts/editing-messages-in-threads.spec.ts#L1
[Chrome] › playwright/e2e/read-receipts/editing-messages-in-threads.spec.ts took 39.6s
Slow Test: [Chrome] › playwright/e2e/invite/invite-dialog.spec.ts#L1
[Chrome] › playwright/e2e/invite/invite-dialog.spec.ts took 24.4s
Slow Test: [Chrome] › playwright/e2e/read-receipts/high-level.spec.ts#L1
[Chrome] › playwright/e2e/read-receipts/high-level.spec.ts took 2.7m
Slow Test: [Chrome] › playwright/e2e/read-receipts/new-messages-in-threads.spec.ts#L1
[Chrome] › playwright/e2e/read-receipts/new-messages-in-threads.spec.ts took 58.9s
Slow Test: [Chrome] › playwright/e2e/read-receipts/editing-messages-thread-roots.spec.ts#L1
[Chrome] › playwright/e2e/read-receipts/editing-messages-thread-roots.spec.ts took 49.7s
Slow Test: [Chrome] › playwright/e2e/read-receipts/new-messages-thread-roots.spec.ts#L1
[Chrome] › playwright/e2e/read-receipts/new-messages-thread-roots.spec.ts took 28.4s
Slow Test: [Chrome] › playwright/e2e/crypto/event-shields.spec.ts#L1
[Chrome] › playwright/e2e/crypto/event-shields.spec.ts took 54.4s
Slow Test: [Chrome] › playwright/e2e/audio-player/audio-player.spec.ts#L1
[Chrome] › playwright/e2e/audio-player/audio-player.spec.ts took 38.6s
Slow Test: [Chrome] › playwright/e2e/composer/RTE.spec.ts#L1
[Chrome] › playwright/e2e/composer/RTE.spec.ts took 35.3s
Slow Test: [Chrome] › playwright/e2e/crypto/crypto.spec.ts#L1
[Chrome] › playwright/e2e/crypto/crypto.spec.ts took 33.8s
Slow Test: [Chrome] › playwright/e2e/crypto/decryption-failure-messages.spec.ts#L1
[Chrome] › playwright/e2e/crypto/decryption-failure-messages.spec.ts took 29.1s
Slow Test: [Chrome] › playwright/e2e/read-receipts/redactions-in-threads.spec.ts#L1
[Chrome] › playwright/e2e/read-receipts/redactions-in-threads.spec.ts took 1.5m
Slow Test: [Chrome] › playwright/e2e/read-receipts/redactions-main-timeline.spec.ts#L1
[Chrome] › playwright/e2e/read-receipts/redactions-main-timeline.spec.ts took 1.1m
Slow Test: [Chrome] › playwright/e2e/read-receipts/reactions-in-threads.spec.ts#L1
[Chrome] › playwright/e2e/read-receipts/reactions-in-threads.spec.ts took 52.9s
Slow Test: [Chrome] › playwright/e2e/read-receipts/read-receipts.spec.ts#L1
[Chrome] › playwright/e2e/read-receipts/read-receipts.spec.ts took 46.5s
Slow Test: [Chrome] › playwright/e2e/read-receipts/redactions-thread-roots.spec.ts#L1
[Chrome] › playwright/e2e/read-receipts/redactions-thread-roots.spec.ts took 31.4s
Slow Test: [Chrome] › playwright/e2e/login/login-consent.spec.ts#L1
[Chrome] › playwright/e2e/login/login-consent.spec.ts took 1.4m
Slow Test: [Chrome] › playwright/e2e/threads/threads.spec.ts#L1
[Chrome] › playwright/e2e/threads/threads.spec.ts took 32.9s
Slow Test: [Chrome] › playwright/e2e/crypto/backups-mas.spec.ts#L1
[Chrome] › playwright/e2e/crypto/backups-mas.spec.ts took 30.2s
Slow Test: [Chrome] › playwright/e2e/crypto/dehydration.spec.ts#L1
[Chrome] › playwright/e2e/crypto/dehydration.spec.ts took 22.6s
Slow Test: [Chrome] › playwright/e2e/app-loading/guest-registration.spec.ts#L1
[Chrome] › playwright/e2e/app-loading/guest-registration.spec.ts took 15.5s
Slow Test: [Chrome] › playwright/e2e/spotlight/spotlight.spec.ts#L1
[Chrome] › playwright/e2e/spotlight/spotlight.spec.ts took 2.4m
Slow Test: [Chrome] › playwright/e2e/spaces/threads-activity-centre/threadsActivityCentre.spec.ts#L1
[Chrome] › playwright/e2e/spaces/threads-activity-centre/threadsActivityCentre.spec.ts took 50.7s
Slow Test: [Chrome] › playwright/e2e/spaces/spaces.spec.ts#L1
[Chrome] › playwright/e2e/spaces/spaces.spec.ts took 31.2s
Slow Test: [Chrome] › playwright/e2e/room/room.spec.ts#L1
[Chrome] › playwright/e2e/room/room.spec.ts took 26.5s
Slow Test: [Chrome] › playwright/e2e/settings/encryption-user-tab/encryption-tab.spec.ts#L1
[Chrome] › playwright/e2e/settings/encryption-user-tab/encryption-tab.spec.ts took 19.5s
🎭 Playwright Run Summary
2 skipped 80 passed (5.9m)
🎭 Playwright Run Summary
1 flaky [Chrome] › playwright/e2e/read-receipts/new-messages-main-timeline.spec.ts:53:17 › Read receipts › new messages › in the main timeline › Reading an older message leaves the room unread @mergequeue 43 skipped 38 passed (6.3m)
🎭 Playwright Run Summary
1 flaky [Chrome] › playwright/e2e/crypto/device-verification.spec.ts:121:9 › Device verification › Verify device with QR code during login @no-webkit 84 passed (7.1m)
🎭 Playwright Run Summary
2 skipped 80 passed (7.0m)
🎭 Playwright Run Summary
3 flaky [Chrome] › playwright/e2e/timeline/timeline.spec.ts:160:13 › Timeline › configure room › should have an expanded generic event list summary (GELS) on IRC layout @screenshot [Chrome] › playwright/e2e/timeline/timeline.spec.ts:226:13 › Timeline › configure room › should click 'collapse' on the first hovered info event line inside GELS on bubble layout @screenshot [Chrome] › playwright/e2e/timeline/timeline.spec.ts:343:13 › Timeline › message displaying › should align generic event list summary with messages and emote on IRC layout @screenshot 68 passed (8.2m)
🎭 Playwright Run Summary
1 flaky [Chrome] › playwright/e2e/sliding-sync/sliding-sync.spec.ts:365:5 › Sliding Sync › should send unsubscribe_rooms for every room switch 2 skipped 85 passed (8.3m)

Artifacts

Produced during runtime
Name Size
all-blob-reports-Chrome-1 Expired
6.28 MB
all-blob-reports-Chrome-2 Expired
289 KB
all-blob-reports-Chrome-3 Expired
5.76 MB
all-blob-reports-Chrome-4 Expired
351 KB
all-blob-reports-Chrome-5 Expired
4.05 MB
all-blob-reports-Chrome-6 Expired
11.4 MB
html-report
25.5 MB
webapp Expired
27.3 MB