End to End Tests #5539
Annotations
9 errors, 29 warnings, and 6 notices
[Chrome] › playwright/e2e/read-receipts/new-messages-main-timeline.spec.ts:53:17 › Read receipts › new messages › in the main timeline › Reading an older message leaves the room unread @mergequeue:
playwright/e2e/read-receipts/index.ts#L488
1) [Chrome] › playwright/e2e/read-receipts/new-messages-main-timeline.spec.ts:53:17 › Read receipts › new messages › in the main timeline › Reading an older message leaves the room unread @mergequeue
Error: expect(received).toBeLessThan(expected)
Expected: < 30
Received: 30
Call Log:
- Timeout 5000ms exceeded while waiting on the predicate
at read-receipts/index.ts:488
486 | // https://playwright.dev/docs/test-assertions#expectpoll
487 | // .toBeLessThan doesn't have a retry mechanism, so we use .poll
> 488 | await expect
| ^
489 | .poll(async () => {
490 | return parseInt(await tile.locator(".mx_NotificationBadge_count").textContent(), 10);
491 | })
at Helpers.assertUnreadLessThan (/home/runner/work/element-web/element-web/playwright/e2e/read-receipts/index.ts:488:9)
at /home/runner/work/element-web/element-web/playwright/e2e/read-receipts/new-messages-main-timeline.spec.ts:68:17
|
[Chrome] › playwright/e2e/crypto/device-verification.spec.ts:121:9 › Device verification › Verify device with QR code during login @no-webkit:
playwright/e2e/crypto/device-verification.spec.ts#L96
1) [Chrome] › playwright/e2e/crypto/device-verification.spec.ts:121:9 › Device verification › Verify device with QR code during login @no-webkit
Error: "route.fetch: Test ended." while running route callback.
Consider awaiting `await page.unrouteAll({ behavior: 'ignoreErrors' })`
before the end of the test to ignore remaining routes in flight.
94 | await route.fulfill({ json: {} });
95 | await new Promise((f) => setTimeout(f, 1000));
> 96 | await route.fetch();
| ^
97 | });
98 |
99 | await logIntoElement(page, credentials);
at /home/runner/work/element-web/element-web/playwright/e2e/crypto/device-verification.spec.ts:96:25
|
[Chrome] › playwright/e2e/crypto/device-verification.spec.ts:121:9 › Device verification › Verify device with QR code during login @no-webkit:
playwright/plugins/utils/api.ts#L27
1) [Chrome] › playwright/e2e/crypto/device-verification.spec.ts:121:9 › Device verification › Verify device with QR code during login @no-webkit
Error: apiRequestContext.fetch: Target page, context or browser has been closed
Call log:
- → POST http://localhost:38103/_synapse/admin/v1/register
- user-agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/133.0.6943.16 Safari/537.36
- accept: */*
- accept-encoding: gzip,deflate,br
- content-type: application/json
- content-length: 308
at ../plugins/utils/api.ts:27
25 | public async request<R extends {}>(verb: Verb, path: string, token?: string, data?: object): Promise<R> {
26 | const url = `${this.baseUrl}${path}`;
> 27 | const res = await this._request.fetch(url, {
| ^
28 | data,
29 | method: verb,
30 | headers: token
at Api.request (/home/runner/work/element-web/element-web/playwright/plugins/utils/api.ts:27:41)
at StartedSynapseContainer.registerUserInternal (/home/runner/work/element-web/element-web/playwright/testcontainers/synapse.ts:306:42)
at Object.credentials (/home/runner/work/element-web/element-web/playwright/element-web-test.ts:162:29)
|
[Chrome] › playwright/e2e/timeline/timeline.spec.ts:160:13 › Timeline › configure room › should have an expanded generic event list summary (GELS) on IRC layout @screenshot:
playwright/e2e/timeline/timeline.spec.ts#L1
1) [Chrome] › playwright/e2e/timeline/timeline.spec.ts:160:13 › Timeline › configure room › should have an expanded generic event list summary (GELS) on IRC layout @screenshot
Test timeout of 30000ms exceeded.
|
[Chrome] › playwright/e2e/timeline/timeline.spec.ts:160:13 › Timeline › configure room › should have an expanded generic event list summary (GELS) on IRC layout @screenshot:
playwright/e2e/timeline/timeline.spec.ts#L177
1) [Chrome] › playwright/e2e/timeline/timeline.spec.ts:160:13 › Timeline › configure room › should have an expanded generic event list summary (GELS) on IRC layout @screenshot
Error: locator.click: Test timeout of 30000ms exceeded.
Call log:
- waiting for locator('.mx_GenericEventListSummary').getByRole('button', { name: 'Expand' })
- locator resolved to <div tabindex="0" role="button" aria-expanded="false" class="mx_AccessibleButton mx_GenericEventListSummary_toggle mx_AccessibleButton_hasKind mx_AccessibleButton_kind_link_inline">Expand</div>
- attempting click action
2 × waiting for element to be visible, enabled and stable
- element is visible, enabled and stable
- scrolling into view if needed
- done scrolling
- <div tabindex="0" role="button" aria-label="Scroll to most recent messages" class="mx_AccessibleButton mx_JumpToBottomButton_scrollDown"></div> from <div class="mx_JumpToBottomButton">…</div> subtree intercepts pointer events
- retrying click action
- waiting 20ms
2 × waiting for element to be visible, enabled and stable
- element is visible, enabled and stable
- scrolling into view if needed
- done scrolling
- <div tabindex="0" role="button" aria-label="Scroll to most recent messages" class="mx_AccessibleButton mx_JumpToBottomButton_scrollDown"></div> from <div class="mx_JumpToBottomButton">…</div> subtree intercepts pointer events
- retrying click action
- waiting 100ms
53 × waiting for element to be visible, enabled and stable
- element is visible, enabled and stable
- scrolling into view if needed
- done scrolling
- <div tabindex="0" role="button" aria-label="Scroll to most recent messages" class="mx_AccessibleButton mx_JumpToBottomButton_scrollDown"></div> from <div class="mx_JumpToBottomButton">…</div> subtree intercepts pointer events
- retrying click action
- waiting 500ms
175 | const gels = page.locator(".mx_GenericEventListSummary");
176 | // Click "expand" link button
> 177 | await gels.getByRole("button", { name: "Expand" }).click();
| ^
178 | // Assert that the "expand" link button worked
179 | await expect(gels.getByRole("button", { name: "Collapse" })).toBeVisible();
180 |
at /home/runner/work/element-web/element-web/playwright/e2e/timeline/timeline.spec.ts:177:68
|
[Chrome] › playwright/e2e/timeline/timeline.spec.ts:226:13 › Timeline › configure room › should click 'collapse' on the first hovered info event line inside GELS on bubble layout @screenshot:
playwright/e2e/timeline/timeline.spec.ts#L254
2) [Chrome] › playwright/e2e/timeline/timeline.spec.ts:226:13 › Timeline › configure room › should click 'collapse' on the first hovered info event line inside GELS on bubble layout @screenshot
Error: expect(locator).toHaveScreenshot(expected)
210 pixels (ratio 0.01 of all image pixels) are different.
Expected: /home/runner/work/element-web/element-web/playwright/snapshots/timeline/timeline.spec.ts/expanded-gels-bubble-layout-linux.png
Received: /home/runner/work/element-web/element-web/playwright/test-results/timeline-timeline-Timeline-d0f12-nside-GELS-on-bubble-layout-Chrome/expanded-gels-bubble-layout-actual.png
Diff: /home/runner/work/element-web/element-web/playwright/test-results/timeline-timeline-Timeline-d0f12-nside-GELS-on-bubble-layout-Chrome/expanded-gels-bubble-layout-diff.png
Call log:
- expect.toHaveScreenshot(expanded-gels-bubble-layout.png) with timeout 5000ms
- verifying given screenshot expectation
- waiting for locator('.mx_MainSplit')
- locator resolved to <div class="mx_MainSplit">…</div>
- taking element screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- attempting scroll into view action
- waiting for element to be stable
- 210 pixels (ratio 0.01 of all image pixels) are different.
- waiting 100ms before taking screenshot
- waiting for locator('.mx_MainSplit')
- locator resolved to <div class="mx_MainSplit">…</div>
- taking element screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- attempting scroll into view action
- waiting for element to be stable
- captured a stable screenshot
- 210 pixels (ratio 0.01 of all image pixels) are different.
252 |
253 | // Save snapshot of expanded generic event list summary on bubble layout
> 254 | await expect(page.locator(".mx_MainSplit")).toMatchScreenshot("expanded-gels-bubble-layout.png", {
| ^
255 | // Exclude timestamp from snapshot
256 | mask: [page.locator(".mx_MessageTimestamp")],
257 | });
at /home/runner/work/element-web/element-web/playwright/e2e/timeline/timeline.spec.ts:254:61
|
[Chrome] › playwright/e2e/timeline/timeline.spec.ts:343:13 › Timeline › message displaying › should align generic event list summary with messages and emote on IRC layout @screenshot:
playwright/e2e/timeline/timeline.spec.ts#L425
3) [Chrome] › playwright/e2e/timeline/timeline.spec.ts:343:13 › Timeline › message displaying › should align generic event list summary with messages and emote on IRC layout @screenshot
Error: expect(locator).toHaveScreenshot(expected)
210 pixels (ratio 0.01 of all image pixels) are different.
Expected: /home/runner/work/element-web/element-web/playwright/snapshots/timeline/timeline.spec.ts/expanded-gels-and-messages-irc-layout-linux.png
Received: /home/runner/work/element-web/element-web/playwright/test-results/timeline-timeline-Timeline-5dcf4-ges-and-emote-on-IRC-layout-Chrome/expanded-gels-and-messages-irc-layout-actual.png
Diff: /home/runner/work/element-web/element-web/playwright/test-results/timeline-timeline-Timeline-5dcf4-ges-and-emote-on-IRC-layout-Chrome/expanded-gels-and-messages-irc-layout-diff.png
Call log:
- expect.toHaveScreenshot(expanded-gels-and-messages-irc-layout.png) with timeout 5000ms
- verifying given screenshot expectation
- waiting for locator('.mx_MainSplit')
- locator resolved to <div class="mx_MainSplit">…</div>
- taking element screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- attempting scroll into view action
- waiting for element to be stable
- 210 pixels (ratio 0.01 of all image pixels) are different.
- waiting 100ms before taking screenshot
- waiting for locator('.mx_MainSplit')
- locator resolved to <div class="mx_MainSplit">…</div>
- taking element screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- attempting scroll into view action
- waiting for element to be stable
- captured a stable screenshot
- 210 pixels (ratio 0.01 of all image pixels) are different.
423 | ).toHaveCSS("margin-inline-start", "99px");
424 | // Record alignment of expanded GELS and messages on messagePanel
> 425 | await expect(page.locator(".mx_MainSplit")).toMatchScreenshot(
| ^
426 | "expanded-gels-and-messages-irc-layout.png",
427 | {
428 | // Exclude timestamp from snapshot of mx_MainSplit
at /home/runner/work/element-web/element-web/playwright/e2e/timeline/timeline.spec.ts:425:61
|
[Chrome] › playwright/e2e/sliding-sync/sliding-sync.spec.ts:365:5 › Sliding Sync › should send unsubscribe_rooms for every room switch:
playwright/e2e/sliding-sync/sliding-sync.spec.ts#L1
1) [Chrome] › playwright/e2e/sliding-sync/sliding-sync.spec.ts:365:5 › Sliding Sync › should send unsubscribe_rooms for every room switch
Test timeout of 30000ms exceeded.
|
[Chrome] › playwright/e2e/sliding-sync/sliding-sync.spec.ts:365:5 › Sliding Sync › should send unsubscribe_rooms for every room switch:
playwright/e2e/sliding-sync/sliding-sync.spec.ts#L406
1) [Chrome] › playwright/e2e/sliding-sync/sliding-sync.spec.ts:365:5 › Sliding Sync › should send unsubscribe_rooms for every room switch
Error: page.waitForRequest: Test timeout of 30000ms exceeded.
404 | await Promise.all([
405 | page.waitForRequest(matchRoomSubRequest(roomOId)),
> 406 | page.waitForRequest(matchRoomUnsubRequest(roomPId)),
| ^
407 | page.getByRole("treeitem", { name: "Orange", exact: true }).click(),
408 | ]);
409 |
at /home/runner/work/element-web/element-web/playwright/e2e/sliding-sync/sliding-sync.spec.ts:406:18
|
Slow Test:
[Chrome] › playwright/e2e/messages/messages.spec.ts#L1
[Chrome] › playwright/e2e/messages/messages.spec.ts took 58.2s
|
Slow Test:
[Chrome] › playwright/e2e/pinned-messages/pinned-messages.spec.ts#L1
[Chrome] › playwright/e2e/pinned-messages/pinned-messages.spec.ts took 57.8s
|
Slow Test:
[Chrome] › playwright/e2e/read-receipts/editing-messages-main-timeline.spec.ts#L1
[Chrome] › playwright/e2e/read-receipts/editing-messages-main-timeline.spec.ts took 39.6s
|
Slow Test:
[Chrome] › playwright/e2e/read-receipts/editing-messages-in-threads.spec.ts#L1
[Chrome] › playwright/e2e/read-receipts/editing-messages-in-threads.spec.ts took 39.6s
|
Slow Test:
[Chrome] › playwright/e2e/invite/invite-dialog.spec.ts#L1
[Chrome] › playwright/e2e/invite/invite-dialog.spec.ts took 24.4s
|
Slow Test:
[Chrome] › playwright/e2e/read-receipts/high-level.spec.ts#L1
[Chrome] › playwright/e2e/read-receipts/high-level.spec.ts took 2.7m
|
Slow Test:
[Chrome] › playwright/e2e/read-receipts/new-messages-in-threads.spec.ts#L1
[Chrome] › playwright/e2e/read-receipts/new-messages-in-threads.spec.ts took 58.9s
|
Slow Test:
[Chrome] › playwright/e2e/read-receipts/editing-messages-thread-roots.spec.ts#L1
[Chrome] › playwright/e2e/read-receipts/editing-messages-thread-roots.spec.ts took 49.7s
|
Slow Test:
[Chrome] › playwright/e2e/read-receipts/new-messages-thread-roots.spec.ts#L1
[Chrome] › playwright/e2e/read-receipts/new-messages-thread-roots.spec.ts took 28.4s
|
Slow Test:
[Chrome] › playwright/e2e/crypto/event-shields.spec.ts#L1
[Chrome] › playwright/e2e/crypto/event-shields.spec.ts took 54.4s
|
Slow Test:
[Chrome] › playwright/e2e/audio-player/audio-player.spec.ts#L1
[Chrome] › playwright/e2e/audio-player/audio-player.spec.ts took 38.6s
|
Slow Test:
[Chrome] › playwright/e2e/composer/RTE.spec.ts#L1
[Chrome] › playwright/e2e/composer/RTE.spec.ts took 35.3s
|
Slow Test:
[Chrome] › playwright/e2e/crypto/crypto.spec.ts#L1
[Chrome] › playwright/e2e/crypto/crypto.spec.ts took 33.8s
|
Slow Test:
[Chrome] › playwright/e2e/crypto/decryption-failure-messages.spec.ts#L1
[Chrome] › playwright/e2e/crypto/decryption-failure-messages.spec.ts took 29.1s
|
Slow Test:
[Chrome] › playwright/e2e/read-receipts/redactions-in-threads.spec.ts#L1
[Chrome] › playwright/e2e/read-receipts/redactions-in-threads.spec.ts took 1.5m
|
Slow Test:
[Chrome] › playwright/e2e/read-receipts/redactions-main-timeline.spec.ts#L1
[Chrome] › playwright/e2e/read-receipts/redactions-main-timeline.spec.ts took 1.1m
|
Slow Test:
[Chrome] › playwright/e2e/read-receipts/reactions-in-threads.spec.ts#L1
[Chrome] › playwright/e2e/read-receipts/reactions-in-threads.spec.ts took 52.9s
|
Slow Test:
[Chrome] › playwright/e2e/read-receipts/read-receipts.spec.ts#L1
[Chrome] › playwright/e2e/read-receipts/read-receipts.spec.ts took 46.5s
|
Slow Test:
[Chrome] › playwright/e2e/read-receipts/redactions-thread-roots.spec.ts#L1
[Chrome] › playwright/e2e/read-receipts/redactions-thread-roots.spec.ts took 31.4s
|
Slow Test:
[Chrome] › playwright/e2e/login/login-consent.spec.ts#L1
[Chrome] › playwright/e2e/login/login-consent.spec.ts took 1.4m
|
Slow Test:
[Chrome] › playwright/e2e/threads/threads.spec.ts#L1
[Chrome] › playwright/e2e/threads/threads.spec.ts took 32.9s
|
Slow Test:
[Chrome] › playwright/e2e/crypto/backups-mas.spec.ts#L1
[Chrome] › playwright/e2e/crypto/backups-mas.spec.ts took 30.2s
|
Slow Test:
[Chrome] › playwright/e2e/crypto/dehydration.spec.ts#L1
[Chrome] › playwright/e2e/crypto/dehydration.spec.ts took 22.6s
|
Slow Test:
[Chrome] › playwright/e2e/app-loading/guest-registration.spec.ts#L1
[Chrome] › playwright/e2e/app-loading/guest-registration.spec.ts took 15.5s
|
Slow Test:
[Chrome] › playwright/e2e/spotlight/spotlight.spec.ts#L1
[Chrome] › playwright/e2e/spotlight/spotlight.spec.ts took 2.4m
|
Slow Test:
[Chrome] › playwright/e2e/spaces/threads-activity-centre/threadsActivityCentre.spec.ts#L1
[Chrome] › playwright/e2e/spaces/threads-activity-centre/threadsActivityCentre.spec.ts took 50.7s
|
Slow Test:
[Chrome] › playwright/e2e/spaces/spaces.spec.ts#L1
[Chrome] › playwright/e2e/spaces/spaces.spec.ts took 31.2s
|
Slow Test:
[Chrome] › playwright/e2e/room/room.spec.ts#L1
[Chrome] › playwright/e2e/room/room.spec.ts took 26.5s
|
Slow Test:
[Chrome] › playwright/e2e/settings/encryption-user-tab/encryption-tab.spec.ts#L1
[Chrome] › playwright/e2e/settings/encryption-user-tab/encryption-tab.spec.ts took 19.5s
|
🎭 Playwright Run Summary
2 skipped
80 passed (5.9m)
|
🎭 Playwright Run Summary
1 flaky
[Chrome] › playwright/e2e/read-receipts/new-messages-main-timeline.spec.ts:53:17 › Read receipts › new messages › in the main timeline › Reading an older message leaves the room unread @mergequeue
43 skipped
38 passed (6.3m)
|
🎭 Playwright Run Summary
1 flaky
[Chrome] › playwright/e2e/crypto/device-verification.spec.ts:121:9 › Device verification › Verify device with QR code during login @no-webkit
84 passed (7.1m)
|
🎭 Playwright Run Summary
2 skipped
80 passed (7.0m)
|
🎭 Playwright Run Summary
3 flaky
[Chrome] › playwright/e2e/timeline/timeline.spec.ts:160:13 › Timeline › configure room › should have an expanded generic event list summary (GELS) on IRC layout @screenshot
[Chrome] › playwright/e2e/timeline/timeline.spec.ts:226:13 › Timeline › configure room › should click 'collapse' on the first hovered info event line inside GELS on bubble layout @screenshot
[Chrome] › playwright/e2e/timeline/timeline.spec.ts:343:13 › Timeline › message displaying › should align generic event list summary with messages and emote on IRC layout @screenshot
68 passed (8.2m)
|
🎭 Playwright Run Summary
1 flaky
[Chrome] › playwright/e2e/sliding-sync/sliding-sync.spec.ts:365:5 › Sliding Sync › should send unsubscribe_rooms for every room switch
2 skipped
85 passed (8.3m)
|
Artifacts
Produced during runtime
Name | Size | |
---|---|---|
all-blob-reports-Chrome-1
Expired
|
6.28 MB |
|
all-blob-reports-Chrome-2
Expired
|
289 KB |
|
all-blob-reports-Chrome-3
Expired
|
5.76 MB |
|
all-blob-reports-Chrome-4
Expired
|
351 KB |
|
all-blob-reports-Chrome-5
Expired
|
4.05 MB |
|
all-blob-reports-Chrome-6
Expired
|
11.4 MB |
|
html-report
|
25.5 MB |
|
webapp
Expired
|
27.3 MB |
|