1) [Chrome] › playwright/e2e/read-receipts/new-messages-main-timeline.spec.ts:53:17 › Read receipts › new messages › in the main timeline › Reading an older message leaves the room unread @mergequeue Error: expect(received).toBeLessThan(expected) Expected: < 30 Received: 30 Call Log: - Timeout 5000ms exceeded while waiting on the predicate at read-receipts/index.ts:488 486 | // https://playwright.dev/docs/test-assertions#expectpoll 487 | // .toBeLessThan doesn't have a retry mechanism, so we use .poll > 488 | await expect | ^ 489 | .poll(async () => { 490 | return parseInt(await tile.locator(".mx_NotificationBadge_count").textContent(), 10); 491 | }) at Helpers.assertUnreadLessThan (/home/runner/work/element-web/element-web/playwright/e2e/read-receipts/index.ts:488:9) at /home/runner/work/element-web/element-web/playwright/e2e/read-receipts/new-messages-main-timeline.spec.ts:68:17

1) [Chrome] › playwright/e2e/crypto/device-verification.spec.ts:121:9 › Device verification › Verify device with QR code during login @no-webkit Error: "route.fetch: Test ended." while running route callback. Consider awaiting `await page.unrouteAll({ behavior: 'ignoreErrors' })` before the end of the test to ignore remaining routes in flight. 94 | await route.fulfill({ json: {} }); 95 | await new Promise((f) => setTimeout(f, 1000)); > 96 | await route.fetch(); | ^ 97 | }); 98 | 99 | await logIntoElement(page, credentials); at /home/runner/work/element-web/element-web/playwright/e2e/crypto/device-verification.spec.ts:96:25

1) [Chrome] › playwright/e2e/crypto/device-verification.spec.ts:121:9 › Device verification › Verify device with QR code during login @no-webkit Error: apiRequestContext.fetch: Target page, context or browser has been closed Call log: - → POST http://localhost:38495/_synapse/admin/v1/register - user-agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/133.0.6943.16 Safari/537.36 - accept: */* - accept-encoding: gzip,deflate,br - content-type: application/json - content-length: 308 at ../plugins/utils/api.ts:27 25 | public async request<R extends {}>(verb: Verb, path: string, token?: string, data?: object): Promise<R> { 26 | const url = `${this.baseUrl}${path}`; > 27 | const res = await this._request.fetch(url, { | ^ 28 | data, 29 | method: verb, 30 | headers: token at Api.request (/home/runner/work/element-web/element-web/playwright/plugins/utils/api.ts:27:41) at StartedSynapseContainer.registerUserInternal (/home/runner/work/element-web/element-web/playwright/testcontainers/synapse.ts:306:42) at Object.credentials (/home/runner/work/element-web/element-web/playwright/element-web-test.ts:162:29)

1) [Chrome] › playwright/e2e/timeline/timeline.spec.ts:140:13 › Timeline › configure room › should create and configure a room on IRC layout @screenshot Error: expect(locator).toHaveScreenshot(expected) 40 pixels (ratio 0.01 of all image pixels) are different. Expected: /home/runner/work/element-web/element-web/playwright/snapshots/timeline/timeline.spec.ts/configured-room-irc-layout-linux.png Received: /home/runner/work/element-web/element-web/playwright/test-results/timeline-timeline-Timeline-43bff-figure-a-room-on-IRC-layout-Chrome/configured-room-irc-layout-actual.png Diff: /home/runner/work/element-web/element-web/playwright/test-results/timeline-timeline-Timeline-43bff-figure-a-room-on-IRC-layout-Chrome/configured-room-irc-layout-diff.png Call log: - expect.toHaveScreenshot(configured-room-irc-layout.png) with timeout 5000ms - verifying given screenshot expectation - waiting for locator('.mx_MainSplit') - locator resolved to <div class="mx_MainSplit">…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - 40 pixels (ratio 0.01 of all image pixels) are different. - waiting 100ms before taking screenshot - waiting for locator('.mx_MainSplit') - locator resolved to <div class="mx_MainSplit">…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - captured a stable screenshot - 40 pixels (ratio 0.01 of all image pixels) are different. 154 | await expect(page.locator(".mx_TimelineSeparator")).toHaveText("today"); 155 | > 156 | await expect(page.locator(".mx_MainSplit")).toMatchScreenshot("configured-room-irc-layout.png"); | ^ 157 | }, 158 | ); 159 | at /home/runner/work/element-web/element-web/playwright/e2e/timeline/timeline.spec.ts:156:61

2) [Chrome] › playwright/e2e/timeline/timeline.spec.ts:226:13 › Timeline › configure room › should click 'collapse' on the first hovered info event line inside GELS on bubble layout @screenshot Error: expect(locator).toHaveScreenshot(expected) 210 pixels (ratio 0.01 of all image pixels) are different. Expected: /home/runner/work/element-web/element-web/playwright/snapshots/timeline/timeline.spec.ts/expanded-gels-bubble-layout-linux.png Received: /home/runner/work/element-web/element-web/playwright/test-results/timeline-timeline-Timeline-d0f12-nside-GELS-on-bubble-layout-Chrome/expanded-gels-bubble-layout-actual.png Diff: /home/runner/work/element-web/element-web/playwright/test-results/timeline-timeline-Timeline-d0f12-nside-GELS-on-bubble-layout-Chrome/expanded-gels-bubble-layout-diff.png Call log: - expect.toHaveScreenshot(expanded-gels-bubble-layout.png) with timeout 5000ms - verifying given screenshot expectation - waiting for locator('.mx_MainSplit') - locator resolved to <div class="mx_MainSplit">…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - 210 pixels (ratio 0.01 of all image pixels) are different. - waiting 100ms before taking screenshot - waiting for locator('.mx_MainSplit') - locator resolved to <div class="mx_MainSplit">…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - captured a stable screenshot - 210 pixels (ratio 0.01 of all image pixels) are different. 252 | 253 | // Save snapshot of expanded generic event list summary on bubble layout > 254 | await expect(page.locator(".mx_MainSplit")).toMatchScreenshot("expanded-gels-bubble-layout.png", { | ^ 255 | // Exclude timestamp from snapshot 256 | mask: [page.locator(".mx_MessageTimestamp")], 257 | }); at /home/runner/work/element-web/element-web/playwright/e2e/timeline/timeline.spec.ts:254:61

3) [Chrome] › playwright/e2e/timeline/timeline.spec.ts:1217:13 › Timeline › message sending › should render images in the timeline @no-firefox @no-webkit @screenshot Error: expect(locator).toHaveScreenshot(expected) 87122 pixels (ratio 0.18 of all image pixels) are different. Expected: /home/runner/work/element-web/element-web/playwright/snapshots/timeline/timeline.spec.ts/image-in-timeline-default-layout-linux.png Received: /home/runner/work/element-web/element-web/playwright/test-results/timeline-timeline-Timeline-4bcb0-nder-images-in-the-timeline-Chrome/image-in-timeline-default-layout-actual.png Diff: /home/runner/work/element-web/element-web/playwright/test-results/timeline-timeline-Timeline-4bcb0-nder-images-in-the-timeline-Chrome/image-in-timeline-default-layout-diff.png Call log: - expect.toHaveScreenshot(image-in-timeline-default-layout.png) with timeout 5000ms - verifying given screenshot expectation - waiting for locator('.mx_ScrollPanel') - locator resolved to <div tabindex="-1" class="mx_AutoHideScrollbar mx_ScrollPanel mx_RoomView_messagePanel">…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - 87122 pixels (ratio 0.18 of all image pixels) are different. - waiting 100ms before taking screenshot - waiting for locator('.mx_ScrollPanel') - locator resolved to <div tabindex="-1" class="mx_AutoHideScrollbar mx_ScrollPanel mx_RoomView_messagePanel">…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - captured a stable screenshot - 87122 pixels (ratio 0.18 of all image pixels) are different. 1209 | }; 1210 | > 1211 | await expect(page.locator(".mx_ScrollPanel")).toMatchScreenshot( | ^ 1212 | "image-in-timeline-default-layout.png", 1213 | screenshotOptions, 1214 | ); at testImageRendering (/home/runner/work/element-web/element-web/playwright/e2e/timeline/timeline.spec.ts:1211:59) at /home/runner/work/element-web/element-web/playwright/e2e/timeline/timeline.spec.ts:1218:13

[Chrome] › playwright/e2e/messages/messages.spec.ts took 57.9s

[Chrome] › playwright/e2e/pinned-messages/pinned-messages.spec.ts took 57.0s

[Chrome] › playwright/e2e/read-receipts/editing-messages-in-threads.spec.ts took 38.7s

[Chrome] › playwright/e2e/read-receipts/editing-messages-main-timeline.spec.ts took 38.3s

[Chrome] › playwright/e2e/invite/invite-dialog.spec.ts took 28.8s

[Chrome] › playwright/e2e/read-receipts/high-level.spec.ts took 2.7m

[Chrome] › playwright/e2e/read-receipts/new-messages-in-threads.spec.ts took 59.4s

[Chrome] › playwright/e2e/read-receipts/editing-messages-thread-roots.spec.ts took 50.0s

[Chrome] › playwright/e2e/read-receipts/new-messages-thread-roots.spec.ts took 28.7s

[Chrome] › playwright/e2e/read-receipts/redactions-in-threads.spec.ts took 1.6m

[Chrome] › playwright/e2e/read-receipts/redactions-main-timeline.spec.ts took 1.1m

[Chrome] › playwright/e2e/read-receipts/reactions-in-threads.spec.ts took 52.5s

[Chrome] › playwright/e2e/read-receipts/read-receipts.spec.ts took 47.3s

[Chrome] › playwright/e2e/read-receipts/redactions-thread-roots.spec.ts took 32.0s

[Chrome] › playwright/e2e/crypto/event-shields.spec.ts took 50.9s

[Chrome] › playwright/e2e/audio-player/audio-player.spec.ts took 38.8s

[Chrome] › playwright/e2e/composer/RTE.spec.ts took 35.6s

[Chrome] › playwright/e2e/crypto/crypto.spec.ts took 33.7s

[Chrome] › playwright/e2e/crypto/decryption-failure-messages.spec.ts took 28.6s

[Chrome] › playwright/e2e/login/login-consent.spec.ts took 1.3m

[Chrome] › playwright/e2e/threads/threads.spec.ts took 33.1s

[Chrome] › playwright/e2e/crypto/backups-mas.spec.ts took 32.4s

[Chrome] › playwright/e2e/crypto/dehydration.spec.ts took 23.3s

[Chrome] › playwright/e2e/app-loading/guest-registration.spec.ts took 15.7s

[Chrome] › playwright/e2e/spotlight/spotlight.spec.ts took 2.5m

[Chrome] › playwright/e2e/sliding-sync/sliding-sync.spec.ts took 54.0s

[Chrome] › playwright/e2e/spaces/threads-activity-centre/threadsActivityCentre.spec.ts took 49.7s

[Chrome] › playwright/e2e/room/room.spec.ts took 38.1s

[Chrome] › playwright/e2e/spaces/spaces.spec.ts took 30.7s

2 skipped 80 passed (5.9m)

1 flaky [Chrome] › playwright/e2e/read-receipts/new-messages-main-timeline.spec.ts:53:17 › Read receipts › new messages › in the main timeline › Reading an older message leaves the room unread @mergequeue 43 skipped 38 passed (6.2m)

2 skipped 80 passed (7.0m)

1 flaky [Chrome] › playwright/e2e/crypto/device-verification.spec.ts:121:9 › Device verification › Verify device with QR code during login @no-webkit 84 passed (7.1m)

3 flaky [Chrome] › playwright/e2e/timeline/timeline.spec.ts:140:13 › Timeline › configure room › should create and configure a room on IRC layout @screenshot [Chrome] › playwright/e2e/timeline/timeline.spec.ts:226:13 › Timeline › configure room › should click 'collapse' on the first hovered info event line inside GELS on bubble layout @screenshot [Chrome] › playwright/e2e/timeline/timeline.spec.ts:1217:13 › Timeline › message sending › should render images in the timeline @no-firefox @no-webkit @screenshot 68 passed (7.7m)