1) [Chrome] › read-receipts/new-messages-thread-roots.spec.ts:35:17 › Read receipts › new messages › thread roots › Reading a thread root within the thread view marks it as read in the main timeline @mergequeue Error: Timed out 5000ms waiting for expect(locator).toHaveText(expected) Locator: getByRole('treeitem', { name: /^Room Beta/ }).locator('.mx_NotificationBadge_count') Expected string: "23" Received string: "61" Call log: - expect.toHaveText with timeout 5000ms - waiting for getByRole('treeitem', { name: /^Room Beta/ }).locator('.mx_NotificationBadge_count') 9 × locator resolved to <span class="mx_NotificationBadge_count">61</span> - unexpected value "61" at read-receipts/index.ts:473 471 | await expect(tile.locator(".mx_NotificationBadge_dot")).toBeVisible(); 472 | } else { > 473 | await expect(tile.locator(".mx_NotificationBadge_count")).toHaveText(count.toString()); | ^ 474 | } 475 | } 476 | at Helpers.assertUnread (/home/runner/work/element-web/element-web/playwright/e2e/read-receipts/index.ts:473:71) at /home/runner/work/element-web/element-web/playwright/e2e/read-receipts/new-messages-thread-roots.spec.ts:58:28

1) [Chrome] › read-receipts/redactions-main-timeline.spec.ts:162:17 › Read receipts › redactions › in the main timeline › Redacting one of the unread messages reduces the unread count after restart @mergequeue Error: Timed out 5000ms waiting for expect(locator).toHaveText(expected) Locator: getByRole('treeitem', { name: /^Room Beta/ }).locator('.mx_NotificationBadge_count') Expected string: "2" Received string: "3" Call log: - expect.toHaveText with timeout 5000ms - waiting for getByRole('treeitem', { name: /^Room Beta/ }).locator('.mx_NotificationBadge_count') 9 × locator resolved to <span class="mx_NotificationBadge_count">3</span> - unexpected value "3" at read-receipts/index.ts:473 471 | await expect(tile.locator(".mx_NotificationBadge_dot")).toBeVisible(); 472 | } else { > 473 | await expect(tile.locator(".mx_NotificationBadge_count")).toHaveText(count.toString()); | ^ 474 | } 475 | } 476 | at Helpers.assertUnread (/home/runner/work/element-web/element-web/playwright/e2e/read-receipts/index.ts:473:71) at /home/runner/work/element-web/element-web/playwright/e2e/read-receipts/redactions-main-timeline.spec.ts:173:28

1) [Chrome] › audio-player/audio-player.spec.ts:168:9 › Audio player › should be correctly rendered - dark theme @no-firefox @no-webkit @screenshot Test timeout of 30000ms exceeded while running "beforeEach" hook. 123 | }; 124 | > 125 | test.beforeEach(async ({ page, app, user }) => { | ^ 126 | await app.client.createRoom({ name: "Test Room" }); 127 | await app.viewRoomByName("Test Room"); 128 | at /home/runner/work/element-web/element-web/playwright/e2e/audio-player/audio-player.spec.ts:125:10

1) [Chrome] › audio-player/audio-player.spec.ts:168:9 › Audio player › should be correctly rendered - dark theme @no-firefox @no-webkit @screenshot Error: locator.click: Test timeout of 30000ms exceeded. Call log: - waiting for getByRole('tree', { name: 'Rooms' }).locator('[title="Test Room"],[aria-label="Test Room"]').first() at ../pages/ElementAppPage.ts:96 94 | .locator(`[title="${name}"],[aria-label="${name}"]`) 95 | .first() > 96 | .click(); | ^ 97 | } 98 | 99 | public async viewRoomById(roomId: string): Promise<void> { at ElementAppPage.viewRoomByName (/home/runner/work/element-web/element-web/playwright/pages/ElementAppPage.ts:96:14) at /home/runner/work/element-web/element-web/playwright/e2e/audio-player/audio-player.spec.ts:127:19

2) [Chrome] › audio-player/audio-player.spec.ts:243:9 › Audio player › should support creating a reply chain with multiple audio files @no-firefox @no-webkit @screenshot Test timeout of 30000ms exceeded.

2) [Chrome] › audio-player/audio-player.spec.ts:243:9 › Audio player › should support creating a reply chain with multiple audio files @no-firefox @no-webkit @screenshot Error: locator.click: Test timeout of 30000ms exceeded. Call log: - waiting for locator('.mx_EventTile_last').getByRole('button', { name: 'Reply', exact: true }) 255 | const clickButtonReply = async () => { 256 | await tile.hover(); > 257 | await tile.getByRole("button", { name: "Reply", exact: true }).click(); | ^ 258 | }; 259 | 260 | await uploadFile(page, "playwright/sample-files/upload-first.ogg"); at clickButtonReply (/home/runner/work/element-web/element-web/playwright/e2e/audio-player/audio-player.spec.ts:257:80) at /home/runner/work/element-web/element-web/playwright/e2e/audio-player/audio-player.spec.ts:273:13

1) [Chrome] › crypto/backups-mas.spec.ts:31:9 › Encryption state after registration › user is prompted to set up recovery Test timeout of 30000ms exceeded.

1) [Chrome] › crypto/backups-mas.spec.ts:31:9 › Encryption state after registration › user is prompted to set up recovery Error: locator.fill: Test timeout of 30000ms exceeded. Call log: - waiting for getByRole('textbox', { name: '6-digit code' }) at oidc/index.ts:38 36 | const [code] = messages.items[0].text.match(/(\d{6})/); 37 | > 38 | await page.getByRole("textbox", { name: "6-digit code" }).fill(code); | ^ 39 | await page.getByRole("button", { name: "Continue" }).click(); 40 | await expect(page.getByText("Allow access to your account?")).toBeVisible(); 41 | await page.getByRole("button", { name: "Continue" }).click(); at registerAccountMas (/home/runner/work/element-web/element-web/playwright/e2e/oidc/index.ts:38:63) at /home/runner/work/element-web/element-web/playwright/e2e/crypto/backups-mas.spec.ts:34:9

2) [Chrome] › crypto/backups-mas.spec.ts:48:9 › Key backup reset from elsewhere › Key backup is disabled when reset from elsewhere Test timeout of 30000ms exceeded.

2) [Chrome] › crypto/backups-mas.spec.ts:48:9 › Key backup reset from elsewhere › Key backup is disabled when reset from elsewhere Error: locator.fill: Test timeout of 30000ms exceeded. Call log: - waiting for getByRole('textbox', { name: '6-digit code' }) at oidc/index.ts:38 36 | const [code] = messages.items[0].text.match(/(\d{6})/); 37 | > 38 | await page.getByRole("textbox", { name: "6-digit code" }).fill(code); | ^ 39 | await page.getByRole("button", { name: "Continue" }).click(); 40 | await expect(page.getByText("Allow access to your account?")).toBeVisible(); 41 | await page.getByRole("button", { name: "Continue" }).click(); at registerAccountMas (/home/runner/work/element-web/element-web/playwright/e2e/oidc/index.ts:38:63) at /home/runner/work/element-web/element-web/playwright/e2e/crypto/backups-mas.spec.ts:58:9

3) [Chrome] › login/login-consent.spec.ts:147:13 › Login › Password login › Follows the original link after login { errcode: 'M_USER_IN_USE', error: 'User ID already taken.' }

4) [Chrome] › login/login-consent.spec.ts:156:17 › Login › Password login › verification after login › Shows verification prompt after login if signing keys are set up, skippable by default { errcode: 'M_USER_IN_USE', error: 'User ID already taken.' }

5) [Chrome] › login/login-consent.spec.ts:186:21 › Login › Password login › verification after login › with force_verification off › Shows skippable verification prompt after login if signing keys are set up { errcode: 'M_USER_IN_USE', error: 'User ID already taken.' }

6) [Chrome] › login/login-consent.spec.ts:220:21 › Login › Password login › verification after login › with force_verification on › Shows unskippable verification prompt after login if signing keys are set up { errcode: 'M_USER_IN_USE', error: 'User ID already taken.' }

7) [Chrome] › login/login-consent.spec.ts:252:13 › Login › logout › should go to login page on logout { errcode: 'M_USER_IN_USE', error: 'User ID already taken.' }

8) [Chrome] › login/soft_logout_oauth.spec.ts:40:9 › Soft logout with SSO user › shows the soft-logout page when a request fails, and allows a re-login Error: Timed out 5000ms waiting for expect(locator).toBeVisible() Locator: getByRole('heading', { name: 'Create your account' }) Expected: visible Received: <element(s) not found> Call log: - expect.toBeVisible with timeout 5000ms - waiting for getByRole('heading', { name: 'Create your account' }) at login/utils.ts:37 35 | 36 | // Synapse prompts us to pick a user ID > 37 | await expect(page.getByRole("heading", { name: "Create your account" })).toBeVisible(); | ^ 38 | await page.getByRole("textbox", { name: "Username (required)" }).fill("alice"); 39 | 40 | // wait for username validation to start, and complete at doTokenRegistration (/home/runner/work/element-web/element-web/playwright/e2e/login/utils.ts:37:78) at Object.user (/home/runner/work/element-web/element-web/playwright/e2e/login/soft_logout_oauth.spec.ts:30:26)

1) [Chrome] › room/room-header.spec.ts:54:13 › Room Header › with feature_notifications enabled › should render a very long room name without collapsing the buttons @screenshot Test timeout of 30000ms exceeded.

1) [Chrome] › room/room-header.spec.ts:54:13 › Room Header › with feature_notifications enabled › should render a very long room name without collapsing the buttons @screenshot Error: locator.click: Test timeout of 30000ms exceeded. Call log: - waiting for getByRole('tree', { name: 'Rooms' }).locator('[title="Lorem ipsum dolor sit amet, consectetur adipisicing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam, quis nostrud exercitation ullamco laboris nisi ut aliquip ex ea commodo consequat. Duis aute irure dolor in reprehenderit in voluptate velit esse cillum dolore eu fugiat nulla pariatur. Excepteur sint occaecat cupidatat non proident, sunt in culpa qui officia deserunt mollit anim id est laborum."],[aria-label="Lorem ipsum dolor sit amet, consectetur adipisicing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam, quis nostrud exercitation ullamco laboris nisi ut aliquip ex ea commodo consequat. Duis aute irure dolor in reprehenderit in voluptate velit esse cillum dolore eu fugiat nulla pariatur. Excepteur sint occaecat cupidatat non proident, sunt in culpa qui officia deserunt mollit anim id est laborum."]').first() at ../pages/ElementAppPage.ts:96 94 | .locator(`[title="${name}"],[aria-label="${name}"]`) 95 | .first() > 96 | .click(); | ^ 97 | } 98 | 99 | public async viewRoomById(roomId: string): Promise<void> { at ElementAppPage.viewRoomByName (/home/runner/work/element-web/element-web/playwright/pages/ElementAppPage.ts:96:14) at /home/runner/work/element-web/element-web/playwright/e2e/room/room-header.spec.ts:66:27

2) [Chrome] › room_options/marked_unread.spec.ts:22:9 › Mark as Unread › should mark a room as unread Error: expect(locator).toBeVisible() Locator: getByLabel('The mark unread test room Unread messages.') Expected: visible Received: <element(s) not found> Call log: - expect.toBeVisible with timeout 5000ms - waiting for getByLabel('The mark unread test room Unread messages.') 49 | await page.getByRole("menuitem", { name: "Mark as unread" }).click(); 50 | > 51 | expect(page.getByLabel(TEST_ROOM_NAME + " Unread messages.")).toBeVisible(); | ^ 52 | }); 53 | }); 54 | at /home/runner/work/element-web/element-web/playwright/e2e/room_options/marked_unread.spec.ts:51:71

3) [Chrome] › room-directory/room-directory.spec.ts:18:9 › Room Directory › should allow admin to add alias & publish room to directory @no-webkit Error: Timed out 5000ms waiting for expect(locator).toHaveClass(expected) Locator: locator('.mx_SettingsFieldset').filter({ hasText: 'Local Addresses' }).getByText('#gaming:localhost') Expected string: "mx_EditableItem_item" Received: <element(s) not found> Call log: - expect.toHaveClass with timeout 5000ms - waiting for locator('.mx_SettingsFieldset').filter({ hasText: 'Local Addresses' }).getByText('#gaming:localhost') 32 | await localAddresses.getByRole("textbox").fill("gaming"); 33 | await localAddresses.getByRole("button", { name: "Add" }).click(); > 34 | await expect(localAddresses.getByText("#gaming:localhost")).toHaveClass("mx_EditableItem_item"); | ^ 35 | 36 | // Publish into the public rooms directory 37 | const publishedAddresses = page.locator(".mx_SettingsFieldset", { hasText: "Published Addresses" }); at /home/runner/work/element-web/element-web/playwright/e2e/room-directory/room-directory.spec.ts:34:73

3) [Chrome] › room-directory/room-directory.spec.ts:18:9 › Room Directory › should allow admin to add alias & publish room to directory @no-webkit Retry #1 ─────────────────────────────────────────────────────────────────────────────────────── Error: Timed out 5000ms waiting for expect(locator).toHaveClass(expected) Locator: locator('.mx_SettingsFieldset').filter({ hasText: 'Local Addresses' }).getByText('#gaming:localhost') Expected string: "mx_EditableItem_item" Received: <element(s) not found> Call log: - expect.toHaveClass with timeout 5000ms - waiting for locator('.mx_SettingsFieldset').filter({ hasText: 'Local Addresses' }).getByText('#gaming:localhost') 32 | await localAddresses.getByRole("textbox").fill("gaming"); 33 | await localAddresses.getByRole("button", { name: "Add" }).click(); > 34 | await expect(localAddresses.getByText("#gaming:localhost")).toHaveClass("mx_EditableItem_item"); | ^ 35 | 36 | // Publish into the public rooms directory 37 | const publishedAddresses = page.locator(".mx_SettingsFieldset", { hasText: "Published Addresses" }); at /home/runner/work/element-web/element-web/playwright/e2e/room-directory/room-directory.spec.ts:34:73

4) [Chrome] › settings/general-room-settings-tab.spec.ts:39:9 › General room settings tab › long address should not cause dialog to overflow @no-webkit Error: Timed out 5000ms waiting for expect(locator).toHaveValue(expected) Locator: locator('.mx_Dialog').filter({ has: locator('.mx_RoomSettingsDialog') }).locator('#canonicalAlias') Expected string: "#abcasdhjasjhdaj1jh1asdhasjdhajsdhjavhjksdabcasdhjasjhdaj1jh1asdhasjdhajsdhjavhjksdabcasdhjasjhdaj1jh1asdhasjdhajsdhjavhjksdabcasdhjasjhdaj1jh1asdhasjdhajsdhjavhjksd:localhost" Received string: "" Call log: - expect.toHaveValue with timeout 5000ms - waiting for locator('.mx_Dialog').filter({ has: locator('.mx_RoomSettingsDialog') }).locator('#canonicalAlias') 9 × locator resolved to <select type="text" id="canonicalAlias" label="Main address" placeholder="Main address">…</select> - unexpected value "" 45 | 46 | // 2. wait for the new setting to apply ... > 47 | await expect(settings.locator("#canonicalAlias")).toHaveValue(`#${longString}:localhost`); | ^ 48 | 49 | // 3. Check if the dialog overflows 50 | const dialogBoundingBox = await page.locator(".mx_Dialog").boundingBox(); at /home/runner/work/element-web/element-web/playwright/e2e/settings/general-room-settings-tab.spec.ts:47:59

5) [Chrome] › share-dialog/share-dialog.spec.ts:19:9 › Share dialog › should share a room @screenshot Error: expect.toHaveScreenshot(share-dialog-room.png): Test ended. Call log: - expect.toHaveScreenshot(share-dialog-room.png) with timeout 5000ms - verifying given screenshot expectation - waiting for getByRole('dialog', { name: 'Share room' }) at ../element-web-test.ts:314 312 | 313 | const screenshotName = sanitizeFilePathBeforeExtension(name); > 314 | await baseExpect(receiver).toHaveScreenshot(screenshotName, options); | ^ 315 | 316 | await style.evaluate((tag) => tag.remove()); 317 | at Object.toMatchScreenshot (/home/runner/work/element-web/element-web/playwright/element-web-test.ts:314:9)

6) [Chrome] › share-dialog/share-dialog.spec.ts:32:9 › Share dialog › should share a room member @screenshot Error: expect.toHaveScreenshot(share-dialog-user.png): Target page, context or browser has been closed at ../element-web-test.ts:314 312 | 313 | const screenshotName = sanitizeFilePathBeforeExtension(name); > 314 | await baseExpect(receiver).toHaveScreenshot(screenshotName, options); | ^ 315 | 316 | await style.evaluate((tag) => tag.remove()); 317 | at Object.toMatchScreenshot (/home/runner/work/element-web/element-web/playwright/element-web-test.ts:314:9)

7) [Chrome] › share-dialog/share-dialog.spec.ts:49:9 › Share dialog › should share an event @screenshot Error: expect.toHaveScreenshot(share-dialog-event.png): Test ended. Call log: - expect.toHaveScreenshot(share-dialog-event.png) with timeout 5000ms - verifying given screenshot expectation - waiting for getByRole('dialog', { name: 'Share Room Message' }) - locator resolved to <div role="dialog" class="mx_ShareDialog" data-focus-lock-disabled="false" aria-describedby="mx_Dialog_content" aria-labelledby="mx_BaseDialog_title">…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable at ../element-web-test.ts:314 312 | 313 | const screenshotName = sanitizeFilePathBeforeExtension(name); > 314 | await baseExpect(receiver).toHaveScreenshot(screenshotName, options); | ^ 315 | 316 | await style.evaluate((tag) => tag.remove()); 317 | at Object.toMatchScreenshot (/home/runner/work/element-web/element-web/playwright/element-web-test.ts:314:9)

8) [Chrome] › spotlight/spotlight.spec.ts:132:9 › Spotlight › should find known public rooms ───── Error: Timed out 5000ms waiting for expect(locator).toHaveCount(expected) Locator: locator('[role=dialog][aria-label="Search Dialog"]').locator('.mx_SpotlightDialog_section.mx_SpotlightDialog_results .mx_SpotlightDialog_option') Expected: 1 Received: 3 Call log: - expect.toHaveCount with timeout 5000ms - waiting for locator('[role=dialog][aria-label="Search Dialog"]').locator('.mx_SpotlightDialog_section.mx_SpotlightDialog_results .mx_SpotlightDialog_option') 2 × locator resolved to 0 elements - unexpected value "0" 7 × locator resolved to 3 elements - unexpected value "3" 136 | await spotlight.search(room1Name); 137 | const resultLocator = spotlight.results; > 138 | await expect(resultLocator).toHaveCount(1); | ^ 139 | await expect(resultLocator.first()).toContainText(room1Name); 140 | await expect(resultLocator.first()).toContainText("View"); 141 | await resultLocator.first().click(); at /home/runner/work/element-web/element-web/playwright/e2e/spotlight/spotlight.spec.ts:138:37

[Chrome] › messages/messages.spec.ts took 58.2s

[Chrome] › pinned-messages/pinned-messages.spec.ts took 56.7s

[Chrome] › read-receipts/editing-messages-in-threads.spec.ts took 38.0s

[Chrome] › read-receipts/editing-messages-main-timeline.spec.ts took 37.7s

[Chrome] › invite/invite-dialog.spec.ts took 32.2s

[Chrome] › read-receipts/high-level.spec.ts took 2.6m

[Chrome] › read-receipts/new-messages-in-threads.spec.ts took 57.3s

[Chrome] › read-receipts/editing-messages-thread-roots.spec.ts took 45.8s

[Chrome] › read-receipts/new-messages-main-timeline.spec.ts took 38.9s

[Chrome] › read-receipts/redactions-in-threads.spec.ts took 1.5m

[Chrome] › read-receipts/reactions-in-threads.spec.ts took 47.5s

[Chrome] › read-receipts/read-receipts.spec.ts took 39.9s

[Chrome] › read-receipts/redactions-thread-roots.spec.ts took 30.6s

[Chrome] › right-panel/right-panel.spec.ts took 23.5s

[Chrome] › crypto/event-shields.spec.ts took 52.8s

[Chrome] › composer/RTE.spec.ts took 35.7s

[Chrome] › crypto/crypto.spec.ts took 34.3s

[Chrome] › crypto/decryption-failure-messages.spec.ts took 28.5s

[Chrome] › accessibility/keyboard-navigation.spec.ts took 25.8s

[Chrome] › timeline/timeline.spec.ts took 1.3m

[Chrome] › threads/threads.spec.ts took 24.5s

[Chrome] › user-onboarding/user-onboarding-new.spec.ts took 24.2s

[Chrome] › app-loading/guest-registration.spec.ts took 18.9s

[Chrome] › register/register.spec.ts took 16.8s

[Chrome] › sliding-sync/sliding-sync.spec.ts took 52.8s

[Chrome] › spaces/threads-activity-centre/threadsActivityCentre.spec.ts took 47.1s

[Chrome] › spaces/spaces.spec.ts took 30.6s

[Chrome] › settings/account-user-settings-tab.spec.ts took 16.8s

2 skipped 73 passed (5.7m)

1 flaky [Chrome] › read-receipts/new-messages-thread-roots.spec.ts:35:17 › Read receipts › new messages › thread roots › Reading a thread root within the thread view marks it as read in the main timeline @mergequeue 43 skipped 38 passed (6.0m)

1 flaky [Chrome] › read-receipts/redactions-main-timeline.spec.ts:162:17 › Read receipts › redactions › in the main timeline › Redacting one of the unread messages reduces the unread count after restart @mergequeue 3 skipped 73 passed (6.7m)

2 flaky [Chrome] › audio-player/audio-player.spec.ts:168:9 › Audio player › should be correctly rendered - dark theme @no-firefox @no-webkit @screenshot [Chrome] › audio-player/audio-player.spec.ts:243:9 › Audio player › should support creating a reply chain with multiple audio files @no-firefox @no-webkit @screenshot 80 passed (7.9m)

10 flaky [Chrome] › crypto/backups-mas.spec.ts:31:9 › Encryption state after registration › user is prompted to set up recovery [Chrome] › crypto/backups-mas.spec.ts:48:9 › Key backup reset from elsewhere › Key backup is disabled when reset from elsewhere [Chrome] › login/login-consent.spec.ts:147:13 › Login › Password login › Follows the original link after login [Chrome] › login/login-consent.spec.ts:156:17 › Login › Password login › verification after login › Shows verification prompt after login if signing keys are set up, skippable by default [Chrome] › login/login-consent.spec.ts:186:21 › Login › Password login › verification after login › with force_verification off › Shows skippable verification prompt after login if signing keys are set up [Chrome] › login/login-consent.spec.ts:220:21 › Login › Password login › verification after login › with force_verification on › Shows unskippable verification prompt after login if signing keys are set up [Chrome] › login/login-consent.spec.ts:252:13 › Login › logout › should go to login page on logout [Chrome] › login/soft_logout_oauth.spec.ts:40:9 › Soft logout with SSO user › shows the soft-logout page when a request fails, and allows a re-login [Chrome] › oidc/oidc-native.spec.ts:20:9 › OIDC Native › can register the oauth2 client and an account @no-firefox @no-webkit [Chrome] › register/email.spec.ts:34:9 › Email Registration › registers an account and lands on the use case selection screen @screenshot 2 skipped 57 passed (10.3m)