Skip to content
This repository has been archived by the owner on Sep 11, 2024. It is now read-only.

End to End Tests

End to End Tests #8739

Triggered via workflow run April 18, 2024 21:58
@t3chguyt3chguy
completed 2c848d7
Status Failure
Total duration 18m 29s
Artifacts 9

end-to-end-tests.yaml

on: workflow_run
Prepare
2s
Prepare
Matrix: tests
Report results
52s
Report results
Fit to window
Zoom out
Zoom in

Annotations

14 errors, 7 warnings, and 1 notice
Run Tests 8/8
The process '/usr/bin/xvfb-run' failed with exit code 1
Run Tests 4/8
The process '/usr/bin/xvfb-run' failed with exit code 1
Run Tests 7/8
The process '/usr/bin/xvfb-run' failed with exit code 1
Run Tests 3/8
The process '/usr/bin/xvfb-run' failed with exit code 1
[Legacy Crypto] › register/register.spec.ts:26:9 › Registration › registers an account and lands on the home screen: matrix-react-sdk/playwright/e2e/register/register.spec.ts#L30
1) [Legacy Crypto] › register/register.spec.ts:26:9 › Registration › registers an account and lands on the home screen Error: Screenshot comparison failed: Expected an image 548px by 454px, received 548px by 456px. 4884 pixels (ratio 0.02 of all image pixels) are different. Expected: /home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/snapshots/register/register.spec.ts/server-picker-linux.png Received: /home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/test-results/register-register-Registra-495ef-nd-lands-on-the-home-screen-Legacy-Crypto/server-picker-actual.png Diff: /home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/test-results/register-register-Registra-495ef-nd-lands-on-the-home-screen-Legacy-Crypto/server-picker-diff.png Call log: - page._expectScreenshot with timeout 5000ms - verifying given screenshot expectation - waiting for locator('.mx_Dialog') - locator resolved to <div class="mx_Dialog">…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - Expected an image 548px by 454px, received 548px by 456px. 4647 pixels (ratio 0.02 of all image pixels) are different. - waiting 100ms before taking screenshot - waiting for locator('.mx_Dialog') - locator resolved to <div class="mx_Dialog">…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - 266 pixels (ratio 0.01 of all image pixels) are different. - waiting 250ms before taking screenshot - waiting for locator('.mx_Dialog') - locator resolved to <div class="mx_Dialog">…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - captured a stable screenshot - Expected an image 548px by 454px, received 548px by 456px. 4884 pixels (ratio 0.02 of all image pixels) are different. 28 | await expect(page.getByRole("button", { name: "Continue", exact: true })).toBeVisible(); 29 | > 30 | await expect(page.locator(".mx_Dialog")).toMatchScreenshot("server-picker.png"); | ^ 31 | await checkA11y(); 32 | 33 | await page.getByRole("textbox", { name: "Other homeserver" }).fill(homeserver.config.baseUrl); at /home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/e2e/register/register.spec.ts:30:50
[Legacy Crypto] › register/register.spec.ts:26:9 › Registration › registers an account and lands on the home screen: matrix-react-sdk/playwright/e2e/register/register.spec.ts#L30
1) [Legacy Crypto] › register/register.spec.ts:26:9 › Registration › registers an account and lands on the home screen Retry #1 ─────────────────────────────────────────────────────────────────────────────────────── Error: Screenshot comparison failed: Expected an image 548px by 454px, received 548px by 456px. 4884 pixels (ratio 0.02 of all image pixels) are different. Expected: /home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/snapshots/register/register.spec.ts/server-picker-linux.png Received: /home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/test-results/register-register-Registra-495ef-nd-lands-on-the-home-screen-Legacy-Crypto-retry1/server-picker-actual.png Diff: /home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/test-results/register-register-Registra-495ef-nd-lands-on-the-home-screen-Legacy-Crypto-retry1/server-picker-diff.png Call log: - page._expectScreenshot with timeout 5000ms - verifying given screenshot expectation - waiting for locator('.mx_Dialog') - locator resolved to <div class="mx_Dialog">…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - Expected an image 548px by 454px, received 548px by 456px. 4678 pixels (ratio 0.02 of all image pixels) are different. - waiting 100ms before taking screenshot - waiting for locator('.mx_Dialog') - locator resolved to <div class="mx_Dialog">…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - 265 pixels (ratio 0.01 of all image pixels) are different. - waiting 250ms before taking screenshot - waiting for locator('.mx_Dialog') - locator resolved to <div class="mx_Dialog">…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - captured a stable screenshot - Expected an image 548px by 454px, received 548px by 456px. 4884 pixels (ratio 0.02 of all image pixels) are different. 28 | await expect(page.getByRole("button", { name: "Continue", exact: true })).toBeVisible(); 29 | > 30 | await expect(page.locator(".mx_Dialog")).toMatchScreenshot("server-picker.png"); | ^ 31 | await checkA11y(); 32 | 33 | await page.getByRole("textbox", { name: "Other homeserver" }).fill(homeserver.config.baseUrl); at /home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/e2e/register/register.spec.ts:30:50
[Legacy Crypto] › register/register.spec.ts:26:9 › Registration › registers an account and lands on the home screen: matrix-react-sdk/playwright/e2e/register/register.spec.ts#L30
1) [Legacy Crypto] › register/register.spec.ts:26:9 › Registration › registers an account and lands on the home screen Retry #2 ─────────────────────────────────────────────────────────────────────────────────────── Error: Screenshot comparison failed: Expected an image 548px by 454px, received 548px by 456px. 4884 pixels (ratio 0.02 of all image pixels) are different. Expected: /home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/snapshots/register/register.spec.ts/server-picker-linux.png Received: /home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/test-results/register-register-Registra-495ef-nd-lands-on-the-home-screen-Legacy-Crypto-retry2/server-picker-actual.png Diff: /home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/test-results/register-register-Registra-495ef-nd-lands-on-the-home-screen-Legacy-Crypto-retry2/server-picker-diff.png Call log: - page._expectScreenshot with timeout 5000ms - verifying given screenshot expectation - waiting for locator('.mx_Dialog') - locator resolved to <div class="mx_Dialog">…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - Expected an image 548px by 454px, received 548px by 456px. 4647 pixels (ratio 0.02 of all image pixels) are different. - waiting 100ms before taking screenshot - waiting for locator('.mx_Dialog') - locator resolved to <div class="mx_Dialog">…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - 266 pixels (ratio 0.01 of all image pixels) are different. - waiting 250ms before taking screenshot - waiting for locator('.mx_Dialog') - locator resolved to <div class="mx_Dialog">…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - captured a stable screenshot - Expected an image 548px by 454px, received 548px by 456px. 4884 pixels (ratio 0.02 of all image pixels) are different. 28 | await expect(page.getByRole("button", { name: "Continue", exact: true })).toBeVisible(); 29 | > 30 | await expect(page.locator(".mx_Dialog")).toMatchScreenshot("server-picker.png"); | ^ 31 | await checkA11y(); 32 | 33 | await page.getByRole("textbox", { name: "Other homeserver" }).fill(homeserver.config.baseUrl); at /home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/e2e/register/register.spec.ts:30:50
[Legacy Crypto] › settings/appearance-user-settings-tab.spec.ts:25:9 › Appearance user settings tab › should be rendered properly: matrix-react-sdk/playwright/e2e/settings/appearance-user-settings-tab.spec.ts#L36
2) [Legacy Crypto] › settings/appearance-user-settings-tab.spec.ts:25:9 › Appearance user settings tab › should be rendered properly Error: Screenshot comparison failed: 982 pixels (ratio 0.01 of all image pixels) are different. Expected: /home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/snapshots/settings/appearance-user-settings-tab.spec.ts/appearance-tab-linux.png Received: /home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/test-results/settings-appearance-user-s-a0ff3-should-be-rendered-properly-Legacy-Crypto/appearance-tab-actual.png Diff: /home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/test-results/settings-appearance-user-s-a0ff3-should-be-rendered-properly-Legacy-Crypto/appearance-tab-diff.png Call log: - page._expectScreenshot with timeout 5000ms - verifying given screenshot expectation - waiting for locator('.mx_Dialog').filter({ has: locator('.mx_UserSettingsDialog') }) - locator resolved to <div class="mx_Dialog">…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - 982 pixels (ratio 0.01 of all image pixels) are different. - waiting 100ms before taking screenshot - waiting for locator('.mx_Dialog').filter({ has: locator('.mx_UserSettingsDialog') }) - locator resolved to <div class="mx_Dialog">…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - captured a stable screenshot - 982 pixels (ratio 0.01 of all image pixels) are different. 34 | await expect(tab.getByRole("button", { name: "Hide advanced" })).toBeVisible(); 35 | > 36 | await expect(tab).toMatchScreenshot("appearance-tab.png"); | ^ 37 | }); 38 | 39 | test("should support switching layouts", async ({ page, user, app }) => { at /home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/e2e/settings/appearance-user-settings-tab.spec.ts:36:27
[Legacy Crypto] › settings/appearance-user-settings-tab.spec.ts:25:9 › Appearance user settings tab › should be rendered properly: matrix-react-sdk/playwright/e2e/settings/appearance-user-settings-tab.spec.ts#L36
2) [Legacy Crypto] › settings/appearance-user-settings-tab.spec.ts:25:9 › Appearance user settings tab › should be rendered properly Retry #1 ─────────────────────────────────────────────────────────────────────────────────────── Error: Screenshot comparison failed: 982 pixels (ratio 0.01 of all image pixels) are different. Expected: /home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/snapshots/settings/appearance-user-settings-tab.spec.ts/appearance-tab-linux.png Received: /home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/test-results/settings-appearance-user-s-a0ff3-should-be-rendered-properly-Legacy-Crypto-retry1/appearance-tab-actual.png Diff: /home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/test-results/settings-appearance-user-s-a0ff3-should-be-rendered-properly-Legacy-Crypto-retry1/appearance-tab-diff.png Call log: - page._expectScreenshot with timeout 5000ms - verifying given screenshot expectation - waiting for locator('.mx_Dialog').filter({ has: locator('.mx_UserSettingsDialog') }) - locator resolved to <div class="mx_Dialog">…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - 982 pixels (ratio 0.01 of all image pixels) are different. - waiting 100ms before taking screenshot - waiting for locator('.mx_Dialog').filter({ has: locator('.mx_UserSettingsDialog') }) - locator resolved to <div class="mx_Dialog">…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - captured a stable screenshot - 982 pixels (ratio 0.01 of all image pixels) are different. 34 | await expect(tab.getByRole("button", { name: "Hide advanced" })).toBeVisible(); 35 | > 36 | await expect(tab).toMatchScreenshot("appearance-tab.png"); | ^ 37 | }); 38 | 39 | test("should support switching layouts", async ({ page, user, app }) => { at /home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/e2e/settings/appearance-user-settings-tab.spec.ts:36:27
[Legacy Crypto] › settings/appearance-user-settings-tab.spec.ts:25:9 › Appearance user settings tab › should be rendered properly: matrix-react-sdk/playwright/e2e/settings/appearance-user-settings-tab.spec.ts#L36
2) [Legacy Crypto] › settings/appearance-user-settings-tab.spec.ts:25:9 › Appearance user settings tab › should be rendered properly Retry #2 ─────────────────────────────────────────────────────────────────────────────────────── Error: Screenshot comparison failed: 982 pixels (ratio 0.01 of all image pixels) are different. Expected: /home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/snapshots/settings/appearance-user-settings-tab.spec.ts/appearance-tab-linux.png Received: /home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/test-results/settings-appearance-user-s-a0ff3-should-be-rendered-properly-Legacy-Crypto-retry2/appearance-tab-actual.png Diff: /home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/test-results/settings-appearance-user-s-a0ff3-should-be-rendered-properly-Legacy-Crypto-retry2/appearance-tab-diff.png Call log: - page._expectScreenshot with timeout 5000ms - verifying given screenshot expectation - waiting for locator('.mx_Dialog').filter({ has: locator('.mx_UserSettingsDialog') }) - locator resolved to <div class="mx_Dialog">…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - 982 pixels (ratio 0.01 of all image pixels) are different. - waiting 100ms before taking screenshot - waiting for locator('.mx_Dialog').filter({ has: locator('.mx_UserSettingsDialog') }) - locator resolved to <div class="mx_Dialog">…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - captured a stable screenshot - 982 pixels (ratio 0.01 of all image pixels) are different. 34 | await expect(tab.getByRole("button", { name: "Hide advanced" })).toBeVisible(); 35 | > 36 | await expect(tab).toMatchScreenshot("appearance-tab.png"); | ^ 37 | }); 38 | 39 | test("should support switching layouts", async ({ page, user, app }) => { at /home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/e2e/settings/appearance-user-settings-tab.spec.ts:36:27
[Legacy Crypto] › settings/general-room-settings-tab.spec.ts:31:9 › General room settings tab › should be rendered properly: matrix-react-sdk/playwright/e2e/settings/general-room-settings-tab.spec.ts#L37
3) [Legacy Crypto] › settings/general-room-settings-tab.spec.ts:31:9 › General room settings tab › should be rendered properly Error: Screenshot comparison failed: 11178 pixels (ratio 0.02 of all image pixels) are different. Expected: /home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/snapshots/settings/general-room-settings-tab.spec.ts/General-room-settings-tab-should-be-rendered-properly-1-linux.png Received: /home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/test-results/settings-general-room-sett-fdda5-should-be-rendered-properly-Legacy-Crypto/General-room-settings-tab-should-be-rendered-properly-1-actual.png Diff: /home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/test-results/settings-general-room-sett-fdda5-should-be-rendered-properly-Legacy-Crypto/General-room-settings-tab-should-be-rendered-properly-1-diff.png Call log: - page._expectScreenshot with timeout 5000ms - verifying given screenshot expectation - waiting for locator('.mx_Dialog').filter({ has: locator('.mx_RoomSettingsDialog') }) - locator resolved to <div class="mx_Dialog">…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - 11178 pixels (ratio 0.02 of all image pixels) are different. - waiting 100ms before taking screenshot - waiting for locator('.mx_Dialog').filter({ has: locator('.mx_RoomSettingsDialog') }) - locator resolved to <div class="mx_Dialog">…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - captured a stable screenshot - 11178 pixels (ratio 0.02 of all image pixels) are different. 35 | await expect(settings.getByText("Show less")).toBeVisible(); 36 | > 37 | await expect(settings).toMatchScreenshot(); | ^ 38 | 39 | // Click the "Show less" details element 40 | await settings.getByText("Show less").click(); at /home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/e2e/settings/general-room-settings-tab.spec.ts:37:32
[Legacy Crypto] › settings/general-room-settings-tab.spec.ts:31:9 › General room settings tab › should be rendered properly: matrix-react-sdk/playwright/e2e/settings/general-room-settings-tab.spec.ts#L37
3) [Legacy Crypto] › settings/general-room-settings-tab.spec.ts:31:9 › General room settings tab › should be rendered properly Retry #1 ─────────────────────────────────────────────────────────────────────────────────────── Error: Screenshot comparison failed: 11178 pixels (ratio 0.02 of all image pixels) are different. Expected: /home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/snapshots/settings/general-room-settings-tab.spec.ts/General-room-settings-tab-should-be-rendered-properly-1-linux.png Received: /home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/test-results/settings-general-room-sett-fdda5-should-be-rendered-properly-Legacy-Crypto-retry1/General-room-settings-tab-should-be-rendered-properly-1-actual.png Diff: /home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/test-results/settings-general-room-sett-fdda5-should-be-rendered-properly-Legacy-Crypto-retry1/General-room-settings-tab-should-be-rendered-properly-1-diff.png Call log: - page._expectScreenshot with timeout 5000ms - verifying given screenshot expectation - waiting for locator('.mx_Dialog').filter({ has: locator('.mx_RoomSettingsDialog') }) - locator resolved to <div class="mx_Dialog">…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - 11178 pixels (ratio 0.02 of all image pixels) are different. - waiting 100ms before taking screenshot - waiting for locator('.mx_Dialog').filter({ has: locator('.mx_RoomSettingsDialog') }) - locator resolved to <div class="mx_Dialog">…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - captured a stable screenshot - 11178 pixels (ratio 0.02 of all image pixels) are different. 35 | await expect(settings.getByText("Show less")).toBeVisible(); 36 | > 37 | await expect(settings).toMatchScreenshot(); | ^ 38 | 39 | // Click the "Show less" details element 40 | await settings.getByText("Show less").click(); at /home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/e2e/settings/general-room-settings-tab.spec.ts:37:32
[Legacy Crypto] › settings/general-room-settings-tab.spec.ts:31:9 › General room settings tab › should be rendered properly: matrix-react-sdk/playwright/e2e/settings/general-room-settings-tab.spec.ts#L37
3) [Legacy Crypto] › settings/general-room-settings-tab.spec.ts:31:9 › General room settings tab › should be rendered properly Retry #2 ─────────────────────────────────────────────────────────────────────────────────────── Error: Screenshot comparison failed: 11178 pixels (ratio 0.02 of all image pixels) are different. Expected: /home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/snapshots/settings/general-room-settings-tab.spec.ts/General-room-settings-tab-should-be-rendered-properly-1-linux.png Received: /home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/test-results/settings-general-room-sett-fdda5-should-be-rendered-properly-Legacy-Crypto-retry2/General-room-settings-tab-should-be-rendered-properly-1-actual.png Diff: /home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/test-results/settings-general-room-sett-fdda5-should-be-rendered-properly-Legacy-Crypto-retry2/General-room-settings-tab-should-be-rendered-properly-1-diff.png Call log: - page._expectScreenshot with timeout 5000ms - verifying given screenshot expectation - waiting for locator('.mx_Dialog').filter({ has: locator('.mx_RoomSettingsDialog') }) - locator resolved to <div class="mx_Dialog">…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - 11178 pixels (ratio 0.02 of all image pixels) are different. - waiting 100ms before taking screenshot - waiting for locator('.mx_Dialog').filter({ has: locator('.mx_RoomSettingsDialog') }) - locator resolved to <div class="mx_Dialog">…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - captured a stable screenshot - 11178 pixels (ratio 0.02 of all image pixels) are different. 35 | await expect(settings.getByText("Show less")).toBeVisible(); 36 | > 37 | await expect(settings).toMatchScreenshot(); | ^ 38 | 39 | // Click the "Show less" details element 40 | await settings.getByText("Show less").click(); at /home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/e2e/settings/general-room-settings-tab.spec.ts:37:32
[Legacy Crypto] › settings/general-user-settings-tab.spec.ts:37:9 › General user settings tab › should be rendered properly: matrix-react-sdk/playwright/e2e/settings/general-user-settings-tab.spec.ts#L38
4) [Legacy Crypto] › settings/general-user-settings-tab.spec.ts:37:9 › General user settings tab › should be rendered properly Error: Screenshot comparison failed: 13170 pixels (ratio 0.02 of all image pixels) are different. Expected: /home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/snapshots/settings/general-user-settings-tab.spec.ts/general-linux.png Received: /home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/test-results/settings-general-user-sett-200fc-should-be-rendered-properly-Legacy-Crypto/general-actual.png Diff: /home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/test-results/settings-general-user-sett-200fc-should-be-rendered-properly-Legacy-Crypto/general-diff.png Call log: - page._expectScreenshot with timeout 5000ms - verifying given screenshot expectation - waiting for locator('.mx_Dialog').filter({ has: locator('.mx_UserSettingsDialog') }) - locator resolved to <div class="mx_Dialog">…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - 13170 pixels (ratio 0.02 of all image pixels) are different. - waiting 100ms before taking screenshot - waiting for locator('.mx_Dialog').filter({ has: locator('.mx_UserSettingsDialog') }) - locator resolved to <div class="mx_Dialog">…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - captured a stable screenshot - 13170 pixels (ratio 0.02 of all image pixels) are different. 36 | 37 | test("should be rendered properly", async ({ uut }) => { > 38 | await expect(uut).toMatchScreenshot("general.png"); | ^ 39 | 40 | // Assert that the top heading is rendered 41 | await expect(uut.getByRole("heading", { name: "General" })).toBeVisible(); at /home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/e2e/settings/general-user-settings-tab.spec.ts:38:27
Prepare
Node.js 16 actions are deprecated. Please update the following actions to use Node.js 20: Sibz/github-status-action@071b5370da85afbb16637d6eed8524a06bc2053e. For more information see: https://github.blog/changelog/2023-09-22-github-actions-transitioning-from-node-16-to-node-20/.
Report results
Node.js 16 actions are deprecated. Please update the following actions to use Node.js 20: Sibz/github-status-action@071b5370da85afbb16637d6eed8524a06bc2053e, bobheadxi/deployments@88ce5600046c82542f8246ac287d0a53c461bca3, actions/github-script@v6, nwtgck/actions-netlify@7a92f00dde8c92a5a9e8385ec2919775f7647352. For more information see: https://github.blog/changelog/2023-09-22-github-actions-transitioning-from-node-16-to-node-20/.
Slow Test: [Rust Crypto] › read-receipts/redactions.spec.ts#L1
[Rust Crypto] › read-receipts/redactions.spec.ts took 5.8m
Slow Test: [Legacy Crypto] › read-receipts/redactions.spec.ts#L1
[Legacy Crypto] › read-receipts/redactions.spec.ts took 5.7m
Slow Test: [Rust Crypto] › read-receipts/new-messages.spec.ts#L1
[Rust Crypto] › read-receipts/new-messages.spec.ts took 3.8m
Slow Test: [Rust Crypto] › read-receipts/high-level.spec.ts#L1
[Rust Crypto] › read-receipts/high-level.spec.ts took 3.7m
Slow Test: [Legacy Crypto] › read-receipts/new-messages.spec.ts#L1
[Legacy Crypto] › read-receipts/new-messages.spec.ts took 3.5m
🎭 Playwright Run Summary
10 failed [Legacy Crypto] › register/register.spec.ts:26:9 › Registration › registers an account and lands on the home screen [Legacy Crypto] › settings/appearance-user-settings-tab.spec.ts:25:9 › Appearance user settings tab › should be rendered properly [Legacy Crypto] › settings/general-room-settings-tab.spec.ts:31:9 › General room settings tab › should be rendered properly [Legacy Crypto] › settings/general-user-settings-tab.spec.ts:37:9 › General user settings tab › should be rendered properly [Legacy Crypto] › spaces/spaces.spec.ts:99:9 › Spaces › should allow user to create private space [Rust Crypto] › register/register.spec.ts:26:9 › Registration › registers an account and lands on the home screen [Rust Crypto] › settings/appearance-user-settings-tab.spec.ts:25:9 › Appearance user settings tab › should be rendered properly [Rust Crypto] › settings/general-room-settings-tab.spec.ts:31:9 › General room settings tab › should be rendered properly [Rust Crypto] › settings/general-user-settings-tab.spec.ts:37:9 › General user settings tab › should be rendered properly [Rust Crypto] › spaces/spaces.spec.ts:99:9 › Spaces › should allow user to create private space 3 flaky [Legacy Crypto] › user-onboarding/user-onboarding-new.spec.ts:43:9 › User Onboarding (new user) › app download dialog [Rust Crypto] › audio-player/audio-player.spec.ts:156:9 › Audio player › should be correctly rendered - high contrast theme [Rust Crypto] › login/overwrite_login.spec.ts:21:9 › Overwrite login action › Try replace existing login with new one 124 skipped 665 passed (15.9m)

Artifacts

Produced during runtime
Name Size
all-blob-reports-1 Expired
1.06 MB
all-blob-reports-2 Expired
603 KB
all-blob-reports-3 Expired
9.31 MB
all-blob-reports-4 Expired
20.2 MB
all-blob-reports-5 Expired
7.64 MB
all-blob-reports-6 Expired
580 KB
all-blob-reports-7 Expired
9.22 MB
all-blob-reports-8 Expired
12.7 MB
html-report--attempt-1 Expired
54.2 MB