Custom env variables #12
galata.yml
on: pull_request
Visual Regression Tests
46m 33s
Matrix: Visual Regression Documentation
Annotations
20 errors and 2 notices
|
[documentation] › test/documentation/general.test.ts:20:7 › General › Welcome:
core/galata/test/documentation/general.test.ts#L1
1) [documentation] › test/documentation/general.test.ts:20:7 › General › Welcome ─────────────────
Test timeout of 90000ms exceeded.
|
|
[documentation] › test/documentation/general.test.ts:20:7 › General › Welcome:
core/galata/test/documentation/general.test.ts#L50
1) [documentation] › test/documentation/general.test.ts:20:7 › General › Welcome ─────────────────
Error: proxy.click: Test timeout of 90000ms exceeded.
Call log:
- waiting for locator('button:has-text("Select")')
48 | await page.click('.lm-Menu ul[role="menu"] >> text=New');
49 | await page.click('#jp-mainmenu-file-new >> text=Console');
> 50 | await page.click('button:has-text("Select")');
| ^
51 |
52 | await page.dblclick('text=Data.ipynb');
53 |
at /home/runner/work/jupyterlab/jupyterlab/core/galata/test/documentation/general.test.ts:50:16
|
|
[documentation] › test/documentation/general.test.ts:20:7 › General › Welcome:
core/galata/test/documentation/general.test.ts#L1
1) [documentation] › test/documentation/general.test.ts:20:7 › General › Welcome ─────────────────
Retry #1 ───────────────────────────────────────────────────────────────────────────────────────
Test timeout of 90000ms exceeded.
|
|
[documentation] › test/documentation/general.test.ts:20:7 › General › Welcome:
core/galata/test/documentation/general.test.ts#L50
1) [documentation] › test/documentation/general.test.ts:20:7 › General › Welcome ─────────────────
Retry #1 ───────────────────────────────────────────────────────────────────────────────────────
Error: proxy.click: Test timeout of 90000ms exceeded.
Call log:
- waiting for locator('button:has-text("Select")')
48 | await page.click('.lm-Menu ul[role="menu"] >> text=New');
49 | await page.click('#jp-mainmenu-file-new >> text=Console');
> 50 | await page.click('button:has-text("Select")');
| ^
51 |
52 | await page.dblclick('text=Data.ipynb');
53 |
at /home/runner/work/jupyterlab/jupyterlab/core/galata/test/documentation/general.test.ts:50:16
|
|
[documentation] › test/documentation/general.test.ts:20:7 › General › Welcome:
core/galata/test/documentation/general.test.ts#L1
1) [documentation] › test/documentation/general.test.ts:20:7 › General › Welcome ─────────────────
Retry #2 ───────────────────────────────────────────────────────────────────────────────────────
Test timeout of 90000ms exceeded.
|
|
[documentation] › test/documentation/general.test.ts:20:7 › General › Welcome:
core/galata/test/documentation/general.test.ts#L50
1) [documentation] › test/documentation/general.test.ts:20:7 › General › Welcome ─────────────────
Retry #2 ───────────────────────────────────────────────────────────────────────────────────────
Error: proxy.click: Test timeout of 90000ms exceeded.
Call log:
- waiting for locator('button:has-text("Select")')
48 | await page.click('.lm-Menu ul[role="menu"] >> text=New');
49 | await page.click('#jp-mainmenu-file-new >> text=Console');
> 50 | await page.click('button:has-text("Select")');
| ^
51 |
52 | await page.dblclick('text=Data.ipynb');
53 |
at /home/runner/work/jupyterlab/jupyterlab/core/galata/test/documentation/general.test.ts:50:16
|
|
[documentation] › test/documentation/customization.test.ts:17:7 › Default › should use default layout:
core/galata/test/documentation/customization.test.ts#L32
2) [documentation] › test/documentation/customization.test.ts:17:7 › Default › should use default layout
Error: Screenshot comparison failed:
1307 pixels (ratio 0.01 of all image pixels) are different.
Expected: /home/runner/work/jupyterlab/jupyterlab/core/galata/test/documentation/customization.test.ts-snapshots/default-terminal-position-single-documentation-linux.png
Received: /home/runner/work/jupyterlab/jupyterlab/core/galata/test-results/test-documentation-customi-38159-t-should-use-default-layout-documentation/default-terminal-position-single-actual.png
Diff: /home/runner/work/jupyterlab/jupyterlab/core/galata/test-results/test-documentation-customi-38159-t-should-use-default-layout-documentation/default-terminal-position-single-diff.png
30 | await page.locator('.jp-Terminal').waitFor();
31 |
> 32 | expect(await page.screenshot()).toMatchSnapshot(
| ^
33 | 'default-terminal-position-single.png'
34 | );
35 | });
at /home/runner/work/jupyterlab/jupyterlab/core/galata/test/documentation/customization.test.ts:32:37
|
|
[documentation] › test/documentation/debugger.test.ts:126:7 › Debugger › Breakpoints on exception:
core/galata/test/documentation/debugger.test.ts#L189
3) [documentation] › test/documentation/debugger.test.ts:126:7 › Debugger › Breakpoints on exception
Error: Screenshot comparison failed:
366 pixels (ratio 0.02 of all image pixels) are different.
Expected: /home/runner/work/jupyterlab/jupyterlab/core/galata/test/documentation/debugger.test.ts-snapshots/debugger-stop-on-raised-exception-documentation-linux.png
Received: /home/runner/work/jupyterlab/jupyterlab/core/galata/test-results/test-documentation-debugge-b2db7-er-Breakpoints-on-exception-documentation/debugger-stop-on-raised-exception-actual.png
Diff: /home/runner/work/jupyterlab/jupyterlab/core/galata/test-results/test-documentation-debugge-b2db7-er-Breakpoints-on-exception-documentation/debugger-stop-on-raised-exception-diff.png
187 | clip: { y: 110, x: 300, width: 300, height: 80 }
188 | })
> 189 | ).toMatchSnapshot('debugger_stop_on_raised_exception.png');
| ^
190 | await page.click('jp-button[title^=Continue]');
191 | await page.click('jp-button[title^=Continue]');
192 | });
at /home/runner/work/jupyterlab/jupyterlab/core/galata/test/documentation/debugger.test.ts:189:7
|
|
[documentation] › test/documentation/debugger.test.ts:126:7 › Debugger › Breakpoints on exception:
core/galata/src/helpers/notebook.ts#L456
3) [documentation] › test/documentation/debugger.test.ts:126:7 › Debugger › Breakpoints on exception
Error: page.waitForTimeout: Test ended.
at src/helpers/notebook.ts:456
454 | let done = false;
455 | do {
> 456 | await this.page.waitForTimeout(20);
| ^
457 | done = await this.page.evaluate(cellIdx => {
458 | return window.galata.haveBeenExecuted(cellIdx);
459 | }, cellIndex);
at NotebookHelper.waitForRun (/home/runner/work/jupyterlab/jupyterlab/core/galata/src/helpers/notebook.ts:456:23)
at NotebookHelper.runCell (/home/runner/work/jupyterlab/jupyterlab/core/galata/src/helpers/notebook.ts:1411:5)
|
|
Visual Regression Documentation (3.10.6)
Process completed with exit code 1.
|
|
[galata] › test/galata/filebrowser.spec.ts:26:7 › filebrowser helper › should activate already opened file:
galata/test/galata/filebrowser.spec.ts#L1
1) [galata] › test/galata/filebrowser.spec.ts:26:7 › filebrowser helper › should activate already opened file
Test timeout of 60000ms exceeded.
|
|
[galata] › test/galata/filebrowser.spec.ts:26:7 › filebrowser helper › should activate already opened file:
galata/test/galata/filebrowser.spec.ts#L32
1) [galata] › test/galata/filebrowser.spec.ts:26:7 › filebrowser helper › should activate already opened file
Error: locator.click: Test timeout of 60000ms exceeded.
Call log:
- waiting for locator('.jp-Dialog').getByRole('button', { name: 'Select Kernel', exact: true })
30 | .locator('.jp-Dialog')
31 | .getByRole('button', { name: 'Select Kernel', exact: true })
> 32 | .click();
| ^
33 |
34 | expect.soft(await page.activity.isTabActive(DEFAULT_NAME)).toEqual(false);
35 | await page.filebrowser.open(DEFAULT_NAME);
at /home/runner/work/jupyterlab/jupyterlab/galata/test/galata/filebrowser.spec.ts:32:8
|
|
[galata] › test/galata/filebrowser.spec.ts:26:7 › filebrowser helper › should activate already opened file:
galata/test/galata/filebrowser.spec.ts#L1
1) [galata] › test/galata/filebrowser.spec.ts:26:7 › filebrowser helper › should activate already opened file
Retry #1 ───────────────────────────────────────────────────────────────────────────────────────
Test timeout of 60000ms exceeded.
|
|
[galata] › test/galata/filebrowser.spec.ts:26:7 › filebrowser helper › should activate already opened file:
galata/test/galata/filebrowser.spec.ts#L32
1) [galata] › test/galata/filebrowser.spec.ts:26:7 › filebrowser helper › should activate already opened file
Retry #1 ───────────────────────────────────────────────────────────────────────────────────────
Error: locator.click: Test timeout of 60000ms exceeded.
Call log:
- waiting for locator('.jp-Dialog').getByRole('button', { name: 'Select Kernel', exact: true })
30 | .locator('.jp-Dialog')
31 | .getByRole('button', { name: 'Select Kernel', exact: true })
> 32 | .click();
| ^
33 |
34 | expect.soft(await page.activity.isTabActive(DEFAULT_NAME)).toEqual(false);
35 | await page.filebrowser.open(DEFAULT_NAME);
at /home/runner/work/jupyterlab/jupyterlab/galata/test/galata/filebrowser.spec.ts:32:8
|
|
[galata] › test/galata/fixture.spec.ts:109:7 › kernels › should return the active kernels:
galata/test/galata/fixture.spec.ts#L1
2) [galata] › test/galata/fixture.spec.ts:109:7 › kernels › should return the active kernels ─────
Test timeout of 60000ms exceeded.
|
|
[galata] › test/galata/fixture.spec.ts:109:7 › kernels › should return the active kernels:
galata/test/galata/fixture.spec.ts#L130
2) [galata] › test/galata/fixture.spec.ts:109:7 › kernels › should return the active kernels ─────
Error: locator.waitFor: Test timeout of 60000ms exceeded.
Call log:
- waiting for locator('.jp-Dialog') to be visible
128 |
129 | await page.menu.clickMenuItem('File>New>Console');
> 130 | await page.locator('.jp-Dialog').waitFor();
| ^
131 | await page.click('.jp-Dialog .jp-mod-accept');
132 | await page.locator('text= | Idle').waitFor();
133 |
at /home/runner/work/jupyterlab/jupyterlab/galata/test/galata/fixture.spec.ts:130:38
|
|
[galata] › test/galata/fixture.spec.ts:109:7 › kernels › should return the active kernels:
galata/test/galata/fixture.spec.ts#L1
2) [galata] › test/galata/fixture.spec.ts:109:7 › kernels › should return the active kernels ─────
Retry #1 ───────────────────────────────────────────────────────────────────────────────────────
Test timeout of 60000ms exceeded.
|
|
[galata] › test/galata/fixture.spec.ts:109:7 › kernels › should return the active kernels:
galata/test/galata/fixture.spec.ts#L130
2) [galata] › test/galata/fixture.spec.ts:109:7 › kernels › should return the active kernels ─────
Retry #1 ───────────────────────────────────────────────────────────────────────────────────────
Error: locator.waitFor: Test timeout of 60000ms exceeded.
Call log:
- waiting for locator('.jp-Dialog') to be visible
128 |
129 | await page.menu.clickMenuItem('File>New>Console');
> 130 | await page.locator('.jp-Dialog').waitFor();
| ^
131 | await page.click('.jp-Dialog .jp-mod-accept');
132 | await page.locator('text= | Idle').waitFor();
133 |
at /home/runner/work/jupyterlab/jupyterlab/galata/test/galata/fixture.spec.ts:130:38
|
|
[galata] › test/galata/fixture.spec.ts:144:7 › sessions › should return the active sessions:
galata/test/galata/fixture.spec.ts#L1
3) [galata] › test/galata/fixture.spec.ts:144:7 › sessions › should return the active sessions ───
Test timeout of 60000ms exceeded.
|
|
[galata] › test/galata/fixture.spec.ts:144:7 › sessions › should return the active sessions:
galata/test/galata/fixture.spec.ts#L158
3) [galata] › test/galata/fixture.spec.ts:144:7 › sessions › should return the active sessions ───
Error: locator.waitFor: Test timeout of 60000ms exceeded.
Call log:
- waiting for locator('.jp-Dialog') to be visible
156 |
157 | await page.menu.clickMenuItem('File>New>Console');
> 158 | await page.locator('.jp-Dialog').waitFor();
| ^
159 | await page.click('.jp-Dialog .jp-mod-accept');
160 | await page.locator('text= | Idle').waitFor();
161 |
at /home/runner/work/jupyterlab/jupyterlab/galata/test/galata/fixture.spec.ts:158:38
|
|
🎭 Playwright Run Summary
1 failed
[documentation] › test/documentation/general.test.ts:20:7 › General › Welcome ──────────────────
2 flaky
[documentation] › test/documentation/customization.test.ts:17:7 › Default › should use default layout
[documentation] › test/documentation/debugger.test.ts:126:7 › Debugger › Breakpoints on exception
60 passed (8.5m)
|
|
🎭 Playwright Run Summary
10 failed
[galata] › test/galata/filebrowser.spec.ts:26:7 › filebrowser helper › should activate already opened file
[galata] › test/galata/fixture.spec.ts:109:7 › kernels › should return the active kernels ──────
[galata] › test/galata/fixture.spec.ts:144:7 › sessions › should return the active sessions ────
[jupyterlab] › test/jupyterlab/completer.test.ts:175:9 › Completer › Console › Open completer on console
[jupyterlab] › test/jupyterlab/completer.test.ts:183:9 › Completer › Console › Filter console completer suggestions by typing
[jupyterlab] › test/jupyterlab/console.test.ts:27:7 › Console › Executed cells should become read-only
[jupyterlab] › test/jupyterlab/console.test.ts:65:7 › Console (terminal mode) › Cells get executed with Enter
[jupyterlab] › test/jupyterlab/contextmenu.test.ts:196:7 › Application Context Menu › Open console context menu
[jupyterlab] › test/jupyterlab/debugger.test.ts:125:7 › Debugger Tests › Start debug session (Script)
[jupyterlab] › test/jupyterlab/kernel.test.ts:129:9 › Kernel › Console › Should ask for kernel when creating console from menu
5 flaky
[jupyterlab] › test/jupyterlab/notebook-markdown.test.ts:86:7 › Notebook Markdown › Render a MermaidJS flowchart
[jupyterlab] › test/jupyterlab/notebook-markdown.test.ts:92:7 › Notebook Markdown › Render a MermaidJS error
[jupyterlab] › test/jupyterlab/notebook-replace.test.ts:153:11 › Notebook Search and Replace › Replace in a code cell and a markdown cell with a string containing the query string
[jupyterlab] › test/jupyterlab/notebook-toolbar.test.ts:223:7 › Reactive toolbar › Items in popup toolbar should have the same order
[jupyterlab] › test/jupyterlab/workspace.test.ts:317:7 › Workspace in doc mode › should restore workspace when switching back to lab mode
470 passed (40.9m)
|
Artifacts
Produced during runtime
| Name | Size | |
|---|---|---|
|
jupyterlab-documentation-report
Expired
|
7.34 MB |
|
|
jupyterlab-documentation-test-assets
Expired
|
6.38 MB |
|
|
jupyterlab-galata-report
Expired
|
35.5 MB |
|
|
jupyterlab-galata-test-assets
Expired
|
31.2 MB |
|