Custom env variables #16
galata.yml
on: pull_request
Visual Regression Tests
47m 32s
Matrix: Visual Regression Documentation
Annotations
19 errors and 2 notices
|
[documentation] › test/documentation/general.test.ts:21:7 › General › Welcome:
core/galata/test/documentation/general.test.ts#L1
1) [documentation] › test/documentation/general.test.ts:21:7 › General › Welcome ─────────────────
Test timeout of 90000ms exceeded.
|
|
[documentation] › test/documentation/general.test.ts:21:7 › General › Welcome:
core/galata/test/documentation/general.test.ts#L51
1) [documentation] › test/documentation/general.test.ts:21:7 › General › Welcome ─────────────────
Error: proxy.click: Test timeout of 90000ms exceeded.
Call log:
- waiting for locator('button:has-text("Select")')
49 | await page.click('.lm-Menu ul[role="menu"] >> text=New');
50 | await page.click('#jp-mainmenu-file-new >> text=Console');
> 51 | await page.click('button:has-text("Select")');
| ^
52 |
53 | await page.dblclick('text=Data.ipynb');
54 |
at /home/runner/work/jupyterlab/jupyterlab/core/galata/test/documentation/general.test.ts:51:16
|
|
[documentation] › test/documentation/general.test.ts:21:7 › General › Welcome:
core/galata/test/documentation/general.test.ts#L1
1) [documentation] › test/documentation/general.test.ts:21:7 › General › Welcome ─────────────────
Retry #1 ───────────────────────────────────────────────────────────────────────────────────────
Test timeout of 90000ms exceeded.
|
|
[documentation] › test/documentation/general.test.ts:21:7 › General › Welcome:
core/galata/test/documentation/general.test.ts#L51
1) [documentation] › test/documentation/general.test.ts:21:7 › General › Welcome ─────────────────
Retry #1 ───────────────────────────────────────────────────────────────────────────────────────
Error: proxy.click: Test timeout of 90000ms exceeded.
Call log:
- waiting for locator('button:has-text("Select")')
49 | await page.click('.lm-Menu ul[role="menu"] >> text=New');
50 | await page.click('#jp-mainmenu-file-new >> text=Console');
> 51 | await page.click('button:has-text("Select")');
| ^
52 |
53 | await page.dblclick('text=Data.ipynb');
54 |
at /home/runner/work/jupyterlab/jupyterlab/core/galata/test/documentation/general.test.ts:51:16
|
|
[documentation] › test/documentation/general.test.ts:21:7 › General › Welcome:
core/galata/test/documentation/general.test.ts#L1
1) [documentation] › test/documentation/general.test.ts:21:7 › General › Welcome ─────────────────
Retry #2 ───────────────────────────────────────────────────────────────────────────────────────
Test timeout of 90000ms exceeded.
|
|
[documentation] › test/documentation/general.test.ts:21:7 › General › Welcome:
core/galata/test/documentation/general.test.ts#L51
1) [documentation] › test/documentation/general.test.ts:21:7 › General › Welcome ─────────────────
Retry #2 ───────────────────────────────────────────────────────────────────────────────────────
Error: proxy.click: Test timeout of 90000ms exceeded.
Call log:
- waiting for locator('button:has-text("Select")')
49 | await page.click('.lm-Menu ul[role="menu"] >> text=New');
50 | await page.click('#jp-mainmenu-file-new >> text=Console');
> 51 | await page.click('button:has-text("Select")');
| ^
52 |
53 | await page.dblclick('text=Data.ipynb');
54 |
at /home/runner/work/jupyterlab/jupyterlab/core/galata/test/documentation/general.test.ts:51:16
|
|
[documentation] › test/documentation/debugger.test.ts:126:7 › Debugger › Breakpoints on exception:
core/galata/test/documentation/debugger.test.ts#L189
2) [documentation] › test/documentation/debugger.test.ts:126:7 › Debugger › Breakpoints on exception
Error: Screenshot comparison failed:
366 pixels (ratio 0.02 of all image pixels) are different.
Expected: /home/runner/work/jupyterlab/jupyterlab/core/galata/test/documentation/debugger.test.ts-snapshots/debugger-stop-on-raised-exception-documentation-linux.png
Received: /home/runner/work/jupyterlab/jupyterlab/core/galata/test-results/test-documentation-debugge-b2db7-er-Breakpoints-on-exception-documentation/debugger-stop-on-raised-exception-actual.png
Diff: /home/runner/work/jupyterlab/jupyterlab/core/galata/test-results/test-documentation-debugge-b2db7-er-Breakpoints-on-exception-documentation/debugger-stop-on-raised-exception-diff.png
187 | clip: { y: 110, x: 300, width: 300, height: 80 }
188 | })
> 189 | ).toMatchSnapshot('debugger_stop_on_raised_exception.png');
| ^
190 | await page.click('jp-button[title^=Continue]');
191 | await page.click('jp-button[title^=Continue]');
192 | });
at /home/runner/work/jupyterlab/jupyterlab/core/galata/test/documentation/debugger.test.ts:189:7
|
|
[documentation] › test/documentation/debugger.test.ts:126:7 › Debugger › Breakpoints on exception:
core/galata/src/helpers/notebook.ts#L456
2) [documentation] › test/documentation/debugger.test.ts:126:7 › Debugger › Breakpoints on exception
Error: page.waitForTimeout: Test ended.
at src/helpers/notebook.ts:456
454 | let done = false;
455 | do {
> 456 | await this.page.waitForTimeout(20);
| ^
457 | done = await this.page.evaluate(cellIdx => {
458 | return window.galata.haveBeenExecuted(cellIdx);
459 | }, cellIndex);
at NotebookHelper.waitForRun (/home/runner/work/jupyterlab/jupyterlab/core/galata/src/helpers/notebook.ts:456:23)
at NotebookHelper.runCell (/home/runner/work/jupyterlab/jupyterlab/core/galata/src/helpers/notebook.ts:1411:5)
|
|
Visual Regression Documentation (3.10.6)
Process completed with exit code 1.
|
|
[galata] › test/galata/filebrowser.spec.ts:26:7 › filebrowser helper › should activate already opened file:
galata/test/galata/filebrowser.spec.ts#L1
1) [galata] › test/galata/filebrowser.spec.ts:26:7 › filebrowser helper › should activate already opened file
Test timeout of 60000ms exceeded.
|
|
[galata] › test/galata/filebrowser.spec.ts:26:7 › filebrowser helper › should activate already opened file:
galata/test/galata/filebrowser.spec.ts#L32
1) [galata] › test/galata/filebrowser.spec.ts:26:7 › filebrowser helper › should activate already opened file
Error: locator.click: Test timeout of 60000ms exceeded.
Call log:
- waiting for locator('.jp-Dialog').getByRole('button', { name: 'Select Kernel', exact: true })
30 | .locator('.jp-Dialog')
31 | .getByRole('button', { name: 'Select Kernel', exact: true })
> 32 | .click();
| ^
33 |
34 | expect.soft(await page.activity.isTabActive(DEFAULT_NAME)).toEqual(false);
35 | await page.filebrowser.open(DEFAULT_NAME);
at /home/runner/work/jupyterlab/jupyterlab/galata/test/galata/filebrowser.spec.ts:32:8
|
|
[galata] › test/galata/filebrowser.spec.ts:26:7 › filebrowser helper › should activate already opened file:
galata/test/galata/filebrowser.spec.ts#L1
1) [galata] › test/galata/filebrowser.spec.ts:26:7 › filebrowser helper › should activate already opened file
Retry #1 ───────────────────────────────────────────────────────────────────────────────────────
Test timeout of 60000ms exceeded.
|
|
[galata] › test/galata/filebrowser.spec.ts:26:7 › filebrowser helper › should activate already opened file:
galata/test/galata/filebrowser.spec.ts#L32
1) [galata] › test/galata/filebrowser.spec.ts:26:7 › filebrowser helper › should activate already opened file
Retry #1 ───────────────────────────────────────────────────────────────────────────────────────
Error: locator.click: Test timeout of 60000ms exceeded.
Call log:
- waiting for locator('.jp-Dialog').getByRole('button', { name: 'Select Kernel', exact: true })
30 | .locator('.jp-Dialog')
31 | .getByRole('button', { name: 'Select Kernel', exact: true })
> 32 | .click();
| ^
33 |
34 | expect.soft(await page.activity.isTabActive(DEFAULT_NAME)).toEqual(false);
35 | await page.filebrowser.open(DEFAULT_NAME);
at /home/runner/work/jupyterlab/jupyterlab/galata/test/galata/filebrowser.spec.ts:32:8
|
|
[galata] › test/galata/fixture.spec.ts:109:7 › kernels › should return the active kernels:
galata/test/galata/fixture.spec.ts#L1
2) [galata] › test/galata/fixture.spec.ts:109:7 › kernels › should return the active kernels ─────
Test timeout of 60000ms exceeded.
|
|
[galata] › test/galata/fixture.spec.ts:109:7 › kernels › should return the active kernels:
galata/test/galata/fixture.spec.ts#L130
2) [galata] › test/galata/fixture.spec.ts:109:7 › kernels › should return the active kernels ─────
Error: locator.waitFor: Test timeout of 60000ms exceeded.
Call log:
- waiting for locator('.jp-Dialog') to be visible
128 |
129 | await page.menu.clickMenuItem('File>New>Console');
> 130 | await page.locator('.jp-Dialog').waitFor();
| ^
131 | await page.click('.jp-Dialog .jp-mod-accept');
132 | await page.locator('text= | Idle').waitFor();
133 |
at /home/runner/work/jupyterlab/jupyterlab/galata/test/galata/fixture.spec.ts:130:38
|
|
[galata] › test/galata/fixture.spec.ts:109:7 › kernels › should return the active kernels:
galata/test/galata/fixture.spec.ts#L1
2) [galata] › test/galata/fixture.spec.ts:109:7 › kernels › should return the active kernels ─────
Retry #1 ───────────────────────────────────────────────────────────────────────────────────────
Test timeout of 60000ms exceeded.
|
|
[galata] › test/galata/fixture.spec.ts:109:7 › kernels › should return the active kernels:
galata/test/galata/fixture.spec.ts#L130
2) [galata] › test/galata/fixture.spec.ts:109:7 › kernels › should return the active kernels ─────
Retry #1 ───────────────────────────────────────────────────────────────────────────────────────
Error: locator.waitFor: Test timeout of 60000ms exceeded.
Call log:
- waiting for locator('.jp-Dialog') to be visible
128 |
129 | await page.menu.clickMenuItem('File>New>Console');
> 130 | await page.locator('.jp-Dialog').waitFor();
| ^
131 | await page.click('.jp-Dialog .jp-mod-accept');
132 | await page.locator('text= | Idle').waitFor();
133 |
at /home/runner/work/jupyterlab/jupyterlab/galata/test/galata/fixture.spec.ts:130:38
|
|
[galata] › test/galata/fixture.spec.ts:144:7 › sessions › should return the active sessions:
galata/test/galata/fixture.spec.ts#L1
3) [galata] › test/galata/fixture.spec.ts:144:7 › sessions › should return the active sessions ───
Test timeout of 60000ms exceeded.
|
|
[galata] › test/galata/fixture.spec.ts:144:7 › sessions › should return the active sessions:
galata/test/galata/fixture.spec.ts#L158
3) [galata] › test/galata/fixture.spec.ts:144:7 › sessions › should return the active sessions ───
Error: locator.waitFor: Test timeout of 60000ms exceeded.
Call log:
- waiting for locator('.jp-Dialog') to be visible
156 |
157 | await page.menu.clickMenuItem('File>New>Console');
> 158 | await page.locator('.jp-Dialog').waitFor();
| ^
159 | await page.click('.jp-Dialog .jp-mod-accept');
160 | await page.locator('text= | Idle').waitFor();
161 |
at /home/runner/work/jupyterlab/jupyterlab/galata/test/galata/fixture.spec.ts:158:38
|
|
🎭 Playwright Run Summary
1 failed
[documentation] › test/documentation/general.test.ts:21:7 › General › Welcome ──────────────────
1 flaky
[documentation] › test/documentation/debugger.test.ts:126:7 › Debugger › Breakpoints on exception
61 passed (8.2m)
|
|
🎭 Playwright Run Summary
10 failed
[galata] › test/galata/filebrowser.spec.ts:26:7 › filebrowser helper › should activate already opened file
[galata] › test/galata/fixture.spec.ts:109:7 › kernels › should return the active kernels ──────
[galata] › test/galata/fixture.spec.ts:144:7 › sessions › should return the active sessions ────
[jupyterlab] › test/jupyterlab/completer.test.ts:175:9 › Completer › Console › Open completer on console
[jupyterlab] › test/jupyterlab/completer.test.ts:183:9 › Completer › Console › Filter console completer suggestions by typing
[jupyterlab] › test/jupyterlab/console.test.ts:27:7 › Console › Executed cells should become read-only
[jupyterlab] › test/jupyterlab/console.test.ts:65:7 › Console (terminal mode) › Cells get executed with Enter
[jupyterlab] › test/jupyterlab/contextmenu.test.ts:196:7 › Application Context Menu › Open console context menu
[jupyterlab] › test/jupyterlab/debugger.test.ts:125:7 › Debugger Tests › Start debug session (Script)
[jupyterlab] › test/jupyterlab/kernel.test.ts:129:9 › Kernel › Console › Should ask for kernel when creating console from menu
2 flaky
[jupyterlab] › test/jupyterlab/notebook-markdown.test.ts:86:7 › Notebook Markdown › Render a MermaidJS flowchart
[jupyterlab] › test/jupyterlab/notebook-markdown.test.ts:92:7 › Notebook Markdown › Render a MermaidJS error
475 passed (40.7m)
|
Artifacts
Produced during runtime
| Name | Size | |
|---|---|---|
|
jupyterlab-documentation-report
Expired
|
6.96 MB |
|
|
jupyterlab-documentation-test-assets
Expired
|
6 MB |
|
|
jupyterlab-galata-report
Expired
|
35.1 MB |
|
|
jupyterlab-galata-test-assets
Expired
|
30.8 MB |
|