UI visual regression testing to cover UI widgets visibility #16
ui_notebooks_test.yaml
on: pull_request
verify-0_basic_ray
10m 3s
Annotations
10 errors and 1 notice
tests/0_basic_ray.test.ts:30:7 › Visual Regression › Run notebook and capture cell outputs:
ui-tests/tests/0_basic_ray.test.ts#L58
1) tests/0_basic_ray.test.ts:30:7 › Visual Regression › Run notebook and capture cell outputs ────
Error: A snapshot doesn't exist at /home/runner/work/codeflare-sdk/codeflare-sdk/ui-tests/tests/0_basic_ray.test.ts-snapshots/widgets-cell-0-linux.png, writing actual.
56 |
57 | if (captures[i]) {
> 58 | expect.soft(captures[i]).toMatchSnapshot(image); // Compare pre-existing capture
| ^
59 | continue;
60 | }
61 | }
at /home/runner/work/codeflare-sdk/codeflare-sdk/ui-tests/tests/0_basic_ray.test.ts:58:34
|
tests/0_basic_ray.test.ts:30:7 › Visual Regression › Run notebook and capture cell outputs:
ui-tests/tests/0_basic_ray.test.ts#L58
1) tests/0_basic_ray.test.ts:30:7 › Visual Regression › Run notebook and capture cell outputs ────
Error: A snapshot doesn't exist at /home/runner/work/codeflare-sdk/codeflare-sdk/ui-tests/tests/0_basic_ray.test.ts-snapshots/widgets-cell-2-linux.png, writing actual.
56 |
57 | if (captures[i]) {
> 58 | expect.soft(captures[i]).toMatchSnapshot(image); // Compare pre-existing capture
| ^
59 | continue;
60 | }
61 | }
at /home/runner/work/codeflare-sdk/codeflare-sdk/ui-tests/tests/0_basic_ray.test.ts:58:34
|
tests/0_basic_ray.test.ts:30:7 › Visual Regression › Run notebook and capture cell outputs:
ui-tests/tests/0_basic_ray.test.ts#L58
1) tests/0_basic_ray.test.ts:30:7 › Visual Regression › Run notebook and capture cell outputs ────
Error: A snapshot doesn't exist at /home/runner/work/codeflare-sdk/codeflare-sdk/ui-tests/tests/0_basic_ray.test.ts-snapshots/widgets-cell-3-linux.png, writing actual.
56 |
57 | if (captures[i]) {
> 58 | expect.soft(captures[i]).toMatchSnapshot(image); // Compare pre-existing capture
| ^
59 | continue;
60 | }
61 | }
at /home/runner/work/codeflare-sdk/codeflare-sdk/ui-tests/tests/0_basic_ray.test.ts:58:34
|
tests/0_basic_ray.test.ts:30:7 › Visual Regression › Run notebook and capture cell outputs:
ui-tests/tests/0_basic_ray.test.ts#L58
1) tests/0_basic_ray.test.ts:30:7 › Visual Regression › Run notebook and capture cell outputs ────
Error: A snapshot doesn't exist at /home/runner/work/codeflare-sdk/codeflare-sdk/ui-tests/tests/0_basic_ray.test.ts-snapshots/widgets-cell-4-linux.png, writing actual.
56 |
57 | if (captures[i]) {
> 58 | expect.soft(captures[i]).toMatchSnapshot(image); // Compare pre-existing capture
| ^
59 | continue;
60 | }
61 | }
at /home/runner/work/codeflare-sdk/codeflare-sdk/ui-tests/tests/0_basic_ray.test.ts:58:34
|
tests/0_basic_ray.test.ts:30:7 › Visual Regression › Run notebook and capture cell outputs:
ui-tests/tests/0_basic_ray.test.ts#L58
1) tests/0_basic_ray.test.ts:30:7 › Visual Regression › Run notebook and capture cell outputs ────
Error: A snapshot doesn't exist at /home/runner/work/codeflare-sdk/codeflare-sdk/ui-tests/tests/0_basic_ray.test.ts-snapshots/widgets-cell-5-linux.png, writing actual.
56 |
57 | if (captures[i]) {
> 58 | expect.soft(captures[i]).toMatchSnapshot(image); // Compare pre-existing capture
| ^
59 | continue;
60 | }
61 | }
at /home/runner/work/codeflare-sdk/codeflare-sdk/ui-tests/tests/0_basic_ray.test.ts:58:34
|
tests/0_basic_ray.test.ts:30:7 › Visual Regression › Run notebook and capture cell outputs:
ui-tests/tests/0_basic_ray.test.ts#L58
1) tests/0_basic_ray.test.ts:30:7 › Visual Regression › Run notebook and capture cell outputs ────
Error: A snapshot doesn't exist at /home/runner/work/codeflare-sdk/codeflare-sdk/ui-tests/tests/0_basic_ray.test.ts-snapshots/widgets-cell-6-linux.png, writing actual.
56 |
57 | if (captures[i]) {
> 58 | expect.soft(captures[i]).toMatchSnapshot(image); // Compare pre-existing capture
| ^
59 | continue;
60 | }
61 | }
at /home/runner/work/codeflare-sdk/codeflare-sdk/ui-tests/tests/0_basic_ray.test.ts:58:34
|
tests/0_basic_ray.test.ts:30:7 › Visual Regression › Run notebook and capture cell outputs:
ui-tests/tests/0_basic_ray.test.ts#L58
1) tests/0_basic_ray.test.ts:30:7 › Visual Regression › Run notebook and capture cell outputs ────
Error: A snapshot doesn't exist at /home/runner/work/codeflare-sdk/codeflare-sdk/ui-tests/tests/0_basic_ray.test.ts-snapshots/widgets-cell-7-linux.png, writing actual.
56 |
57 | if (captures[i]) {
> 58 | expect.soft(captures[i]).toMatchSnapshot(image); // Compare pre-existing capture
| ^
59 | continue;
60 | }
61 | }
at /home/runner/work/codeflare-sdk/codeflare-sdk/ui-tests/tests/0_basic_ray.test.ts:58:34
|
tests/0_basic_ray.test.ts:30:7 › Visual Regression › Run notebook and capture cell outputs:
ui-tests/tests/0_basic_ray.test.ts#L58
1) tests/0_basic_ray.test.ts:30:7 › Visual Regression › Run notebook and capture cell outputs ────
Error: A snapshot doesn't exist at /home/runner/work/codeflare-sdk/codeflare-sdk/ui-tests/tests/0_basic_ray.test.ts-snapshots/widgets-cell-8-linux.png, writing actual.
56 |
57 | if (captures[i]) {
> 58 | expect.soft(captures[i]).toMatchSnapshot(image); // Compare pre-existing capture
| ^
59 | continue;
60 | }
61 | }
at /home/runner/work/codeflare-sdk/codeflare-sdk/ui-tests/tests/0_basic_ray.test.ts:58:34
|
tests/0_basic_ray.test.ts:30:7 › Visual Regression › Run notebook and capture cell outputs:
ui-tests/tests/0_basic_ray.test.ts#L58
1) tests/0_basic_ray.test.ts:30:7 › Visual Regression › Run notebook and capture cell outputs ────
Error: A snapshot doesn't exist at /home/runner/work/codeflare-sdk/codeflare-sdk/ui-tests/tests/0_basic_ray.test.ts-snapshots/widgets-cell-9-linux.png, writing actual.
56 |
57 | if (captures[i]) {
> 58 | expect.soft(captures[i]).toMatchSnapshot(image); // Compare pre-existing capture
| ^
59 | continue;
60 | }
61 | }
at /home/runner/work/codeflare-sdk/codeflare-sdk/ui-tests/tests/0_basic_ray.test.ts:58:34
|
tests/0_basic_ray.test.ts:30:7 › Visual Regression › Run notebook and capture cell outputs:
ui-tests/tests/0_basic_ray.test.ts#L58
1) tests/0_basic_ray.test.ts:30:7 › Visual Regression › Run notebook and capture cell outputs ────
Error: A snapshot doesn't exist at /home/runner/work/codeflare-sdk/codeflare-sdk/ui-tests/tests/0_basic_ray.test.ts-snapshots/widgets-cell-10-linux.png, writing actual.
56 |
57 | if (captures[i]) {
> 58 | expect.soft(captures[i]).toMatchSnapshot(image); // Compare pre-existing capture
| ^
59 | continue;
60 | }
61 | }
at /home/runner/work/codeflare-sdk/codeflare-sdk/ui-tests/tests/0_basic_ray.test.ts:58:34
|
🎭 Playwright Run Summary
1 failed
tests/0_basic_ray.test.ts:30:7 › Visual Regression › Run notebook and capture cell outputs ─────
|
Artifacts
Produced during runtime
Name | Size | |
---|---|---|
ipywidgets-test-assets
|
8.55 MB |
|
ipywidgets-test-report
|
8.75 MB |
|