1) [chromium] › components/data-source/data-source.spec.ts:136:3 › data source › should use a custom button for local file inputs Error: expect(locator).toHaveText(expected) Locator: locator('.file-picker').first() Expected string: "Browse files" Received: <element(s) not found> Call log: - expect.toHaveText with timeout 5000ms - waiting for locator('.file-picker').first() 126 | const expectedLocalFileInputText = "Browse files"; 127 | await fixture.setLocalAttribute(true); > 128 | expect(fixture.filePicker()).toHaveText(expectedLocalFileInputText); | ^ 129 | }); 130 | 131 | test("should handle having no source correctly with remote files", async ({ fixture }) => { at /home/runner/work/web-components/web-components/src/components/data-source/data-source.spec.ts:128:34

1) [chromium] › components/data-source/data-source.spec.ts:136:3 › data source › should use a custom button for local file inputs Error: Test ended. Call log: - navigating to "about:blank", waiting until "load"

2) [chromium] › components/decision/classification/classification.spec.ts:10:3 › Classification Component › should display the correct shortcuts if both true and false shortcuts are provided Error: expect(locator).toBeAttached() Locator: locator('.file-picker').first() Expected: attached Received: <element(s) not found> Call log: - expect.toBeAttached with timeout 5000ms - waiting for locator('.file-picker').first() at components/data-source/data-source.spec.ts:169 167 | 168 | await fixture.setLocalAttribute(true); > 169 | expect(fixture.filePicker()).toBeAttached(); | ^ 170 | }); 171 | 172 | test.skip("should invalidate local file source when switching to a remote file", async ({ fixture }) => { at /home/runner/work/web-components/web-components/src/components/data-source/data-source.spec.ts:169:34

2) [chromium] › components/decision/classification/classification.spec.ts:10:3 › Classification Component › should display the correct shortcuts if both true and false shortcuts are provided Error: Test ended. Call log: - navigating to "about:blank", waiting until "load"

3) [chromium] › tests/verification-grid/verification-grid.e2e.spec.ts:136:7 › single verification grid › changing attributes › changing the grid size › should not allow a grid size that is a string Error: expect(locator).toBeHidden() Locator: locator('#dialog-preference').first() Expected: hidden Received: visible Call log: - expect.toBeHidden with timeout 5000ms - waiting for locator('#dialog-preference').first() 121 | 122 | test("should not have an option to now show the help dialog again", async ({ fixture }) => { > 123 | expect(fixture.helpDialogPreference()).toBeHidden(); | ^ 124 | }); 125 | }); 126 | at /home/runner/work/web-components/web-components/src/tests/verification-grid/verification-grid.e2e.spec.ts:123:46

3) [chromium] › tests/verification-grid/verification-grid.e2e.spec.ts:136:7 › single verification grid › changing attributes › changing the grid size › should not allow a grid size that is a string Error: Test ended. Call log: - navigating to "about:blank", waiting until "load"

4) [chromium] › tests/verification-grid/verification-grid.e2e.spec.ts:360:5 › single verification grid › progress bar › should grow the view segments if a full page of decisions is made Test timeout of 30000ms exceeded.

4) [chromium] › tests/verification-grid/verification-grid.e2e.spec.ts:360:5 › single verification grid › progress bar › should grow the view segments if a full page of decisions is made Error: locator.click: Test timeout of 30000ms exceeded. Call log: - waiting for locator('.decision-button').first() - locator resolved to <button title="Shortcut: Y" id="decision-button" aria-disabled="true" part="decision-button" class="oe-btn-primary decision-button disabled">…</button> - attempting click action - waiting for element to be visible, enabled and stable - element is not enabled - retrying click action, attempt #1 - waiting for element to be visible, enabled and stable - element is not enabled - retrying click action, attempt #2 - waiting 20ms - waiting for element to be visible, enabled and stable - element is not enabled - retrying click action, attempt #3 - waiting 100ms - waiting for element to be visible, enabled and stable - element is not enabled - retrying click action, attempt #4 - waiting 100ms - waiting for element to be visible, enabled and stable - element is not enabled - retrying click action, attempt #5 - waiting 500ms - waiting for element to be visible, enabled and stable - element is not enabled - retrying click action, attempt #6 - waiting 500ms - waiting for element to be visible, enabled and stable - element is not enabled - retrying click action, attempt #7 - waiting 500ms - waiting for element to be visible, enabled and stable - element is not enabled - retrying click action, attempt #8 - waiting 500ms - waiting for element to be visible, enabled and stable - element is not enabled - retrying click action, attempt #9 - waiting 500ms - waiting for element to be visible, enabled and stable - element is not enabled - retrying click action, attempt #10 - waiting 500ms - waiting for element to be visible, enabled and stable - element is not enabled - retrying click action, attempt #11 - waiting 500ms - waiting for element to be visible, enabled and stable - element is not enabled - retrying click action, attempt #12 - waiting 500ms - waiting for element to be visible, enabled and stable - element is not enabled - retrying click action, attempt #13 - waiting 500ms - waiting for element to be visible, enabled and stable - element is not enabled - retrying click action, attempt #14 - waiting 500ms - waiting for element to be visible, enabled and stable - element is not enabled - retrying click action, attempt #15 - waiting 500ms - waiting for element to be visible, enabled and stable - element is not enabled - retrying click action, attempt #16 - waiting 500ms - waiting for element to be visible, enabled and stable - element is not enabled - retrying click action, attempt #17 - waiting 500ms - waiting for element to be visible, enabled and stable - element is not enabled - retrying click action, attempt #18 - waiting 500ms - waiting for element to be visible, enabled and stable - element is not enabled - retrying click action, attempt #19 - waiting 500ms - waiting for element to be visible, enabled and stable - element is not enabled - retrying click action, attempt #20 - waiting 500ms - waiting for element to be visible, enabled and stable - element is not enabled - retrying click action, attempt #21 - waiting 500ms - waiting for element to be visible, enabled and stable - element is not enabled - retrying click action, attempt #22 - wai

5) [chromium] › tests/verification-grid/verification-grid.e2e.spec.ts:546:5 › single verification grid › pagination › should start viewing history when the previous page button is clicked Error: expect(locator).not.toBeVisible() Locator: getByTestId('continue-verifying-button').first() Expected: not visible Received: visible Call log: - expect.not.toBeVisible with timeout 5000ms - waiting for getByTestId('continue-verifying-button').first() 534 | 535 | test("should hide the 'Continue Verifying' button when not viewing history", async ({ fixture }) => { > 536 | expect(fixture.continueVerifyingButton()).not.toBeVisible(); | ^ 537 | }); 538 | 539 | test("should show the 'Continue Verifying' button when viewing history", async ({ fixture }) => { at /home/runner/work/web-components/web-components/src/tests/verification-grid/verification-grid.e2e.spec.ts:536:53

5) [chromium] › tests/verification-grid/verification-grid.e2e.spec.ts:546:5 › single verification grid › pagination › should start viewing history when the previous page button is clicked Error: Test ended. Call log: - navigating to "about:blank", waiting until "load"

1) [chromium] › components\data-source\data-source.spec.ts:136:3 › data source › should use a custom button for local file inputs Error: expect(locator).not.toBeAttached() Locator: locator('.file-picker').first() Expected: not attached Received: attached Call log: - expect.not.toBeAttached with timeout 5000ms - waiting for locator('.file-picker').first() 131 | test("should handle having no source correctly with remote files", async ({ fixture }) => { 132 | await fixture.setLocalAttribute(false); > 133 | expect(fixture.filePicker()).not.toBeAttached(); | ^ 134 | }); 135 | 136 | test("should use a custom button for local file inputs", async ({ fixture }) => { at D:\a\web-components\web-components\src\components\data-source\data-source.spec.ts:133:38

1) [chromium] › components\data-source\data-source.spec.ts:136:3 › data source › should use a custom button for local file inputs Error: Test ended. Call log: - navigating to "about:blank", waiting until "load"

2) [chromium] › components\data-source\data-source.spec.ts:164:3 › data source › should handle changing from remote to local files Error: expect(locator).toHaveText(expected) Locator: locator('.file-picker').first() Expected string: "Browse files" Received string: "" Call log: - expect.toHaveText with timeout 5000ms - waiting for locator('.file-picker').first() 126 | const expectedLocalFileInputText = "Browse files"; 127 | await fixture.setLocalAttribute(true); > 128 | expect(fixture.filePicker()).toHaveText(expectedLocalFileInputText); | ^ 129 | }); 130 | 131 | test("should handle having no source correctly with remote files", async ({ fixture }) => { at D:\a\web-components\web-components\src\components\data-source\data-source.spec.ts:128:34

2) [chromium] › components\data-source\data-source.spec.ts:164:3 › data source › should handle changing from remote to local files Error: Test ended. Call log: - navigating to "about:blank", waiting until "load"

3) [chromium] › components\decision\classification\classification.spec.ts:22:3 › Classification Component › should derive a false shortcut if only a true shortcut is provided Error: expect(locator).toBeAttached() Locator: locator('.file-picker').first() Expected: attached Received: <element(s) not found> Call log: - expect.toBeAttached with timeout 5000ms - waiting for locator('.file-picker').first() at components\data-source\data-source.spec.ts:169 167 | 168 | await fixture.setLocalAttribute(true); > 169 | expect(fixture.filePicker()).toBeAttached(); | ^ 170 | }); 171 | 172 | test.skip("should invalidate local file source when switching to a remote file", async ({ fixture }) => { at D:\a\web-components\web-components\src\components\data-source\data-source.spec.ts:169:34

3) [chromium] › components\decision\classification\classification.spec.ts:22:3 › Classification Component › should derive a false shortcut if only a true shortcut is provided Error: Test ended. Call log: - navigating to "about:blank", waiting until "load"

4) [chromium] › tests\verification-grid\verification-grid.e2e.spec.ts:136:7 › single verification grid › changing attributes › changing the grid size › should not allow a grid size that is a string Error: expect(locator).toBeHidden() Locator: locator('#dialog-preference').first() Expected: hidden Received: visible Call log: - expect.toBeHidden with timeout 5000ms - waiting for locator('#dialog-preference').first() 121 | 122 | test("should not have an option to now show the help dialog again", async ({ fixture }) => { > 123 | expect(fixture.helpDialogPreference()).toBeHidden(); | ^ 124 | }); 125 | }); 126 | at D:\a\web-components\web-components\src\tests\verification-grid\verification-grid.e2e.spec.ts:123:46

4) [chromium] › tests\verification-grid\verification-grid.e2e.spec.ts:136:7 › single verification grid › changing attributes › changing the grid size › should not allow a grid size that is a string Error: Test ended. Call log: - navigating to "about:blank", waiting until "load"

5) [chromium] › tests\verification-grid\verification-grid.e2e.spec.ts:152:7 › single verification grid › changing attributes › changing the grid size › should not allow a grid size that is a negative number Test timeout of 30000ms exceeded while running "beforeEach" hook. 55 | 56 | test.describe("single verification grid", () => { > 57 | test.beforeEach(async ({ fixture, page }) => { | ^ 58 | await fixture.create(); 59 | 60 | await page.setViewportSize({ width: 1920, height: 1080 }); at D:\a\web-components\web-components\src\tests\verification-grid\verification-grid.e2e.spec.ts:57:8

5) [chromium] › tests\verification-grid\verification-grid.e2e.spec.ts:152:7 › single verification grid › changing attributes › changing the grid size › should not allow a grid size that is a negative number Error: page.waitForLoadState: Test ended. at tests\verification-grid\verification-grid.e2e.fixture.ts:120 118 | </oe-verification-grid> 119 | `); > 120 | await this.page.waitForLoadState("networkidle"); | ^ 121 | await this.page.waitForSelector("oe-verification-grid"); 122 | } 123 | at TestPage.create (D:\a\web-components\web-components\src\tests\verification-grid\verification-grid.e2e.fixture.ts:120:21) at D:\a\web-components\web-components\src\tests\verification-grid\verification-grid.e2e.spec.ts:58:5

1) [chromium] › components/data-source/data-source.spec.ts:131:3 › data source › should handle having no source correctly with remote files Error: expect(locator).toHaveText(expected) Locator: locator('.file-picker').first() Expected string: "Browse files" Received: <element(s) not found> Call log: - expect.toHaveText with timeout 5000ms - waiting for locator('.file-picker').first() 126 | const expectedLocalFileInputText = "Browse files"; 127 | await fixture.setLocalAttribute(true); > 128 | expect(fixture.filePicker()).toHaveText(expectedLocalFileInputText); | ^ 129 | }); 130 | 131 | test("should handle having no source correctly with remote files", async ({ fixture }) => { at /Users/runner/work/web-components/web-components/src/components/data-source/data-source.spec.ts:128:34

1) [chromium] › components/data-source/data-source.spec.ts:131:3 › data source › should handle having no source correctly with remote files Error: Test ended. Call log: - navigating to "about:blank", waiting until "load"

2) [chromium] › components/data-source/data-source.spec.ts:164:3 › data source › should handle changing from remote to local files Error: expect(locator).not.toBeVisible() Locator: locator('#browser-file-input').first() Expected: not visible Received: visible Call log: - expect.not.toBeVisible with timeout 5000ms - waiting for locator('#browser-file-input').first() 136 | test("should use a custom button for local file inputs", async ({ fixture }) => { 137 | await fixture.setLocalAttribute(true); > 138 | expect(fixture.browserFileInput()).not.toBeVisible(); | ^ 139 | }); 140 | 141 | // TODO: fix in https://github.com/ecoacoustics/web-components/issues/86 at /Users/runner/work/web-components/web-components/src/components/data-source/data-source.spec.ts:138:44

2) [chromium] › components/data-source/data-source.spec.ts:164:3 › data source › should handle changing from remote to local files Error: Test ended. Call log: - navigating to "about:blank", waiting until "load"

3) [chromium] › components/decision/classification/classification.spec.ts:10:3 › Classification Component › should display the correct shortcuts if both true and false shortcuts are provided Error: expect(locator).toBeAttached() Locator: locator('.file-picker').first() Expected: attached Received: <element(s) not found> Call log: - expect.toBeAttached with timeout 5000ms - waiting for locator('.file-picker').first() at components/data-source/data-source.spec.ts:169 167 | 168 | await fixture.setLocalAttribute(true); > 169 | expect(fixture.filePicker()).toBeAttached(); | ^ 170 | }); 171 | 172 | test.skip("should invalidate local file source when switching to a remote file", async ({ fixture }) => { at /Users/runner/work/web-components/web-components/src/components/data-source/data-source.spec.ts:169:34

3) [chromium] › components/decision/classification/classification.spec.ts:10:3 › Classification Component › should display the correct shortcuts if both true and false shortcuts are provided Error: Test ended. Call log: - navigating to "about:blank", waiting until "load"

4) [chromium] › tests/verification-grid/verification-grid.e2e.spec.ts:129:7 › single verification grid › changing attributes › changing the grid size › should react correctly to changing the grid size Error: expect(locator).toBeHidden() Locator: locator('#dialog-preference').first() Expected: hidden Received: visible Call log: - expect.toBeHidden with timeout 5000ms - waiting for locator('#dialog-preference').first() 121 | 122 | test("should not have an option to now show the help dialog again", async ({ fixture }) => { > 123 | expect(fixture.helpDialogPreference()).toBeHidden(); | ^ 124 | }); 125 | }); 126 | at /Users/runner/work/web-components/web-components/src/tests/verification-grid/verification-grid.e2e.spec.ts:123:46

4) [chromium] › tests/verification-grid/verification-grid.e2e.spec.ts:129:7 › single verification grid › changing attributes › changing the grid size › should react correctly to changing the grid size Error: Test ended. Call log: - navigating to "about:blank", waiting until "load"

5) [chromium] › tests/verification-grid/verification-grid.e2e.spec.ts:539:5 › single verification grid › pagination › should show the 'Continue Verifying' button when viewing history Error: expect(locator).not.toBeVisible() Locator: getByTestId('continue-verifying-button').first() Expected: not visible Received: visible Call log: - expect.not.toBeVisible with timeout 5000ms - waiting for getByTestId('continue-verifying-button').first() 534 | 535 | test("should hide the 'Continue Verifying' button when not viewing history", async ({ fixture }) => { > 536 | expect(fixture.continueVerifyingButton()).not.toBeVisible(); | ^ 537 | }); 538 | 539 | test("should show the 'Continue Verifying' button when viewing history", async ({ fixture }) => { at /Users/runner/work/web-components/web-components/src/tests/verification-grid/verification-grid.e2e.spec.ts:536:53

5) [chromium] › tests/verification-grid/verification-grid.e2e.spec.ts:539:5 › single verification grid › pagination › should show the 'Continue Verifying' button when viewing history Error: Test ended. Call log: - navigating to "about:blank", waiting until "load"

[firefox] › components/spectrogram/spectrogram.spec.ts took 30.9s

[webkit] › components/spectrogram/spectrogram.spec.ts took 30.2s

[chromium] › components/spectrogram/spectrogram.spec.ts took 29.8s

[firefox] › tests/indicator-spectrogram/indicator-spectrogram-media-controls.e2e.spec.ts took 28.3s

[webkit] › tests/indicator-spectrogram/indicator-spectrogram-media-controls.e2e.spec.ts took 27.4s

25 flaky [chromium] › components/data-source/data-source.spec.ts:136:3 › data source › should use a custom button for local file inputs [chromium] › components/decision/classification/classification.spec.ts:10:3 › Classification Component › should display the correct shortcuts if both true and false shortcuts are provided [chromium] › tests/verification-grid/verification-grid.e2e.spec.ts:136:7 › single verification grid › changing attributes › changing the grid size › should not allow a grid size that is a string [chromium] › tests/verification-grid/verification-grid.e2e.spec.ts:360:5 › single verification grid › progress bar › should grow the view segments if a full page of decisions is made [chromium] › tests/verification-grid/verification-grid.e2e.spec.ts:546:5 › single verification grid › pagination › should start viewing history when the previous page button is clicked [chromium] › tests/verification-grid/verification-grid.e2e.spec.ts:555:5 › single verification grid › pagination › should stop viewing history when the 'Continue Verifying' button is clicked [chromium] › tests/verification-grid/verification-grid.e2e.spec.ts:567:5 › single verification grid › pagination › should stop playing audio and reset time when the grid auto pages [firefox] › components/data-source/data-source.spec.ts:136:3 › data source › should use a custom button for local file inputs [firefox] › components/data-source/data-source.spec.ts:164:3 › data source › should handle changing from remote to local files [firefox] › components/decision/classification/classification.spec.ts:32:3 › Classification Component › should derive a true shortcut if only a false shortcut is provided [firefox] › tests/verification-grid/verification-grid.e2e.spec.ts:136:7 › single verification grid › changing attributes › changing the grid size › should not allow a grid size that is a string [firefox] › tests/verification-grid/verification-grid.e2e.spec.ts:347:5 › single verification grid › progress bar › should not show the completed segment if a partial page of decisions is made [firefox] › tests/verification-grid/verification-grid.e2e.spec.ts:423:5 › single verification grid › progress bar › should have the the correct segment sizes if the user exits history [firefox] › tests/verification-grid/verification-grid.e2e.spec.ts:513:5 › single verification grid › pagination › should disable the previous page button when at the start of history [firefox] › tests/verification-grid/verification-grid.e2e.spec.ts:539:5 › single verification grid › pagination › should show the 'Continue Verifying' button when viewing history [firefox] › tests/verification-grid/verification-grid.e2e.spec.ts:546:5 › single verification grid › pagination › should start viewing history when the previous page button is clicked [firefox] › tests/verification-grid/verification-grid.e2e.spec.ts:567:5 › single verification grid › pagination › should stop playing audio and reset time when the grid auto pages [webkit] › components/data-source/data-source.spec.ts:136:3 › data source › should use a custom button for local file inputs [webkit] › components/data-source/data-source.spec.ts:164:3 › data source › should handle changing from remote to local files [webkit] › components/decision/classification/classification.spec.ts:32:3 › Classification Component › should derive a true shortcut if only a false shortcut is provided [webkit] › tests/verification-grid/verification-grid.e2e.spec.ts:136:7 › single verification grid › changing attributes › changing the grid size › should not allow a grid size that is a string [webkit] › tests/verification-grid/verification-grid.e2e.spec.ts:347:5 › single verification grid › progress bar › should not show the completed segment if a partial page of decisions is made [webkit] › tests/verification-grid/verification-grid.e2e.spec.ts:360:5 › single verification grid › progress bar › should grow the view segments if a full page of decisions is made [webki

19 flaky [chromium] › components\data-source\data-source.spec.ts:136:3 › data source › should use a custom button for local file inputs [chromium] › components\data-source\data-source.spec.ts:164:3 › data source › should handle changing from remote to local files [chromium] › components\decision\classification\classification.spec.ts:22:3 › Classification Component › should derive a false shortcut if only a true shortcut is provided [chromium] › tests\verification-grid\verification-grid.e2e.spec.ts:136:7 › single verification grid › changing attributes › changing the grid size › should not allow a grid size that is a string [chromium] › tests\verification-grid\verification-grid.e2e.spec.ts:152:7 › single verification grid › changing attributes › changing the grid size › should not allow a grid size that is a negative number [chromium] › tests\verification-grid\verification-grid.e2e.spec.ts:539:5 › single verification grid › pagination › should show the 'Continue Verifying' button when viewing history [chromium] › tests\verification-grid\verification-grid.e2e.spec.ts:1025:9 › single verification grid › grid sizes › portrait tablet › should have the correct grid shape [firefox] › components\data-source\data-source.spec.ts:136:3 › data source › should use a custom button for local file inputs [firefox] › components\data-source\data-source.spec.ts:164:3 › data source › should handle changing from remote to local files [firefox] › components\decision\classification\classification.spec.ts:32:3 › Classification Component › should derive a true shortcut if only a false shortcut is provided [firefox] › tests\verification-grid\verification-grid.e2e.spec.ts:136:7 › single verification grid › changing attributes › changing the grid size › should not allow a grid size that is a string [firefox] › tests\verification-grid\verification-grid.e2e.spec.ts:546:5 › single verification grid › pagination › should start viewing history when the previous page button is clicked [firefox] › tests\verification-grid\verification-grid.e2e.spec.ts:1265:5 › decision meter › mixed classification and verification tasks › should have the correct colors when decisions are made [webkit] › components\data-source\data-source.spec.ts:131:3 › data source › should handle having no source correctly with remote files [webkit] › components\data-source\data-source.spec.ts:164:3 › data source › should handle changing from remote to local files [webkit] › components\decision\classification\classification.spec.ts:10:3 › Classification Component › should display the correct shortcuts if both true and false shortcuts are provided [webkit] › tests\verification-grid\verification-grid.e2e.spec.ts:136:7 › single verification grid › changing attributes › changing the grid size › should not allow a grid size that is a string [webkit] › tests\verification-grid\verification-grid.e2e.spec.ts:555:5 › single verification grid › pagination › should stop viewing history when the 'Continue Verifying' button is clicked [webkit] › tests\verification-grid\verification-grid.e2e.spec.ts:590:7 › single verification grid › sub-selection › tablet selection mode › should select a tile when clicked 273 skipped 683 passed (24.8m)