Skip to content

e2e-flakiness-detector #194

e2e-flakiness-detector

e2e-flakiness-detector #194

Triggered via schedule September 19, 2024 14:04
Status Failure
Total duration 1h 24m 39s
Artifacts 2
Matrix: test-e2e
Fit to window
Zoom out
Zoom in

Annotations

13 errors and 2 notices
auth.test.ts:22:3 › requires a valid auth token and allows logouts: vscode\test\e2e\auth.test.ts#L31
1) auth.test.ts:22:3 › requires a valid auth token and allows logouts ──────────────────────────── Error: Timed out 5000ms waiting for expect(locator).toBeVisible() Locator: getByRole('alert').getByText('Authentication failed.') Expected: visible Received: <element(s) not found> Call log: - expect.toBeVisible with timeout 5000ms - waiting for getByRole('alert').getByText('Authentication failed.') 29 | await page.getByRole('combobox', { name: 'input' }).press('Enter') 30 | > 31 | await expect(page.getByRole('alert').getByText('Authentication failed.')).toBeVisible() | ^ 32 | 33 | await sidebar?.getByRole('button', { name: 'Sign In to Your Enterprise Instance' }).click() 34 | await page.getByRole('option', { name: 'Sign In with URL and Access Token' }).click() at D:\a\cody\cody\vscode\test\e2e\auth.test.ts:31:79
auth.test.ts:22:3 › requires a valid auth token and allows logouts: vscode\test\e2e\auth.test.ts#L1
1) auth.test.ts:22:3 › requires a valid auth token and allows logouts ──────────────────────────── Error: EBUSY: resource busy or locked, rename 'D:\a\cody\cody\playwright\requires_a_valid_auth_token_and_allows_logouts\temp-videos\5bf466a06f7b330e018810e5b6532980.webm' -> 'D:\a\cody\cody\playwright\requires_a_valid_auth_token_and_allows_logouts\videos\run_0_retry_0_failure.webm'
command-commit.test.ts:24:3 › use terminal output as context: vscode\test\e2e\helpers.ts#L331
2) command-commit.test.ts:24:3 › use terminal output as context ────────────────────────────────── Error: Failed to rmSync C:\Users\RUNNER~1\AppData\Local\Temp\cody-vscei8yuw5 after 5 attempts: Error: EBUSY: resource busy or locked, unlink '\\?\C:\Users\RUNNER~1\AppData\Local\Temp\cody-vscei8yuw5\logs\20240919T141203\window1\exthost\extensionTelemetry.log' at helpers.ts:331 329 | } catch (error) { 330 | if (attempts === 1) { > 331 | throw new Error(`Failed to rmSync ${path} after ${maxAttempts} attempts: ${error}`) | ^ 332 | } 333 | 334 | await new Promise(resolve => setTimeout(resolve, 100)) at rmSyncWithRetries (D:\a\cody\cody\vscode\test\e2e\helpers.ts:331:23) at Object.app (D:\a\cody\cody\vscode\test\e2e\helpers.ts:212:13)
command-commit.test.ts:24:3 › use terminal output as context: vscode\test\e2e\helpers.ts#L331
3) command-commit.test.ts:24:3 › use terminal output as context ────────────────────────────────── Error: Failed to rmSync C:\Users\RUNNER~1\AppData\Local\Temp\cody-vsceF0VCdS after 5 attempts: Error: EBUSY: resource busy or locked, unlink '\\?\C:\Users\RUNNER~1\AppData\Local\Temp\cody-vsceF0VCdS\logs\20240919T143035\window1\exthost\extensionTelemetry.log' at helpers.ts:331 329 | } catch (error) { 330 | if (attempts === 1) { > 331 | throw new Error(`Failed to rmSync ${path} after ${maxAttempts} attempts: ${error}`) | ^ 332 | } 333 | 334 | await new Promise(resolve => setTimeout(resolve, 100)) at rmSyncWithRetries (D:\a\cody\cody\vscode\test\e2e\helpers.ts:331:23) at Object.app (D:\a\cody\cody\vscode\test\e2e\helpers.ts:212:13)
command-edit.test.ts:95:1 › edit (fixup) input - range selection: vscode\test\e2e\command-edit.test.ts#L113
4) command-edit.test.ts:95:1 › edit (fixup) input - range selection ────────────────────────────── Error: expect(locator).toBeVisible() Locator: getByText('Nearest Code Block') Expected: visible Received: <element(s) not found> Call log: - expect.toBeVisible with timeout 5000ms - waiting for getByText('Nearest Code Block') 111 | // Check the correct range item is auto-selected 112 | const rangeItem = page.getByText('Nearest Code Block') > 113 | expect(rangeItem).toBeVisible() | ^ 114 | 115 | // Open the range input and check it has the correct item selected 116 | await rangeItem.click() at D:\a\cody\cody\vscode\test\e2e\command-edit.test.ts:113:23
command-edit.test.ts:95:1 › edit (fixup) input - range selection: vscode\test\e2e\command-edit.test.ts#L118
5) command-edit.test.ts:95:1 › edit (fixup) input - range selection ────────────────────────────── Error: expect(locator).toBeVisible() Locator: getByLabel('check file-code Nearest Code Block') Expected: visible Received: <element(s) not found> Call log: - expect.toBeVisible with timeout 5000ms - waiting for getByLabel('check file-code Nearest Code Block') 116 | await rangeItem.click() 117 | const selectedRangeItem = page.getByLabel('check file-code Nearest Code Block') > 118 | expect(selectedRangeItem).toBeVisible() | ^ 119 | 120 | // Open the symbols input and check it has the correct item selected 121 | const symbolitem = page.getByText('Select a Symbol...') at D:\a\cody\cody\vscode\test\e2e\command-edit.test.ts:118:31
command-edit.test.ts:133:1 › edit (fixup) input - model selection: vscode\test\e2e\command-edit.test.ts#L149
6) command-edit.test.ts:133:1 › edit (fixup) input - model selection ───────────────────────────── Error: expect(locator).toBeVisible() Locator: getByLabel('$(anthropic-logo) Claude 3.5').locator('a') Expected: visible Received: <element(s) not found> Call log: - expect.toBeVisible with timeout 5000ms - waiting for getByLabel('$(anthropic-logo) Claude 3.5').locator('a') 147 | const modelItem = page.getByLabel('$(anthropic-logo) Claude 3.5').locator('a') 148 | await nap() > 149 | expect(modelItem).toBeVisible() | ^ 150 | 151 | // Open the model input and check it has the correct item selected 152 | await modelItem.click() at D:\a\cody\cody\vscode\test\e2e\command-edit.test.ts:149:23
command-edit.test.ts:95:1 › edit (fixup) input - range selection: vscode\test\e2e\command-edit.test.ts#L113
7) command-edit.test.ts:95:1 › edit (fixup) input - range selection ────────────────────────────── Error: expect(locator).toBeVisible() Locator: getByText('Nearest Code Block') Expected: visible Received: <element(s) not found> Call log: - expect.toBeVisible with timeout 5000ms - waiting for getByText('Nearest Code Block') 111 | // Check the correct range item is auto-selected 112 | const rangeItem = page.getByText('Nearest Code Block') > 113 | expect(rangeItem).toBeVisible() | ^ 114 | 115 | // Open the range input and check it has the correct item selected 116 | await rangeItem.click() at D:\a\cody\cody\vscode\test\e2e\command-edit.test.ts:113:23
enterprise-cody-ignore.test.ts:43:7 › using actively invoked commands and autocomplete shows a error: vscode\test\e2e\enterprise-cody-ignore.test.ts#L78
8) enterprise-cody-ignore.test.ts:43:7 › using actively invoked commands and autocomplete shows a error Error: Timed out 5000ms waiting for expect(locator).toBeVisible() Locator: getByText('Cody is disabled in this file') Expected: visible Received: <element(s) not found> Call log: - expect.toBeVisible with timeout 5000ms - waiting for getByText('Cody is disabled in this file') 76 | // Clicking on the Cody icon shows a message 77 | await statusBarButton.click() > 78 | await expect(page.getByText('Cody is disabled in this file')).toBeVisible() | ^ 79 | await page.keyboard.press('Escape') 80 | 81 | // Manually invoking autocomplete should show an error at D:\a\cody\cody\vscode\test\e2e\enterprise-cody-ignore.test.ts:78:71
enterprise-cody-ignore.test.ts:43:7 › using actively invoked commands and autocomplete shows a error: vscode\test\e2e\enterprise-cody-ignore.test.ts#L1
8) enterprise-cody-ignore.test.ts:43:7 › using actively invoked commands and autocomplete shows a error Error: EBUSY: resource busy or locked, rename 'D:\a\cody\cody\playwright\using_actively_invoked_commands_and_autocomplete_shows_a_error\temp-videos\83d47b0047adc4f4e6e088a2cab07eae.webm' -> 'D:\a\cody\cody\playwright\using_actively_invoked_commands_and_autocomplete_shows_a_error\videos\run_0_retry_0_failure.webm'
initial-context.test.ts:83:82 › chat try-again actions: vscode/test/e2e/initial-context.test.ts#L1
1) initial-context.test.ts:83:82 › chat try-again actions ──────────────────────────────────────── Test timeout of 30000ms exceeded.
initial-context.test.ts:83:82 › chat try-again actions: vscode/test/e2e/common.ts#L173
1) initial-context.test.ts:83:82 › chat try-again actions ──────────────────────────────────────── Error: locator.fill: Application exited Call log: - waiting for getByPlaceholder('Type the name of a command to run.') - locator resolved to <input wrap="off" type="text" class="input" role="combo…/> - fill("main.c") - attempting fill action - waiting for element to be visible, enabled and editable - element is not visible - retrying fill action, attempt #1 - waiting for element to be visible, enabled and editable - element is not visible - retrying fill action, attempt #2 - waiting 20ms - waiting for element to be visible, enabled and editable - element is not visible - retrying fill action, attempt #3 - waiting 100ms - waiting for element to be visible, enabled and editable - element is not visible - retrying fill action, attempt #4 - waiting 100ms - waiting for element to be visible, enabled and editable - element is not visible - retrying fill action, attempt #5 - waiting 500ms - waiting for element to be visible, enabled and editable - element is not visible - retrying fill action, attempt #6 - waiting 500ms - waiting for element to be visible, enabled and editable - element is not visible - retrying fill action, attempt #7 - waiting 500ms - waiting for element to be visible, enabled and editable - element is not visible - retrying fill action, attempt #8 - waiting 500ms - waiting for element to be visible, enabled and editable - element is not visible - retrying fill action, attempt #9 - waiting 500ms - waiting for element to be visible, enabled and editable - element is not visible - retrying fill action, attempt #10 - waiting 500ms - waiting for element to be visible, enabled and editable - element is not visible - retrying fill action, attempt #11 - waiting 500ms - waiting for element to be visible, enabled and editable - element is not visible - retrying fill action, attempt #12 - waiting 500ms - waiting for element to be visible, enabled and editable - element is not visible - retrying fill action, attempt #13 - waiting 500ms - waiting for element to be visible, enabled and editable - element is not visible - retrying fill action, attempt #14 - waiting 500ms - waiting for element to be visible, enabled and editable - element is not visible - retrying fill action, attempt #15 - waiting 500ms - waiting for element to be visible, enabled and editable - element is not visible - retrying fill action, attempt #16 - waiting 500ms - waiting for element to be visible, enabled and editable - element is not visible - retrying fill action, attempt #17 - waiting 500ms - waiting for element to be visible, enabled and editable - element is not visible - retrying fill action, attempt #18 - waiting 500ms - waiting for element to be visible, enabled and editable - element is not visible - retrying fill action, attempt #19 - waiting 500ms - waiting for element to be visible, enabled and editable - element is not visible - retrying fill action, attempt #20 - waiting 500ms - waiting for element to be visible, enabled and editable - element is not visible - retrying fill action, attempt #21 - waiting 500ms - waiting for element to be visible, enabled and editable - element is not visible - retrying fill action, attempt #22 - waiting 500ms - waiting for element to be visible, enabled and editable - element is not visible - retrying fill
test-e2e (ubuntu)
Process completed with exit code 1.
🎭 Playwright Run Summary
10 failed auth.test.ts:22:3 › requires a valid auth token and allows logouts ───────────────────────────── command-commit.test.ts:24:3 › use terminal output as context ─────────────────────────────────── command-commit.test.ts:24:3 › use terminal output as context ─────────────────────────────────── command-edit.test.ts:95:1 › edit (fixup) input - range selection ─────────────────────────────── command-edit.test.ts:95:1 › edit (fixup) input - range selection ─────────────────────────────── command-edit.test.ts:133:1 › edit (fixup) input - model selection ────────────────────────────── command-edit.test.ts:95:1 › edit (fixup) input - range selection ─────────────────────────────── enterprise-cody-ignore.test.ts:43:7 › using actively invoked commands and autocomplete shows a error enterprise-cody-ignore.test.ts:43:7 › using actively invoked commands and autocomplete shows a error initial-context.test.ts:83:82 › chat try-again actions ───────────────────────────────────────── 12 skipped 158 passed (37.7m)
🎭 Playwright Run Summary
1 failed initial-context.test.ts:83:82 › chat try-again actions ───────────────────────────────────────── 30 skipped 419 passed (1.4h)

Artifacts

Produced during runtime
Name Size
playwright-recordings ubuntu
591 KB
playwright-recordings windows
859 KB