e2e-flakiness-detector #194
Annotations
13 errors and 2 notices
auth.test.ts:22:3 › requires a valid auth token and allows logouts:
vscode\test\e2e\auth.test.ts#L31
1) auth.test.ts:22:3 › requires a valid auth token and allows logouts ────────────────────────────
Error: Timed out 5000ms waiting for expect(locator).toBeVisible()
Locator: getByRole('alert').getByText('Authentication failed.')
Expected: visible
Received: <element(s) not found>
Call log:
- expect.toBeVisible with timeout 5000ms
- waiting for getByRole('alert').getByText('Authentication failed.')
29 | await page.getByRole('combobox', { name: 'input' }).press('Enter')
30 |
> 31 | await expect(page.getByRole('alert').getByText('Authentication failed.')).toBeVisible()
| ^
32 |
33 | await sidebar?.getByRole('button', { name: 'Sign In to Your Enterprise Instance' }).click()
34 | await page.getByRole('option', { name: 'Sign In with URL and Access Token' }).click()
at D:\a\cody\cody\vscode\test\e2e\auth.test.ts:31:79
|
auth.test.ts:22:3 › requires a valid auth token and allows logouts:
vscode\test\e2e\auth.test.ts#L1
1) auth.test.ts:22:3 › requires a valid auth token and allows logouts ────────────────────────────
Error: EBUSY: resource busy or locked, rename 'D:\a\cody\cody\playwright\requires_a_valid_auth_token_and_allows_logouts\temp-videos\5bf466a06f7b330e018810e5b6532980.webm' -> 'D:\a\cody\cody\playwright\requires_a_valid_auth_token_and_allows_logouts\videos\run_0_retry_0_failure.webm'
|
command-commit.test.ts:24:3 › use terminal output as context:
vscode\test\e2e\helpers.ts#L331
2) command-commit.test.ts:24:3 › use terminal output as context ──────────────────────────────────
Error: Failed to rmSync C:\Users\RUNNER~1\AppData\Local\Temp\cody-vscei8yuw5 after 5 attempts: Error: EBUSY: resource busy or locked, unlink '\\?\C:\Users\RUNNER~1\AppData\Local\Temp\cody-vscei8yuw5\logs\20240919T141203\window1\exthost\extensionTelemetry.log'
at helpers.ts:331
329 | } catch (error) {
330 | if (attempts === 1) {
> 331 | throw new Error(`Failed to rmSync ${path} after ${maxAttempts} attempts: ${error}`)
| ^
332 | }
333 |
334 | await new Promise(resolve => setTimeout(resolve, 100))
at rmSyncWithRetries (D:\a\cody\cody\vscode\test\e2e\helpers.ts:331:23)
at Object.app (D:\a\cody\cody\vscode\test\e2e\helpers.ts:212:13)
|
command-commit.test.ts:24:3 › use terminal output as context:
vscode\test\e2e\helpers.ts#L331
3) command-commit.test.ts:24:3 › use terminal output as context ──────────────────────────────────
Error: Failed to rmSync C:\Users\RUNNER~1\AppData\Local\Temp\cody-vsceF0VCdS after 5 attempts: Error: EBUSY: resource busy or locked, unlink '\\?\C:\Users\RUNNER~1\AppData\Local\Temp\cody-vsceF0VCdS\logs\20240919T143035\window1\exthost\extensionTelemetry.log'
at helpers.ts:331
329 | } catch (error) {
330 | if (attempts === 1) {
> 331 | throw new Error(`Failed to rmSync ${path} after ${maxAttempts} attempts: ${error}`)
| ^
332 | }
333 |
334 | await new Promise(resolve => setTimeout(resolve, 100))
at rmSyncWithRetries (D:\a\cody\cody\vscode\test\e2e\helpers.ts:331:23)
at Object.app (D:\a\cody\cody\vscode\test\e2e\helpers.ts:212:13)
|
command-edit.test.ts:95:1 › edit (fixup) input - range selection:
vscode\test\e2e\command-edit.test.ts#L113
4) command-edit.test.ts:95:1 › edit (fixup) input - range selection ──────────────────────────────
Error: expect(locator).toBeVisible()
Locator: getByText('Nearest Code Block')
Expected: visible
Received: <element(s) not found>
Call log:
- expect.toBeVisible with timeout 5000ms
- waiting for getByText('Nearest Code Block')
111 | // Check the correct range item is auto-selected
112 | const rangeItem = page.getByText('Nearest Code Block')
> 113 | expect(rangeItem).toBeVisible()
| ^
114 |
115 | // Open the range input and check it has the correct item selected
116 | await rangeItem.click()
at D:\a\cody\cody\vscode\test\e2e\command-edit.test.ts:113:23
|
command-edit.test.ts:95:1 › edit (fixup) input - range selection:
vscode\test\e2e\command-edit.test.ts#L118
5) command-edit.test.ts:95:1 › edit (fixup) input - range selection ──────────────────────────────
Error: expect(locator).toBeVisible()
Locator: getByLabel('check file-code Nearest Code Block')
Expected: visible
Received: <element(s) not found>
Call log:
- expect.toBeVisible with timeout 5000ms
- waiting for getByLabel('check file-code Nearest Code Block')
116 | await rangeItem.click()
117 | const selectedRangeItem = page.getByLabel('check file-code Nearest Code Block')
> 118 | expect(selectedRangeItem).toBeVisible()
| ^
119 |
120 | // Open the symbols input and check it has the correct item selected
121 | const symbolitem = page.getByText('Select a Symbol...')
at D:\a\cody\cody\vscode\test\e2e\command-edit.test.ts:118:31
|
command-edit.test.ts:133:1 › edit (fixup) input - model selection:
vscode\test\e2e\command-edit.test.ts#L149
6) command-edit.test.ts:133:1 › edit (fixup) input - model selection ─────────────────────────────
Error: expect(locator).toBeVisible()
Locator: getByLabel('$(anthropic-logo) Claude 3.5').locator('a')
Expected: visible
Received: <element(s) not found>
Call log:
- expect.toBeVisible with timeout 5000ms
- waiting for getByLabel('$(anthropic-logo) Claude 3.5').locator('a')
147 | const modelItem = page.getByLabel('$(anthropic-logo) Claude 3.5').locator('a')
148 | await nap()
> 149 | expect(modelItem).toBeVisible()
| ^
150 |
151 | // Open the model input and check it has the correct item selected
152 | await modelItem.click()
at D:\a\cody\cody\vscode\test\e2e\command-edit.test.ts:149:23
|
command-edit.test.ts:95:1 › edit (fixup) input - range selection:
vscode\test\e2e\command-edit.test.ts#L113
7) command-edit.test.ts:95:1 › edit (fixup) input - range selection ──────────────────────────────
Error: expect(locator).toBeVisible()
Locator: getByText('Nearest Code Block')
Expected: visible
Received: <element(s) not found>
Call log:
- expect.toBeVisible with timeout 5000ms
- waiting for getByText('Nearest Code Block')
111 | // Check the correct range item is auto-selected
112 | const rangeItem = page.getByText('Nearest Code Block')
> 113 | expect(rangeItem).toBeVisible()
| ^
114 |
115 | // Open the range input and check it has the correct item selected
116 | await rangeItem.click()
at D:\a\cody\cody\vscode\test\e2e\command-edit.test.ts:113:23
|
enterprise-cody-ignore.test.ts:43:7 › using actively invoked commands and autocomplete shows a error:
vscode\test\e2e\enterprise-cody-ignore.test.ts#L78
8) enterprise-cody-ignore.test.ts:43:7 › using actively invoked commands and autocomplete shows a error
Error: Timed out 5000ms waiting for expect(locator).toBeVisible()
Locator: getByText('Cody is disabled in this file')
Expected: visible
Received: <element(s) not found>
Call log:
- expect.toBeVisible with timeout 5000ms
- waiting for getByText('Cody is disabled in this file')
76 | // Clicking on the Cody icon shows a message
77 | await statusBarButton.click()
> 78 | await expect(page.getByText('Cody is disabled in this file')).toBeVisible()
| ^
79 | await page.keyboard.press('Escape')
80 |
81 | // Manually invoking autocomplete should show an error
at D:\a\cody\cody\vscode\test\e2e\enterprise-cody-ignore.test.ts:78:71
|
enterprise-cody-ignore.test.ts:43:7 › using actively invoked commands and autocomplete shows a error:
vscode\test\e2e\enterprise-cody-ignore.test.ts#L1
8) enterprise-cody-ignore.test.ts:43:7 › using actively invoked commands and autocomplete shows a error
Error: EBUSY: resource busy or locked, rename 'D:\a\cody\cody\playwright\using_actively_invoked_commands_and_autocomplete_shows_a_error\temp-videos\83d47b0047adc4f4e6e088a2cab07eae.webm' -> 'D:\a\cody\cody\playwright\using_actively_invoked_commands_and_autocomplete_shows_a_error\videos\run_0_retry_0_failure.webm'
|
initial-context.test.ts:83:82 › chat try-again actions:
vscode/test/e2e/initial-context.test.ts#L1
1) initial-context.test.ts:83:82 › chat try-again actions ────────────────────────────────────────
Test timeout of 30000ms exceeded.
|
initial-context.test.ts:83:82 › chat try-again actions:
vscode/test/e2e/common.ts#L173
1) initial-context.test.ts:83:82 › chat try-again actions ────────────────────────────────────────
Error: locator.fill: Application exited
Call log:
- waiting for getByPlaceholder('Type the name of a command to run.')
- locator resolved to <input wrap="off" type="text" class="input" role="combo…/>
- fill("main.c")
- attempting fill action
- waiting for element to be visible, enabled and editable
- element is not visible
- retrying fill action, attempt #1
- waiting for element to be visible, enabled and editable
- element is not visible
- retrying fill action, attempt #2
- waiting 20ms
- waiting for element to be visible, enabled and editable
- element is not visible
- retrying fill action, attempt #3
- waiting 100ms
- waiting for element to be visible, enabled and editable
- element is not visible
- retrying fill action, attempt #4
- waiting 100ms
- waiting for element to be visible, enabled and editable
- element is not visible
- retrying fill action, attempt #5
- waiting 500ms
- waiting for element to be visible, enabled and editable
- element is not visible
- retrying fill action, attempt #6
- waiting 500ms
- waiting for element to be visible, enabled and editable
- element is not visible
- retrying fill action, attempt #7
- waiting 500ms
- waiting for element to be visible, enabled and editable
- element is not visible
- retrying fill action, attempt #8
- waiting 500ms
- waiting for element to be visible, enabled and editable
- element is not visible
- retrying fill action, attempt #9
- waiting 500ms
- waiting for element to be visible, enabled and editable
- element is not visible
- retrying fill action, attempt #10
- waiting 500ms
- waiting for element to be visible, enabled and editable
- element is not visible
- retrying fill action, attempt #11
- waiting 500ms
- waiting for element to be visible, enabled and editable
- element is not visible
- retrying fill action, attempt #12
- waiting 500ms
- waiting for element to be visible, enabled and editable
- element is not visible
- retrying fill action, attempt #13
- waiting 500ms
- waiting for element to be visible, enabled and editable
- element is not visible
- retrying fill action, attempt #14
- waiting 500ms
- waiting for element to be visible, enabled and editable
- element is not visible
- retrying fill action, attempt #15
- waiting 500ms
- waiting for element to be visible, enabled and editable
- element is not visible
- retrying fill action, attempt #16
- waiting 500ms
- waiting for element to be visible, enabled and editable
- element is not visible
- retrying fill action, attempt #17
- waiting 500ms
- waiting for element to be visible, enabled and editable
- element is not visible
- retrying fill action, attempt #18
- waiting 500ms
- waiting for element to be visible, enabled and editable
- element is not visible
- retrying fill action, attempt #19
- waiting 500ms
- waiting for element to be visible, enabled and editable
- element is not visible
- retrying fill action, attempt #20
- waiting 500ms
- waiting for element to be visible, enabled and editable
- element is not visible
- retrying fill action, attempt #21
- waiting 500ms
- waiting for element to be visible, enabled and editable
- element is not visible
- retrying fill action, attempt #22
- waiting 500ms
- waiting for element to be visible, enabled and editable
- element is not visible
- retrying fill
|
test-e2e (ubuntu)
Process completed with exit code 1.
|
🎭 Playwright Run Summary
10 failed
auth.test.ts:22:3 › requires a valid auth token and allows logouts ─────────────────────────────
command-commit.test.ts:24:3 › use terminal output as context ───────────────────────────────────
command-commit.test.ts:24:3 › use terminal output as context ───────────────────────────────────
command-edit.test.ts:95:1 › edit (fixup) input - range selection ───────────────────────────────
command-edit.test.ts:95:1 › edit (fixup) input - range selection ───────────────────────────────
command-edit.test.ts:133:1 › edit (fixup) input - model selection ──────────────────────────────
command-edit.test.ts:95:1 › edit (fixup) input - range selection ───────────────────────────────
enterprise-cody-ignore.test.ts:43:7 › using actively invoked commands and autocomplete shows a error
enterprise-cody-ignore.test.ts:43:7 › using actively invoked commands and autocomplete shows a error
initial-context.test.ts:83:82 › chat try-again actions ─────────────────────────────────────────
12 skipped
158 passed (37.7m)
|
🎭 Playwright Run Summary
1 failed
initial-context.test.ts:83:82 › chat try-again actions ─────────────────────────────────────────
30 skipped
419 passed (1.4h)
|
Artifacts
Produced during runtime
Name | Size | |
---|---|---|
playwright-recordings ubuntu
|
591 KB |
|
playwright-recordings windows
|
859 KB |
|