Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

failsOnMKI: serverless goal visualization test suite #191238

Closed
pheyos opened this issue Aug 24, 2024 · 1 comment
Closed

failsOnMKI: serverless goal visualization test suite #191238

pheyos opened this issue Aug 24, 2024 · 1 comment
Assignees
@mbondyra
Labels
failed-test A test failure on a tracked branch, potentially flaky-test Team:Visualizations Visualization editors, elastic-charts and infrastructure

Comments

@pheyos
Copy link
Member

pheyos commented Aug 24, 2024 •
edited
Loading

The serverless goal visualization test suite started to fail consistently (all of the last 8 runs) when running against MKI.

Test file: x-pack/test_serverless/functional/test_suites/common/visualizations/group2/open_in_lens/agg_based/goal.ts

Note that this might be related to a recent update of the used Chrome browser version which was held back for local / PR testing.

Failure details

Visualizations - Group 2 lens app - Agg based Vis Open in Lens Goal should convert color ranges

Failure message:

Error: expected [ { title: 'osx',
    subtitle: 'Average machine.ram',
    extraText: '',
    value: '13,228,964,670.613',
    color: 'rgba(255, 255, 255, 1)',
    trendlineColor: undefined,
    showingTrendline: false,
    showingBar: true },
  { title: 'win 7',
    subtitle: 'Average machine.ram',
    extraText: '',
    value: '13,186,695,551.251',
    color: 'rgba(255, 255, 255, 1)',
    trendlineColor: undefined,
    showingTrendline: false,
    showingBar: true },
  { title: 'win xp',
    subtitle: 'Average machine.ram',
    extraText: '',
    value: '13,073,190,186.423',
    color: 'rgba(255, 255, 255, 1)',
    trendlineColor: undefined,
    showingTrendline: false,
    showingBar: true },
  { title: 'win 8',
    subtitle: 'Average machine.ram',
    extraText: '',
    value: '13,031,579,645.108',
    color: 'rgba(242, 242, 242, 1)',
    trendlineColor: undefined,
    showingTrendline: false,
    showingBar: true },
  { title: 'ios',
    subtitle: 'Average machine.ram',
    extraText: '',
    value: '13,009,497,206.823',
    color: 'rgba(255, 255, 255, 1)',
    trendlineColor: undefined,
    showingTrendline: false,
    showingBar: true },
  { title: undefined,
    subtitle: undefined,
    extraText: undefined,
    value: undefined,
    color: 'rgba(255, 255, 255, 1)',
    trendlineColor: undefined,
    showingTrendline: false,
    showingBar: true } ] to sort of equal [ { title: 'osx',
    subtitle: 'Average machine.ram',
    extraText: '',
    value: '13,228,964,670.613',
    color: 'rgba(255, 255, 255, 1)',
    trendlineColor: undefined,
    showingTrendline: false,
    showingBar: true },
  { title: 'win 7',
    subtitle: 'Average machine.ram',
    extraText: '',
    value: '13,186,695,551.251',
    color: 'rgba(255, 255, 255, 1)',
    trendlineColor: undefined,
    showingTrendline: false,
    showingBar: true },
  { title: 'win xp',
    subtitle: 'Average machine.ram',
    extraText: '',
    value: '13,073,190,186.423',
    color: 'rgba(255, 255, 255, 1)',
    trendlineColor: undefined,
    showingTrendline: false,
    showingBar: true },
  { title: 'win 8',
    subtitle: 'Average machine.ram',
    extraText: '',
    value: '13,031,579,645.108',
    color: 'rgba(255, 255, 255, 1)',
    trendlineColor: undefined,
    showingTrendline: false,
    showingBar: true },
  { title: 'ios',
    subtitle: 'Average machine.ram',
    extraText: '',
    value: '13,009,497,206.823',
    color: 'rgba(255, 255, 255, 1)',
    trendlineColor: undefined,
    showingTrendline: false,
    showingBar: true },
  { title: undefined,
    subtitle: undefined,
    extraText: undefined,
    value: undefined,
    color: 'rgba(255, 255, 255, 1)',
    trendlineColor: undefined,
    showingTrendline: false,
    showingBar: true } ]
    at Assertion.assert (expect.js:100:11)
    at Assertion.eql (expect.js:244:8)
    at Context. (goal.ts:134:23)
    at processTicksAndRejections (node:internal/process/task_queues:95:5)
    at Object.apply (wrap_function.js:73:16) {
  actual: '[\n' +
    '  {\n' +
    '    "color": "rgba(255, 255, 255, 1)"\n' +
    '    "extraText": ""\n' +
    '    "showingBar": true\n' +
    '    "showingTrendline": false\n' +
    '    "subtitle": "Average machine.ram"\n' +
    '    "title": "osx"\n' +
    '    "trendlineColor": [undefined]\n' +
    '    "value": "13,228,964,670.613"\n' +
    '  }\n' +
    '  {\n' +
    '    "color": "rgba(255, 255, 255, 1)"\n' +
    '    "extraText": ""\n' +
    '    "showingBar": true\n' +
    '    "showingTrendline": false\n' +
    '    "subtitle": "Average machine.ram"\n' +
    '    "title": "win 7"\n' +
    '    "trendlineColor": [undefined]\n' +
    '    "value": "13,186,695,551.251"\n' +
    '  }\n' +
    '  {\n' +
    '    "color": "rgba(255, 255, 255, 1)"\n' +
    '    "extraText": ""\n' +
    '    "showingBar": true\n' +
    '    "showingTrendline": false\n' +
    '    "subtitle": "Average machine.ram"\n' +
    '    "title": "win xp"\n' +
    '    "trendlineColor": [undefined]\n' +
    '    "value": "13,073,190,186.423"\n' +
    '  }\n' +
    '  {\n' +
    '    "color": "rgba(242, 242, 242, 1)"\n' +
    '    "extraText": ""\n' +
    '    "showingBar": true\n' +
    '    "showingTrendline": false\n' +
    '    "subtitle": "Average machine.ram"\n' +
    '    "title": "win 8"\n' +
    '    "trendlineColor": [undefined]\n' +
    '    "value": "13,031,579,645.108"\n' +
    '  }\n' +
    '  {\n' +
    '    "color": "rgba(255, 255, 255, 1)"\n' +
    '    "extraText": ""\n' +
    '    "showingBar": true\n' +
    '    "showingTrendline": false\n' +
    '    "subtitle": "Average machine.ram"\n' +
    '    "title": "ios"\n' +
    '    "trendlineColor": [undefined]\n' +
    '    "value": "13,009,497,206.823"\n' +
    '  }\n' +
    '  {\n' +
    '    "color": "rgba(255, 255, 255, 1)"\n' +
    '    "extraText": [undefined]\n' +
    '    "showingBar": true\n' +
    '    "showingTrendline": false\n' +
    '    "subtitle": [undefined]\n' +
    '    "title": [undefined]\n' +
    '    "trendlineColor": [undefined]\n' +
    '    "value": [undefined]\n' +
    '  }\n' +
    ']',
  expected: '[\n' +
    '  {\n' +
    '    "color": "rgba(255, 255, 255, 1)"\n' +
    '    "extraText": ""\n' +
    '    "showingBar": true\n' +
    '    "showingTrendline": false\n' +
    '    "subtitle": "Average machine.ram"\n' +
    '    "title": "osx"\n' +
    '    "trendlineColor": [undefined]\n' +
    '    "value": "13,228,964,670.613"\n' +
    '  }\n' +
    '  {\n' +
    '    "color": "rgba(255, 255, 255, 1)"\n' +
    '    "extraText": ""\n' +
    '    "showingBar": true\n' +
    '    "showingTrendline": false\n' +
    '    "subtitle": "Average machine.ram"\n' +
    '    "title": "win 7"\n' +
    '    "trendlineColor": [undefined]\n' +
    '    "value": "13,186,695,551.251"\n' +
    '  }\n' +
    '  {\n' +
    '    "color": "rgba(255, 255, 255, 1)"\n' +
    '    "extraText": ""\n' +
    '    "showingBar": true\n' +
    '    "showingTrendline": false\n' +
    '    "subtitle": "Average machine.ram"\n' +
    '    "title": "win xp"\n' +
    '    "trendlineColor": [undefined]\n' +
    '    "value": "13,073,190,186.423"\n' +
    '  }\n' +
    '  {\n' +
    '    "color": "rgba(255, 255, 255, 1)"\n' +
    '    "extraText": ""\n' +
    '    "showingBar": true\n' +
    '    "showingTrendline": false\n' +
    '    "subtitle": "Average machine.ram"\n' +
    '    "title": "win 8"\n' +
    '    "trendlineColor": [undefined]\n' +
    '    "value": "13,031,579,645.108"\n' +
    '  }\n' +
    '  {\n' +
    '    "color": "rgba(255, 255, 255, 1)"\n' +
    '    "extraText": ""\n' +
    '    "showingBar": true\n' +
    '    "showingTrendline": false\n' +
    '    "subtitle": "Average machine.ram"\n' +
    '    "title": "ios"\n' +
    '    "trendlineColor": [undefined]\n' +
    '    "value": "13,009,497,206.823"\n' +
    '  }\n' +
    '  {\n' +
    '    "color": "rgba(255, 255, 255, 1)"\n' +
    '    "extraText": [undefined]\n' +
    '    "showingBar": true\n' +
    '    "showingTrendline": false\n' +
    '    "subtitle": [undefined]\n' +
    '    "title": [undefined]\n' +
    '    "trendlineColor": [undefined]\n' +
    '    "value": [undefined]\n' +
    '  }\n' +
    ']',
  showDiff: true
}

Failure screenshot:
image
@pheyos pheyos added Team:Visualizations Visualization editors, elastic-charts and infrastructure failed-test A test failure on a tracked branch, potentially flaky-test labels Aug 24, 2024
@elasticmachine
Copy link
Contributor

Pinging @elastic/kibana-visualizations (Team:Visualizations)

@pheyos pheyos mentioned this issue Aug 24, 2024
Merged
pheyos added a commit that referenced this issue Aug 24, 2024
@pheyos
Skip failing serverless discover and visualize tests for MKI (#191239)
1a72764 
## Summary

This PR skips the failing serverless discover and visualize tests for
MKI runs.

For more details, see the corresponding issues #191237 and #191238.
@mbondyra mbondyra self-assigned this Aug 27, 2024
@mbondyra mbondyra mentioned this issue Aug 27, 2024
Merged
mbondyra added a commit that referenced this issue Aug 27, 2024
@mbondyra
[Managed Content] fix flaky tests (#191388)
2a033c1 
## Summary

Fixes #190227

Fixes #190737
#190990
#190802
#179307 (couldn't find the
rootcause so just decided to align the solution with other files that
follow similar path and are not flaky)

Fixes #191151
#191152
#191176
#191177
#191178
#191153
#191238

Fixes #190711
kibanamachine pushed a commit to kibanamachine/kibana that referenced this issue Aug 27, 2024
@mbondyra
[Managed Content] fix flaky tests (elastic#191388)
d062a5f 
## Summary

Fixes elastic#190227

Fixes elastic#190737
elastic#190990
elastic#190802
elastic#179307 (couldn't find the
rootcause so just decided to align the solution with other files that
follow similar path and are not flaky)

Fixes elastic#191151
elastic#191152
elastic#191176
elastic#191177
elastic#191178
elastic#191153
elastic#191238

Fixes elastic#190711

(cherry picked from commit 2a033c1)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@mbondyra mbondyra

Labels
failed-test A test failure on a tracked branch, potentially flaky-test Team:Visualizations Visualization editors, elastic-charts and infrastructure
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
3 participants
@pheyos @mbondyra @elasticmachine