Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Attempt to remove some e2e flakiness #9423

Merged
merged 8 commits into from
Sep 9, 2024
Merged

Conversation

lukasmasuch
Copy link
Collaborator

@lukasmasuch lukasmasuch commented Sep 9, 2024

Describe your changes

This PR attempts to reduce some e2e test flakiness based on this list.

Replaced the cat image with a black image since it seems that it sometimes leads to a non-sharp version of the image being screenshotted -> which likely results from some browser optimization that first shows a less detailed version of the image. Since the test is about columns and not our image rendering, I just replaced it with a black image to avoid this issue.

Testing Plan

  • PR only contains test changes.

Contribution License Agreement

By submitting this pull request you agree that all contributions to this project are made under the Apache 2.0 license.

@lukasmasuch lukasmasuch changed the title Attempt to remove e2e flakiness Attempt to remove some e2e flakiness Sep 9, 2024
@lukasmasuch lukasmasuch marked this pull request as ready for review September 9, 2024 10:12
Copy link
Collaborator

@raethlein raethlein left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM, thank you! Could you please update the PR description with an information why the cat image was replaced. Based on our conversation it has something to do with the fact that sometimes the images are shown in a lower resolution in the beginning, probably due to some browser-behavior. It'd be great to capture this in the PR for future reference.

LOREM_IPSUM = "Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua."

BLACK_IMG = np.repeat(0, 601350).reshape(633, 950)
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Replaced the cat image with a black image since it seems that it sometimes leads to a non-sharp version of the image being screenshotted -> which likely is a result of some browser optimization that first shows a less detailed version of the image. Since the test is about columns and not our image rendering, I just replaced it with a black image to not run into this issue.

@lukasmasuch lukasmasuch merged commit 61fe828 into develop Sep 9, 2024
33 checks passed
@lukasmasuch lukasmasuch deleted the fix/flaky-e2e-tests branch September 9, 2024 14:49
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants