-
-
Notifications
You must be signed in to change notification settings - Fork 1.3k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
[core] Test charts
performance with codspeed
#13952
Conversation
Deploy preview: https://deploy-preview-13952--material-ui-x.netlify.app/ |
CodSpeed Performance ReportCongrats! CodSpeed is installed 🎉
You will start to see performance impacts in the reports once the benchmarks are run from your default branch.
|
push: | ||
branches: | ||
- 'master' | ||
- 'next' | ||
paths: | ||
- 'packages/x-charts*/**' |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
We could change this to "release" instead, to update the base "bechmarks" release-by-release instead of every push to master
This pull request has conflicts, please resolve those before we can evaluate the pull request. |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Looks good. I'm curious to see how this new tool will integrate in our workflow
This pull request has conflicts, please resolve those before we can evaluate the pull request. |
export default defineConfig({ | ||
plugins: [codspeedPlugin(), react()], | ||
test: { | ||
environment: 'jsdom', |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Are you sure that jsdom is where you want to test performance? Imo, as an emulated test environment it has more chances of diverging from what users see in real-world cases.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Yes, we took that into account. It is better than nothing right now. We want to know if the changes we introduce affect the rendering times by a significant % amount, not necessarily real user times.
Once the platform supports testing using browser/playwright we will definitely change to use that instead.
This is also "free" for us right now.
Initial testing of the charts performance using codspeed
Reports
You can see a live report example at: JCQuintas#4
Unchanged
Regressions/Improvements
Accepting regressions
Once there is a regression over our delimited threshold (currently 10%), we need to manually accept that in their UI.