DEVPROD-6072 Add new degraded mode associated limits #8089
Conversation
model/project_parser_s3.go
Outdated
| @@ -12,6 +12,9 @@ import ( | |||
| "go.mongodb.org/mongo-driver/bson" | |||
| ) | |||
|
|
|||
| // sizeLimit is a hard limit on parser project size. | |||
| const sizeLimit = 1024 * 1024 * 50 | |||
There was a problem hiding this comment.
Do we need a hard-coded size limit? I thought the parser project size was supposed to be configurable from the admin settings so we could incrementally raise it in a controlled way.
I believe the actual current limitation is below 50 MB (depending on the concurrency setting), so we would likely want to adjust this value over time (on top of the degraded size limit) as we understand what Evergreen can and can't tolerate.
There was a problem hiding this comment.
Updated this to be more easily changeable.
I'm not aware of any current limitation beyond the 16MB document limit though:
I believe the actual current limitation is below 50 MB (depending on the concurrency setting)
Where can I find this?
| <md-input-container class="control" style="width:45%;"> | ||
| <label>Max Parser Project Size</label> | ||
| <input type="number" ng-model="Settings.task_limits.max_parser_project_size"> | ||
| </md-input-container> |
There was a problem hiding this comment.
nit: might be slightly nicer if these were expressed in MB (or otherwise, if the admin settings page clarified that the unit is bytes vs. MB).
DEVPROD-6072
Description
There will be a followup PR that makes use of these two new limits.
Testing
Existing