Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

MongoDB doc size can exceed limit for veto_intervals #1151

Open
cfuselli opened this issue Apr 6, 2023 · 0 comments
Open

MongoDB doc size can exceed limit for veto_intervals #1151

cfuselli opened this issue Apr 6, 2023 · 0 comments
Assignees
Labels
bug Something isn't working

Comments

@cfuselli
Copy link
Member

cfuselli commented Apr 6, 2023

Describe the bug
If too many veto intervals are fired, the size of veto_intervals can become too big (>16MB) to be uploaded in the online monitor frontend (see here).

This happened for example for run 051642 (due to intense HEV). The outcome is that the entire processing for the run fails.

The error states:

2023-04-03 13:05:01.133224 | INFO     | process_run (L1419)  | Still processing run 051642. PID:18185
Exception in thread save_1:veto_intervals:
Traceback (most recent call last):
.
.
.
    raise DocumentTooLarge(
pymongo.errors.DocumentTooLarge: BSON document too large (24848171 bytes) - the connected server supports BSON document sizes up to 16793598 bytes.

Maybe need to include this into online_monitor data types with some kind of size check.

@cfuselli cfuselli added the bug Something isn't working label Apr 6, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
Development

No branches or pull requests

2 participants