New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Support file storage in mongodb #29

Open

rekumar opened this issue Jul 31, 2023 · 0 comments

Labels

feature request

Collaborator

rekumar commented Jul 31, 2023

Currently, we can't store images/etc in the mongodb. This will be needed for sure later

Proposed initial solution:

enable GridFS in ALab collections by default. This should scale for some time, but in ~years timeframe present performance issues in our mongodb

Longer-term solution:

link blob storage (Google bucket, AWS EC2, etc) to our database. Raw files uploaded to blob storage, key stored in mongodb. This requires another service + a data schema, + updates to all our surrounding code. Maggma can provide a wrapper to simplify this implementation.

bernardusrendy added the feature request label

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment