Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

MP+: utilize ReadWriteMany volumes for repository cache #476

Open
2 tasks done
jpopelka opened this issue Apr 14, 2023 · 1 comment
Open
2 tasks done

MP+: utilize ReadWriteMany volumes for repository cache #476

jpopelka opened this issue Apr 14, 2023 · 1 comment
Labels
area/general Related to whole service, not a specific part/integration. complexity/single-task Regular task, should be done within days. gain/low This doesn't bring that much value to users. impact/low This issue impacts only a few users. kind/internal Doesn't affect users directly, may be e.g. infrastructure, DB related.

Comments

@jpopelka
Copy link
Member

jpopelka commented Apr 14, 2023 •
edited
Loading

Description

So far, we've been using only block storage (AWS EBS), which can't be accessed in ReadWriteMany mode.
Because of that, we need to have one repository cache for each worker - see #210

On MP+ we can also use AWS EFS file storage (basically NFS - network file system) which can be accessed in ReadWriteMany mode.

Hence, after we have both, stg & prod on MP+, we can consolidate all the RWO worker volumes (1+1 per long-running worker) we use for the repository cache into one(?) RWX.

And we can change workers from StatefulSet to Deployment at the same time, I guess.

Benefit

The long-running workers will use significantly less disk space (1 volume instead of 4 for 2 l-r workers)

Importance

gain/low, impact/low

Workaround

  • There is an existing workaround that can be used until this feature is implemented.

Participation

  • I am willing to submit a pull request for this issue. (Packit team is happy to help!)
@jpopelka jpopelka mentioned this issue Apr 14, 2023
Closed
@lachmanfrantisek lachmanfrantisek added area/general Related to whole service, not a specific part/integration. complexity/single-task Regular task, should be done within days. gain/low This doesn't bring that much value to users. impact/low This issue impacts only a few users. kind/internal Doesn't affect users directly, may be e.g. infrastructure, DB related. labels Apr 20, 2023
@lachmanfrantisek lachmanfrantisek moved this from new to backlog in Packit Kanban Board Apr 20, 2023
@jpopelka jpopelka changed the title Worker & sandcastle: utilize ReadWriteMany volumes MP+: utilize ReadWriteMany volumes for repository cache Apr 21, 2023
@nforro
Copy link
Member

nforro commented Nov 14, 2024

Still relevant.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
area/general Related to whole service, not a specific part/integration. complexity/single-task Regular task, should be done within days. gain/low This doesn't bring that much value to users. impact/low This issue impacts only a few users. kind/internal Doesn't affect users directly, may be e.g. infrastructure, DB related.
Projects
Packit Kanban Board
Status: backlog
Milestone
No milestone
Development

No branches or pull requests
3 participants
@jpopelka @nforro @lachmanfrantisek