Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Replay past data when starting a new worker to initialize function state #1449

Open
rixed opened this issue Mar 17, 2022 · 0 comments
Open

Comments

@rixed
Copy link
Owner

rixed commented Mar 17, 2022

A replay request will replay further back in history than the requested range to make sure the first point of the requested range will account for the recent past of that function. Similarly when starting a new worker, we ideally want to start from where the function would be if it had started earlier.

In practice, it means that when starting a worker supervisor should also start past replayers (but not for the started worker itself), and the started worker would first act as a replayer before transitioning to normal front time worker, with its internal state.

Alternatively, we could have a normal replay up to the front time, and the snapshotted internal state of the last worker be transfered to the new worker.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant