Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Improving Task Resubmission in DPDispatcher #320

Open
Cloudac7 opened this issue Apr 10, 2023 · 2 comments
Open

Improving Task Resubmission in DPDispatcher #320

Cloudac7 opened this issue Apr 10, 2023 · 2 comments
Labels
enhancement New feature or request

Comments

@Cloudac7
Copy link
Contributor

Occasionally, tasks in dpdispatcher might crash unexpectedly, causing the need for resubmission. However, this resubmission process can be inconvenient, for example if the original task was almost completed, and the resubmitted task would simply append to the outputs from zero. In order to avoid this in this issue an alternative solution is proposed - backing up the previous output files to another location and then starting a new run from scratch. This approach would improve efficiency and prevent the need for unnecessary resubmissions. Would it be OK to considering this as a potential user story for dpdispatcher?

@njzjz
Copy link
Member

njzjz commented Apr 10, 2023

This is what you need to handle in the command argument. Some program (such as LAMMPS) supports restarting the task from the existing checkpoint, so moving old files away will break the restarting process.

@Cloudac7
Copy link
Contributor Author

This is what you need to handle in the command argument. Some program (such as LAMMPS) supports restarting the task from the existing checkpoint, so moving old files away will break the restarting process.

I knew, for what I am now dealing with is just about restarting in CP2K. However, it might be in risk of just using original CP2K overwriting, for it might cause repeated part in output files for tasks not end in the normal way. Using command might be rather complicated for situation that a lot of output files to be handled. I thought just add a choice instead of only one way might be an alternative solution.

@njzjz njzjz added the enhancement New feature or request label Jun 7, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

2 participants