Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

RuntimeError in make_model_devi step #262

Open
wankiwi opened this issue Sep 20, 2022 · 5 comments
Open

RuntimeError in make_model_devi step #262

wankiwi opened this issue Sep 20, 2022 · 5 comments
Labels
bug Something isn't working

Comments

@wankiwi
Copy link

wankiwi commented Sep 20, 2022

After I updated the dpdispatcher version to 0.4.18, I got the following error when DPGEN performed the make_model_devi, which can be solved when downgrading dpdispatcher to 0.4.17.

2022-09-20 04:00:40,341 - INFO : job: 31fcd1c1d95b2fedff35615bf29adbc61e3057e5 315398 finished
INFO:dpgen:-------------------------iter.000007 task 02--------------------------
INFO:dpgen:-------------------------iter.000007 task 03--------------------------
INFO:dpgen:-------------------------iter.000007 task 04--------------------------
Traceback (most recent call last):
  File "/home/kwwan/.local/bin/dpgen", line 8, in <module>
    sys.exit(main())
  File "/home/kwwan/.local/lib/python3.8/site-packages/dpgen/main.py", line 185, in main
    args.func(args)
  File "/home/kwwan/.local/lib/python3.8/site-packages/dpgen/generator/run.py", line 3914, in gen_run
    run_iter (args.PARAM, args.MACHINE)
  File "/home/kwwan/.local/lib/python3.8/site-packages/dpgen/generator/run.py", line 3787, in run_iter
    run_model_devi (ii, jdata, mdata)
  File "/home/kwwan/.local/lib/python3.8/site-packages/dpgen/generator/run.py", line 1614, in run_model_devi
    run_md_model_devi(iter_index,jdata,mdata)
  File "/home/kwwan/.local/lib/python3.8/site-packages/dpgen/generator/run.py", line 1608, in run_md_model_devi
    submission.run_submission()
  File "/home/kwwan/software/Anaconda3/lib/python3.8/site-packages/dpdispatcher/submission.py", line 176, in run_submission
    self.generate_jobs()
  File "/home/kwwan/software/Anaconda3/lib/python3.8/site-packages/dpdispatcher/submission.py", line 340, in generate_jobs
    self.bind_machine(self.machine)
  File "/home/kwwan/software/Anaconda3/lib/python3.8/site-packages/dpdispatcher/submission.py", line 163, in bind_machine
    self.machine.context.bind_submission(self)
  File "/home/kwwan/software/Anaconda3/lib/python3.8/site-packages/dpdispatcher/ssh_context.py", line 389, in bind_submission
    self.block_checkcall(f"mv {old_remote_root} {self.remote_root}")
  File "/home/kwwan/software/Anaconda3/lib/python3.8/site-packages/dpdispatcher/ssh_context.py", line 537, in block_checkcall
    raise RuntimeError("Get error code %d in calling %s through ssh with job: %s . message: %s" %
RuntimeError: Get error code 1 in calling mv /data/home/scv3616/run/wankw/temp/dpmd_remote/447fbf8e9ee0ecc33a67e8f01f1847a2d3888f29 /data/home/scv3616/run/wankw/temp/dpmd_remote/5b3271c64c830aca6cfc836322191dc2482054ad through ssh with job: 5b3271c64c830aca6cfc836322191dc2482054ad . message:
@HuangJiameng
Copy link
Contributor

Maybe #261 is related to it?

@njzjz
Copy link
Member

njzjz commented Sep 20, 2022

Task 04 is the run_model_devi step. Your stderr message is empty. Can you try to execute it manually?

@wankiwi
Copy link
Author

wankiwi commented Sep 20, 2022

Task 04 is the run_model_devi step. Your stderr message is empty. Can you try to execute it manually?

I can't do it manually, for I have downgraded dpdispatcher to 0.4.17 and it executed run_model_devi successfully.

@njzjz
Copy link
Member

njzjz commented Sep 20, 2022

I can't reproduce it. @HuangJiameng Do you have the same issue?

@wankiwi
Copy link
Author

wankiwi commented Sep 21, 2022

I can't reproduce it. @HuangJiameng Do you have the same issue?

I don’t know if it is helpful for you to reproduce this error, I used this branch in order to use the merge_traj function

@njzjz njzjz added the bug Something isn't working label Nov 5, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
Development

No branches or pull requests

3 participants