Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

请教一个多GPU训练的问题 #278

Open
liaoshuren opened this issue Feb 24, 2023 · 1 comment
Open

请教一个多GPU训练的问题 #278

liaoshuren opened this issue Feb 24, 2023 · 1 comment
Labels
dicussion Code understanding

Comments

@liaoshuren
Copy link

我看文档说支持多GPU训练，比如tutorial_BipedalWalker-v3.py里面的例子
args.learner_gpus = [0, 1, 2, 3]
train_agent_multiprocessing(args)
然后我看了一下源码，貌似learner_gpus这个参数后来根本没有用过
train_agent_multiprocessing这里面好像也没有对gpu_id分配的管理
不知道我是不是漏了关键代码了，请问这个多GPU训练是怎么实现的呢？谢谢。
@Yonv1943
Copy link
Collaborator

更新了对 vectorized env 的支持后，我正在重写 多GPU训练模块 并整理了代码 AI4Finance-Foundation/RLSolver#43 (comment)

多GPU训练，将会通过 DataParallel 的 ring AllReduce 实现

@YangletLiu YangletLiu added the dicussion Code understanding label Feb 25, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
dicussion Code understanding
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
3 participants
@liaoshuren @YangletLiu @Yonv1943