New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Multi-GPU and distributed training support #2

Open

HopLee6 opened this issue May 6, 2021 · 2 comments

HopLee6 commented May 6, 2021

No description provided.

Owner

miracleyoo commented Jul 5, 2021

这是pytorch-lightning默认支持的。 --gpus=N 即可，N为你的GPU数量。

ghoshaw commented Aug 17, 2022

如果加了 training_epoch_end 的实现，不需要在这个函数下面将所有的卡的loss gather到一起吗？
对于validation_epoch_end 不需要将所有卡的结果 gather到一起吗？

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment