Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

train error (nccl) torch.distributed #280

Open
bis70 opened this issue Aug 29, 2022 · 2 comments
Open

train error (nccl) torch.distributed #280

bis70 opened this issue Aug 29, 2022 · 2 comments

Comments

@bis70
Copy link

bis70 commented Aug 29, 2022

I think your work is great. Unfortunately I do not manage to train the NN. The following error message appears in the console:

(rife) PS C:\Users\C\PycharmProjects\RIFE> python -m torch.distributed.launch --nproc_per_node=1 train.py --world_size=1

Traceback (most recent call last):
File "train.py", line 146, in
torch.distributed.init_process_group(backend="nccl", world_size=args.world_size)
AttributeError: module 'torch.distributed' has no attribute 'init_process_group'
Traceback (most recent call last):
File "C:\ProgramData\Anaconda3\envs\rife\lib\runpy.py", line 194, in _run_module_as_main
return _run_code(code, main_globals, None,
File "C:\ProgramData\Anaconda3\envs\rife\lib\runpy.py", line 87, in _run_code
exec(code, run_globals)
File "C:\ProgramData\Anaconda3\envs\rife\lib\site-packages\torch\distributed\launch.py", line 261, in
main()
File "C:\ProgramData\Anaconda3\envs\rife\lib\site-packages\torch\distributed\launch.py", line 256, in main
raise subprocess.CalledProcessError(returncode=process.returncode,
subprocess.CalledProcessError: Command '['C:\ProgramData\Anaconda3\envs\rife\python.exe', '-u', 'train.py', '--local_rank=0', '--world_size=1']' returned non-zero exit status 1.

@hzwer
Copy link
Owner

hzwer commented Aug 29, 2022

Please check pytorch/examples#467. It seems to be a OS-torch related issue.

@bis70
Copy link
Author

bis70 commented Sep 1, 2022

The link leads to a MacOS problem, I use Windows. Well maybe I will find the problem somewhere else

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants