Supporting Adding DDP Communication Hooks#6736

Merged

SeanNaren merged 56 commits intoLightning-AI:masterfrom shuyingsunshine21:ddp_comm_hook_new

Apr 7, 2021

+309-5

Commits on Mar 23, 2021

Fix some test errors
Shuying Sun
committed
Merge branch 'master' of https://github.com/PyTorchLightning/pytorch-lightning
Shuying Sun
committed

Commits on Mar 24, 2021

Commits on Mar 25, 2021

Merge branch 'master' of https://github.com/PyTorchLightning/pytorch-lightning
Shuying Sun
committed

Commits on Mar 30, 2021

add DDP communication hook
Shuying Sun
committed
remove test related setting
Shuying Sun
committed
remove more test related setting
Shuying Sun
committed
fix ddp comm hook util import issue
Shuying Sun
committed
comments
Shuying Sun
committed
one more fix for test_custom_plugin
Shuying Sun
committed
fix ddp spwan
Shuying Sun
committed
fix sgd
Shuying Sun
committed
address comments and add tests
Shuying Sun
committed

Commits on Mar 31, 2021

1. add is gpu checking 2. modify test a bit 3. formatting
Shuying Sun
committed
formatting nit
Shuying Sun
committed
fix conda 3.7 1.7 issue for no torch.distributed.algorithms module
Shuying Sun
committed

Commits on Apr 1, 2021

need at least 1.8.0
Shuying Sun
committed
minor fix
Shuying Sun
committed
modify changelog
Shuying Sun
committed
changelog should link to PR number instead of issue number
Shuying Sun
committed
refine a bit on doc for register_ddp_comm_hook function, like ddp_comm_wrapper explanation and add hyperparameter for power sgd states in example usge
Shuying Sun
committed
move single device checking before call register_ddp_comm_hook
Shuying Sun
committed

Commits on Apr 2, 2021

formatting
Shuying Sun
committed

Commits on Apr 5, 2021

comments
Shuying Sun
committed
typo
Shuying Sun
committed

Commits on Apr 6, 2021

pre-commit formatting
Shuying Sun
committed
Merge branch 'master' of https://github.com/PyTorchLightning/pytorch-lightning into ddp_comm_hook_new
Shuying Sun
committed