Expose DeepSpeed FP16 parameters due to loss instability#6115

Merged

Borda merged 4 commits intomasterfrom fix/fp16_enable

Feb 21, 2021

+92-15

Commits on Feb 21, 2021

Expose deepspeed config parameters to init function due to instability in parameters
SeanNaren
committed
See if tests can run on normal CI, without special tests
SeanNaren
committed
Add changelog
SeanNaren
committed
Update pytorch_lightning/plugins/training_type/deepspeed.py

SeanNaren
and
carmocca
authored