Skip to content

[fix] fix OOM when megatron loading large model by only rank 0 loads weights #462

[fix] fix OOM when megatron loading large model by only rank 0 loads weights

[fix] fix OOM when megatron loading large model by only rank 0 loads weights #462