Skip to content

[fix] fix OOM when megatron loading large model by only rank 0 loads weights #461

[fix] fix OOM when megatron loading large model by only rank 0 loads weights

[fix] fix OOM when megatron loading large model by only rank 0 loads weights #461