Skip to content

[fix] fix OOM when megatron loading large model by only rank 0 loads weights #445

[fix] fix OOM when megatron loading large model by only rank 0 loads weights

[fix] fix OOM when megatron loading large model by only rank 0 loads weights #445