deepspeedai / Megatron-DeepSpeedLinks

Ongoing research training transformer language models at scale, including: BERT & GPT-2
2,078Updated 2 months ago

Alternatives and similar repositories for Megatron-DeepSpeed

Users that are interested in Megatron-DeepSpeed are comparing it to the libraries listed below

Sorting: