yanring / Megatron-MoE-ModelZooLinks

Best practices for training DeepSeek, Mixtral, Qwen and other MoE models using Megatron Core.
64Updated this week

Alternatives and similar repositories for Megatron-MoE-ModelZoo

Users that are interested in Megatron-MoE-ModelZoo are comparing it to the libraries listed below

Sorting: