yanring / Megatron-MoE-ModelZooLinks

Best practices for testing advanced Mixtral, DeepSeek, and Qwen series MoE models using Megatron Core MoE.
17Updated this week

Alternatives and similar repositories for Megatron-MoE-ModelZoo

Users that are interested in Megatron-MoE-ModelZoo are comparing it to the libraries listed below

Sorting: