davidmrau / mixture-of-experts

PyTorch Re-Implementation of "The Sparsely-Gated Mixture-of-Experts Layer" by Noam Shazeer et al. https://arxiv.org/abs/1701.06538
974Updated 6 months ago

Related projects

Alternatives and complementary repositories for mixture-of-experts