PyTorch implementation of Soft MoE by Google Brain in "From Sparse to Soft Mixtures of Experts" (https://arxiv.org/pdf/2308.00951.pdf)
☆83Oct 5, 2023Updated 2 years ago
Alternatives and similar repositories for soft-mixture-of-experts
Users that are interested in soft-mixture-of-experts are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- PyTorch implementation of "From Sparse to Soft Mixtures of Experts"☆72Aug 22, 2023Updated 3 years ago
- Implementation of Soft MoE, proposed by Brain's Vision team, in Pytorch☆348Apr 2, 2025Updated last year
- Implementation of ST-Moe, the latest incarnation of MoE after years of research at Brain, in Pytorch☆388Jun 17, 2024Updated 2 years ago
- Template repo for Python projects, especially those focusing on machine learning and/or deep learning.☆15Jan 14, 2026Updated 8 months ago
- ☆728Sep 11, 2026Updated 2 weeks ago
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- AdaMoLE: Adaptive Mixture of LoRA Experts☆38Oct 11, 2024Updated last year
- Unofficial Implementation of Selective Attention Transformer☆20Oct 31, 2024Updated last year
- A collection of AWESOME things about mixture-of-experts☆1,288Dec 8, 2024Updated last year
- Implementation of MixCE method described in ACL 2023 paper by Zhang et al.☆20May 29, 2023Updated 3 years ago
- Federated Learning - PyTorch☆15Jun 27, 2021Updated 5 years ago
- Federated learning using a mixture of experts☆17Feb 16, 2021Updated 5 years ago
- [EMNLP'24] Code and data for paper "Ladder: A Model-Agnostic Framework Boosting LLM-based Machine Translation to the Next Level"☆23Jun 29, 2024Updated 2 years ago
- ☆16Dec 31, 2021Updated 4 years ago
- ☆13Jan 27, 2019Updated 7 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- ☆25Aug 2, 2024Updated 2 years ago
- List of papers on Hallucination in LMM☆10Nov 29, 2023Updated 2 years ago
- Experiments to assess SPADE on different LLM pipelines.☆18Apr 7, 2024Updated 2 years ago
- ☆30Sep 28, 2023Updated 3 years ago
- a fast implementation of BM25☆10Sep 15, 2022Updated 4 years ago
- The code for paper: PeFoMed: Parameter Efficient Fine-tuning on Multi-modal Large Language Models for Medical Visual Question Answering☆65Dec 21, 2025Updated 9 months ago
- Implementation of "Towards Understanding Mixture of Experts in Deep Learning", NeurIPS 2022☆10Jan 6, 2023Updated 3 years ago
- Towards Understanding the Mixture-of-Experts Layer in Deep Learning☆37Dec 12, 2023Updated 2 years ago
- Pytorch-based adaptive deformable convolution☆17Jun 26, 2021Updated 5 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Links to publications that focus on the interpretation and analysis of in-context learning☆14Oct 17, 2024Updated last year
- ☆96Apr 3, 2023Updated 3 years ago
- ☆29May 4, 2024Updated 2 years ago
- Learning generative models with Sinkhorn Loss☆32Nov 9, 2018Updated 7 years ago
- ☆14Jun 11, 2024Updated 2 years ago
- ☆18Mar 18, 2024Updated 2 years ago
- Machine learning project using federated learning for text generation☆11May 5, 2024Updated 2 years ago
- Map (deep learning) model weights between different model implementations.☆19Mar 9, 2026Updated 6 months ago
- Federated Reinforcement Learning☆12Jun 20, 2019Updated 7 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- ICCV2021 (poster)☆72Oct 27, 2021Updated 4 years ago
- 使用投毒posion的方式backdoor攻击LeNet-5网络，使用MNIST手写数据集☆14Feb 5, 2021Updated 5 years ago
- The code of paper "Learning Heterogeneous Strategies via Graph-based Multi-agent Reinforcement Learning in Mixed Cooperative-Competitive …☆16Jul 17, 2021Updated 5 years ago
- S$2$CycleDiff: Spatial-Spectral-Bilateral Cycle-Diffusion Frameworkfor Hyperspectral Image Super-Resolution(AAAI 2024)☆17Aug 14, 2025Updated last year
- A Pytorch implementation of Sparsely-Gated Mixture of Experts, for massively increasing the parameter count of language models☆873Sep 13, 2023Updated 3 years ago
- Triton-based implementation of Sparse Mixture of Experts.☆279Oct 3, 2025Updated 11 months ago
- ☆20Sep 18, 2026Updated last week