PyTorch implementation of Soft MoE by Google Brain in "From Sparse to Soft Mixtures of Experts" (https://arxiv.org/pdf/2308.00951.pdf)
☆83Oct 5, 2023Updated 2 years ago
Alternatives and similar repositories for soft-mixture-of-experts
Users that are interested in soft-mixture-of-experts are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- PyTorch implementation of "From Sparse to Soft Mixtures of Experts"☆72Aug 22, 2023Updated 2 years ago
- Implementation of Soft MoE, proposed by Brain's Vision team, in Pytorch☆348Apr 2, 2025Updated last year
- Implementation of ST-Moe, the latest incarnation of MoE after years of research at Brain, in Pytorch☆387Jun 17, 2024Updated 2 years ago
- Template repo for Python projects, especially those focusing on machine learning and/or deep learning.☆15Jan 14, 2026Updated 7 months ago
- ☆727Aug 6, 2026Updated last week
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- Unofficial Implementation of Selective Attention Transformer☆20Oct 31, 2024Updated last year
- A collection of AWESOME things about mixture-of-experts☆1,287Dec 8, 2024Updated last year
- Implementation of MixCE method described in ACL 2023 paper by Zhang et al.☆20May 29, 2023Updated 3 years ago
- Federated Learning - PyTorch☆15Jun 27, 2021Updated 5 years ago
- ☆21Oct 31, 2022Updated 3 years ago
- Official repository for the paper "Approximating Two-Layer Feedforward Networks for Efficient Transformers"☆39Jun 11, 2025Updated last year
- ☆25Aug 2, 2024Updated 2 years ago
- ☆11Nov 27, 2025Updated 8 months ago
- GPT-J 6B inference on TensorRT with INT-8 precision☆11Apr 5, 2023Updated 3 years ago
- End-to-end encrypted cloud storage - Proton Drive • AdSpecial offer: 40% Off Yearly / 80% Off First Month. Protect your most important files, photos, and documents from prying eyes.
- ☆12Jul 18, 2023Updated 3 years ago
- The code for paper: PeFoMed: Parameter Efficient Fine-tuning on Multi-modal Large Language Models for Medical Visual Question Answering☆64Dec 21, 2025Updated 7 months ago
- Towards Understanding the Mixture-of-Experts Layer in Deep Learning☆36Dec 12, 2023Updated 2 years ago
- Pytorch-based adaptive deformable convolution☆17Jun 26, 2021Updated 5 years ago
- Reimplementation of https://github.com/montemac/algebraic_value_editing in pure PyTorch for efficiency on large models☆11Jun 28, 2023Updated 3 years ago
- GPT-2 small trained on phi-like data☆68Feb 18, 2024Updated 2 years ago
- Official code repository of Laplacian Pyramid Pansharpening Network☆26May 28, 2024Updated 2 years ago
- UWSOD: Toward Fully-Supervised-Level Capacity Weakly Supervised Object Detection☆23Mar 30, 2021Updated 5 years ago
- Provably (and non-vacuously) bounding test error of deep neural networks under distribution shift with unlabeled test data.☆10Feb 27, 2024Updated 2 years ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- Included the standard NMS, Rotate NMS，standard SoftNMS, Rotate SoftNMS, Weighted NMS, Rotate Weighted NMS, Weighted-Boxes-Fusion, Rotate …☆15Oct 11, 2021Updated 4 years ago
- ☆96Apr 3, 2023Updated 3 years ago
- Learning generative models with Sinkhorn Loss☆32Nov 9, 2018Updated 7 years ago
- ☆14Jun 11, 2024Updated 2 years ago
- Map (deep learning) model weights between different model implementations.☆19Mar 9, 2026Updated 5 months ago
- "Tail-Aware Sperm Analysis for Transparent Tracking of Spermatozoa" Official Implementation☆10Jan 21, 2026Updated 6 months ago
- Implementation of Switch Transformers from the paper: "Switch Transformers: Scaling to Trillion Parameter Models with Simple and Efficien…☆146Aug 3, 2026Updated 2 weeks ago
- Parameter-Efficient Sparsity Crafting From Dense to Mixture-of-Experts for Instruction Tuning on General Tasks☆31May 22, 2024Updated 2 years ago
- automatic analysis of scanned documents(only extracting handwritten digits)☆17Jul 24, 2021Updated 5 years ago
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- This repository hosts code for converting the original MLP Mixer models (JAX) to TensorFlow.☆15Sep 29, 2021Updated 4 years ago
- S$2$CycleDiff: Spatial-Spectral-Bilateral Cycle-Diffusion Frameworkfor Hyperspectral Image Super-Resolution(AAAI 2024)☆16Aug 14, 2025Updated last year
- A Pytorch implementation of Sparsely-Gated Mixture of Experts, for massively increasing the parameter count of language models☆868Sep 13, 2023Updated 2 years ago
- Integrates Imbue's Cost Aware pareto-Region Bayesian Search (CARBS) with Weights and Biases (WanDB)☆12Mar 17, 2025Updated last year
- A curated, domain-organized list of robotics benchmarks—manipulation, locomotion, navigation, HRI, safety, simulation—summarized in conci…☆14Aug 23, 2025Updated 11 months ago
- implementation of "EFFICIENT KEYWORD SPOTTING USING DILATED CONVOLUTIONS AND GATING"☆38Dec 8, 2019Updated 6 years ago
- ☆10Mar 4, 2024Updated 2 years ago