Awesome Mixture of Experts (MoE): A Curated List of Mixture of Experts (MoE) and Mixture of Multimodal Experts (MoME)
☆75Jul 13, 2026Updated 3 months ago
Alternatives and similar repositories for Awesome-Mixture-of-Experts
Users that are interested in Awesome-Mixture-of-Experts are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- [TKDE'25] The official GitHub page for the survey paper "A Survey on Mixture of Experts in Large Language Models".☆512Aug 18, 2026Updated 2 months ago
- Survey: A collection of AWESOME papers and resources on the latest research in Mixture of Experts.☆146Aug 21, 2024Updated 2 years ago
- Official implementation of "Mixture of Experts Meets Prompt-Based Continual Learning" (NeurIPS 2024)☆43Aug 1, 2025Updated last year
- A curated reading list of research in Mixture-of-Experts(MoE).☆672Oct 30, 2024Updated 2 years ago
- CRAI is a multimodal large language model based on the Mixture of Experts (MoE) architecture, supporting text and image cross-modal tasks…☆16Apr 29, 2025Updated last year
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Official code of "Do Topological Characteristics Help in Knowledge Distillation?"☆11Aug 7, 2024Updated 2 years ago
- HydraNet is a state-of-the-art transformer architecture that combines Multi-Query Attention (MQA), Mixture of Experts (MoE), and continuo…☆14Oct 26, 2026Updated last week
- The code of Advancing Expert Specialization for Better MoE (NeurIPS2025 oral)☆35Jan 22, 2026Updated 9 months ago
- ☆11May 21, 2026Updated 5 months ago
- Towards Understanding the Mixture-of-Experts Layer in Deep Learning☆37Dec 12, 2023Updated 2 years ago
- Solving Token Gradient Conflict in Mixture-of-Experts for Large Vision-Language Model☆13Feb 11, 2025Updated last year
- [NeurIPS 2024] Mixture of Experts for Audio-Visual Learning☆25Jan 19, 2025Updated last year
- 💥 Tiny 9M MoEs with Dynamic Routing☆13May 29, 2024Updated 2 years ago
- The source code for WebConf 2025 paper "Multimodal Graph-Based Variational Mixture of Experts Network for Zero-Shot Multimodal Informatio…☆11Feb 17, 2025Updated last year
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- Community Implementation of the paper: "Multi-Head Mixture-of-Experts" In PyTorch☆31Oct 26, 2026Updated last week
- Mixture-of-Experts Multimodal Variational Autoencoder☆15Jul 3, 2025Updated last year
- The code of 《M4: Multi-Proxy Multi-Gate Mixture of Experts Network for Multiple Instance Learning in Histopathology Image Analysis》☆14Mar 31, 2025Updated last year
- Comparing performance of different InfoNCE type losses used in contrastive learning.☆16Jun 12, 2024Updated 2 years ago
- ☆15Sep 21, 2026Updated last month
- The fastest off-the-shelf inference algorithm for LLMs (ICLR’25)☆14Mar 8, 2025Updated last year
- Official Code for "Token Distillation: Attention-aware Input Embeddings for New Tokens"☆13Mar 11, 2026Updated 7 months ago
- This is the official source code for Multi-domain Universal Representation Learning for Hyperspectral Object Tracking.☆13Sep 30, 2026Updated last month
- ☆11Dec 5, 2024Updated last year
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- This repository contains the code for the paper "ST-MoE-BERT: A Spatial-Temporal Mixture-of-Experts Framework for Long-Term Cross-City Mo…☆17Feb 20, 2025Updated last year
- MoE-Visualizer is a tool designed to visualize the selection of experts in Mixture-of-Experts (MoE) models.☆16Apr 8, 2025Updated last year
- [ICML 2026] Restoring Exploration after Post-Training: Latent Exploration Decoding for Large Reasoning Models☆13May 8, 2026Updated 5 months ago
- Official implementation reference of our AnomalyAgent☆15May 28, 2026Updated 5 months ago
- Code for the paper "No Train, all Gain: Self-Supervised Gradients Improve Deep Frozen Representations"☆11Oct 31, 2024Updated 2 years ago
- This repository collects important papers in the field of Continual Reinforcement Learning and Lifelong Reinforcement Learning.☆14May 25, 2026Updated 5 months ago
- ICML 2025 Oral: ABKD: Pursuing a Proper Allocation of the Probability Mass in Knowledge Distillation via α-β-Divergence☆47Aug 8, 2025Updated last year
- Curated collection of papers in MoE model inference☆430Mar 12, 2026Updated 7 months ago
- Source codes for paper "BlockFFN: Towards End-Side Acceleration-Friendly Mixture-of-Experts with Chunk-Level Activation Sparsity".☆19Jan 10, 2026Updated 9 months ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Adapt full attention LLM to sliding window attention☆14Feb 20, 2026Updated 8 months ago
- ☆16May 21, 2026Updated 5 months ago
- [ESWA'26] Factual Serialization Enhancement: A Key Innovation for Chest X-ray Report Generation☆20Apr 25, 2026Updated 6 months ago
- ☆12Apr 10, 2025Updated last year
- The code for "MoPE: Mixture of Prefix Experts for Zero-Shot Dialogue State Tracking"☆19Jan 25, 2025Updated last year
- This is the official Python and C++ implementation repository for a paper entitled "Visual multi-object tracking with re-identification a…☆16Mar 26, 2025Updated last year
- [ICLR 2025] Drop-Upcycling: Training Sparse Mixture of Experts with Partial Re-initialization☆25Oct 5, 2025Updated last year