[TMLR 2026] LibMoE: A LIBRARY FOR COMPREHENSIVE BENCHMARKING MIXTURE OF EXPERTS IN LARGE LANGUAGE MODELS
☆52May 26, 2026Updated 5 months ago
Alternatives and similar repositories for LibMoE
Users that are interested in LibMoE are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆10Mar 14, 2021Updated 5 years ago
- Official repository for paper Routing-Free Mixture-of-Experts.☆19Aug 23, 2026Updated 2 months ago
- [TMLR] Offical Implementation of ToMoE: ToMoE: Converting Dense Large Language Models to Mixture-of-Experts through Dynamic Structural Pr…☆42Aug 27, 2026Updated 2 months ago
- ☆68Feb 8, 2022Updated 4 years ago
- Solving Token Gradient Conflict in Mixture-of-Experts for Large Vision-Language Model☆13Feb 11, 2025Updated last year
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- [ICLR 2025] Drop-Upcycling: Training Sparse Mixture of Experts with Partial Re-initialization☆25Oct 5, 2025Updated last year
- Official Release of NeurIPS 2024 paper "Slot State Space Models"☆11Mar 22, 2025Updated last year
- CRAI is a multimodal large language model based on the Mixture of Experts (MoE) architecture, supporting text and image cross-modal tasks…☆16Apr 29, 2025Updated last year
- HydraNet is a state-of-the-art transformer architecture that combines Multi-Query Attention (MQA), Mixture of Experts (MoE), and continuo…☆14Updated this week
- Kernels by MakoraGenerate☆15May 26, 2026Updated 5 months ago
- [ICML 2025] Code for "R2-T2: Re-Routing in Test-Time for Multimodal Mixture-of-Experts"☆19Mar 10, 2025Updated last year
- [ICLR2025] Codebase for "ReMoE: Fully Differentiable Mixture-of-Experts with ReLU Routing", built on Megatron-LM.☆123Dec 20, 2024Updated last year
- ☆14Jun 16, 2024Updated 2 years ago
- Official codes of the 1st place for The NVIDIA AI City Challenge 2023 - Track 2☆21Jul 25, 2023Updated 3 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- [NAACL 2025] A Closer Look into Mixture-of-Experts in Large Language Models☆60Feb 7, 2025Updated last year
- CLIP-MoE: Mixture of Experts for CLIP☆57Oct 10, 2024Updated 2 years ago
- The code for "MoPE: Mixture of Prefix Experts for Zero-Shot Dialogue State Tracking"☆19Jan 25, 2025Updated last year
- A place to store AI deep research reports☆12Aug 1, 2026Updated 3 months ago
- ☆16Jul 13, 2026Updated 3 months ago
- The source code for WebConf 2025 paper "Multimodal Graph-Based Variational Mixture of Experts Network for Zero-Shot Multimodal Informatio…☆11Feb 17, 2025Updated last year
- ☆11Jun 16, 2026Updated 4 months ago
- Awesome paper list for reasoning generalization in LLMs.☆160Oct 13, 2026Updated 2 weeks ago
- [ACL 2023 Findings] Emergent Modularity in Pre-trained Transformers☆26Jun 7, 2023Updated 3 years ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- Scaling Laws for Mixture of Experts Models☆16Feb 25, 2025Updated last year
- Delta Attention Residuals - supplementary code and pretrained models☆45Sep 26, 2026Updated last month
- Mixture-of-Experts Multimodal Variational Autoencoder☆15Jul 3, 2025Updated last year
- ☆14Sep 7, 2022Updated 4 years ago
- ☆12Dec 10, 2025Updated 10 months ago
- This repository is used to publish our codes for the conference paper "Vietnamese punctuation prediction using deep neural networks" at S…☆11Jul 11, 2020Updated 6 years ago
- The code of 《M4: Multi-Proxy Multi-Gate Mixture of Experts Network for Multiple Instance Learning in Histopathology Image Analysis》☆14Mar 31, 2025Updated last year
- Mixture of A Million Experts☆64Jul 30, 2024Updated 2 years ago
- (ICLR 2026) Unveiling Super Experts in Mixture-of-Experts Large Language Models☆44Sep 25, 2025Updated last year
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- [ACL 2026 Main] Analytical FFN-to-MoE Restructuring via Activation Pattern Analysis☆55Jun 30, 2026Updated 4 months ago
- NAS Benchmarks Collection☆15Apr 11, 2023Updated 3 years ago
- Implementation for MomentumSMoE☆19Apr 19, 2025Updated last year
- Efficient Mixture of Experts for LLM Paper List☆191Jun 16, 2026Updated 4 months ago
- 海龟汤mcp服务，使你独自一人也可以享受海龟汤游戏的乐趣☆14Apr 8, 2025Updated last year
- This repository contains the code for the paper "ST-MoE-BERT: A Spatial-Temporal Mixture-of-Experts Framework for Long-Term Cross-City Mo…☆17Feb 20, 2025Updated last year
- MoE-Visualizer is a tool designed to visualize the selection of experts in Mixture-of-Experts (MoE) models.☆16Apr 8, 2025Updated last year