[TMLR 2026] LibMoE: A LIBRARY FOR COMPREHENSIVE BENCHMARKING MIXTURE OF EXPERTS IN LARGE LANGUAGE MODELS
☆52May 26, 2026Updated 5 months ago
Alternatives and similar repositories for LibMoE
Users that are interested in LibMoE are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Official repository for paper Routing-Free Mixture-of-Experts.☆20Oct 31, 2026Updated 3 weeks ago
- Source codes for paper "BlockFFN: Towards End-Side Acceleration-Friendly Mixture-of-Experts with Chunk-Level Activation Sparsity".☆20Jan 10, 2026Updated 10 months ago
- Solving Token Gradient Conflict in Mixture-of-Experts for Large Vision-Language Model☆13Feb 11, 2025Updated last year
- CRAI is a multimodal large language model based on the Mixture of Experts (MoE) architecture, supporting text and image cross-modal tasks…☆16Apr 29, 2025Updated last year
- ☆36Nov 22, 2025Updated last year
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- [ICML 2025] Code for "R2-T2: Re-Routing in Test-Time for Multimodal Mixture-of-Experts"☆19Mar 10, 2025Updated last year
- Kernels by MakoraGenerate☆15May 26, 2026Updated 5 months ago
- HydraNet is a state-of-the-art transformer architecture that combines Multi-Query Attention (MQA), Mixture of Experts (MoE), and continuo…☆14Updated this week
- ☆11Jul 25, 2021Updated 5 years ago
- CuMo: Scaling Multimodal LLM with Co-Upcycled Mixture-of-Experts☆165Jun 8, 2024Updated 2 years ago
- Just a research framework☆12Updated this week
- Official codes of the 1st place for The NVIDIA AI City Challenge 2023 - Track 2☆21Jul 25, 2023Updated 3 years ago
- [NAACL 2025] A Closer Look into Mixture-of-Experts in Large Language Models☆60Feb 7, 2025Updated last year
- The code for "MoPE: Mixture of Prefix Experts for Zero-Shot Dialogue State Tracking"☆19Jan 25, 2025Updated last year
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- CLIP-MoE: Mixture of Experts for CLIP☆57Oct 10, 2024Updated 2 years ago
- The source code for WebConf 2025 paper "Multimodal Graph-Based Variational Mixture of Experts Network for Zero-Shot Multimodal Informatio…☆11Feb 17, 2025Updated last year
- A collection of amd kernels for vLLM☆21Updated this week
- ☆20Sep 6, 2025Updated last year
- ☆14Sep 7, 2022Updated 4 years ago
- [ACL 2023 Findings] Emergent Modularity in Pre-trained Transformers☆26Jun 7, 2023Updated 3 years ago
- Delta Attention Residuals - supplementary code and pretrained models☆46Sep 26, 2026Updated last month
- Mixture-of-Experts Multimodal Variational Autoencoder☆15Jul 3, 2025Updated last year
- [NeurIPS 2025] ExGra-Med: Medical Multi-Modal LLM with Extended Context Alignment☆43Apr 7, 2026Updated 7 months ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Implementation for MomentumSMoE☆19Apr 19, 2025Updated last year
- (ICLR 2026) Unveiling Super Experts in Mixture-of-Experts Large Language Models☆44Sep 25, 2025Updated last year
- Efficient Mixture of Experts for LLM Paper List☆190Jun 16, 2026Updated 5 months ago
- The code of 《M4: Multi-Proxy Multi-Gate Mixture of Experts Network for Multiple Instance Learning in Histopathology Image Analysis》☆13Mar 31, 2025Updated last year
- [AAAI 2026] Official implementation of "FlashSVD: Memory-Efficient Inference with Streaming for Low-Rank Models". If you find this reposi…☆19Aug 26, 2026Updated 2 months ago
- [ACL 2026 Main] Analytical FFN-to-MoE Restructuring via Activation Pattern Analysis☆55Jun 30, 2026Updated 4 months ago
- My personal blog about AI, ML and DL 🎉☆11Aug 23, 2023Updated 3 years ago
- A web app for both Text-based and Visual Question Answering.☆14Nov 13, 2023Updated 3 years ago
- This repository contains the code for the paper "ST-MoE-BERT: A Spatial-Temporal Mixture-of-Experts Framework for Long-Term Cross-City Mo…☆17Feb 20, 2025Updated last year
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- Python implementation of the supervised graph prediction method proposed in http://arxiv.org/abs/2202.03813 using PyTorch library and POT…☆15Feb 25, 2022Updated 4 years ago
- MoE-Visualizer is a tool designed to visualize the selection of experts in Mixture-of-Experts (MoE) models.☆17Apr 8, 2025Updated last year
- Speed up Transformers With Spectrum-Preserving Token Merging☆59Apr 30, 2026Updated 6 months ago
- OBEYED-VLA: Clutter-Resistant Vision-Language-Action Models through Object-Centric and Geometry Grounding☆14Sep 11, 2026Updated 2 months ago
- 海龟汤mcp服务,使你独自一人也可以享受海龟汤游戏的乐趣☆14Apr 8, 2025Updated last year
- What do CLIP Vision Transformers learn? Feature Visualization can show you!☆15Aug 29, 2024Updated 2 years ago
- Source code for the paper "Improving Deep Metric Learning byDivide and Conquer"☆21Dec 10, 2021Updated 4 years ago
Are these results useful?