The official implementation of the paper "Towards Efficient Mixture of Experts: A Holistic Study of Compression Techniques (TMLR)".
☆92Oct 2, 2026Updated 3 weeks ago
Alternatives and similar repositories for Unified-MoE-Compression
Users that are interested in Unified-MoE-Compression are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Source code of ACL 2023 Main Conference Paper "PAD-Net: An Efficient Framework for Dynamic Networks".☆14Oct 2, 2026Updated 3 weeks ago
- The open-source Mixture of Depths code and the official implementation of the paper "Router-Tuning: A Simple and Effective Approach for E…☆34Oct 2, 2026Updated 3 weeks ago
- The official implementation of the paper "Capacity-Aware Inference: Mitigating the Straggler Effect in Mixture of Experts" (ICLR 2026).☆23Oct 2, 2026Updated 3 weeks ago
- Source code of EMNLP 2022 Findings paper "SparseAdapter: An Easy Approach for Improving the Parameter-Efficiency of Adapters"☆23Oct 2, 2026Updated 3 weeks ago
- The source code of "Merging Experts into One: Improving Computational Efficiency of Mixture of Experts (EMNLP 2023)":☆49Oct 2, 2026Updated 3 weeks ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- The official implementation of the paper "Uncovering the Redundancy in Transformers via a Unified Study of Layer Dropping (TMLR)".☆193Oct 2, 2026Updated 3 weeks ago
- The official implementation of the paper "Rethinking Pruning for Vision-Language Models: Strategies for Effective Sparsity".☆17Oct 2, 2026Updated 3 weeks ago
- Implementation for ACL 2023 Findings paper "Unsupervised Dense Retrieval with Relevance-Aware Contrastive Pre-Training"☆11May 19, 2024Updated 2 years ago
- Pytorch Code for FedHyper☆11Aug 28, 2024Updated 2 years ago
- Efficient Expert Pruning for Sparse Mixture-of-Experts Language Models: Enhancing Performance and Reducing Inference Costs☆25Nov 11, 2025Updated 11 months ago
- Official PyTorch implementation of CD-MOE☆12Mar 18, 2026Updated 7 months ago
- Official implementation for LaCo (EMNLP 2024 Findings)☆22Oct 3, 2024Updated 2 years ago
- ☆23Nov 26, 2024Updated last year
- A block pruning framework for LLMs.☆28May 17, 2025Updated last year
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- [ICLR‘24 Spotlight] Code for the paper "Merge, Then Compress: Demystify Efficient SMoE with Hints from Its Routing Policy"☆111Jun 20, 2025Updated last year
- A repository aimed at pruning DeepSeek V3, R1 and R1-zero to a usable size☆88Sep 5, 2025Updated last year
- ☆14Aug 18, 2022Updated 4 years ago
- [ACL 2024] Not All Experts are Equal: Efficient Expert Pruning and Skipping for Mixture-of-Experts Large Language Models☆124May 24, 2024Updated 2 years ago
- Code release for AdapMoE accepted by ICCAD 2024☆40Apr 28, 2025Updated last year
- [ICLR 2025] Dynamic Mixture of Experts: An Auto-Tuning Approach for Efficient Transformer Models☆165Jul 9, 2025Updated last year
- ☆22Oct 3, 2024Updated 2 years ago
- The first Object-Oriented Programming (OOP) Evaluation Benchmark for LLMs☆27Jan 15, 2025Updated last year
- Activation-aware Singular Value Decomposition for Compressing Large Language Models☆95Oct 22, 2024Updated 2 years ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- Transformer☆11Nov 29, 2018Updated 7 years ago
- [NeurIPS 2025] Neural Discrete Token Representation Learning for Extreme Token Reduction in Video Large Language Models☆17Aug 19, 2026Updated 2 months ago
- ☆14Dec 22, 2024Updated last year
- ☆10Dec 29, 2025Updated 10 months ago
- [Neurips 2021] Sparse Training via Boosting Pruning Plasticity with Neuroregeneration☆31Feb 11, 2023Updated 3 years ago
- Mixture-of-Basis-Experts for Compressing MoE-based LLMs☆41Dec 24, 2025Updated 10 months ago
- ☆47Nov 8, 2024Updated last year
- Code and Data for "Long-context LLMs Struggle with Long In-context Learning" [TMLR2025]☆113Feb 20, 2025Updated last year
- Transformers components but in Triton☆34May 9, 2025Updated last year
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- ☆14Nov 29, 2024Updated last year
- D^2-MoE: Delta Decompression for MoE-based LLMs Compression☆88Mar 25, 2025Updated last year
- Official Pytorch Implementation of "Outlier Weighed Layerwise Sparsity (OWL): A Missing Secret Sauce for Pruning LLMs to High Sparsity"☆81Jul 7, 2025Updated last year
- A collection of AWESOME things about mixture-of-experts☆1,286Dec 8, 2024Updated last year
- Automated Identification of Redundant Layer Blocks for Pruning in Large Language Models☆269Apr 23, 2024Updated 2 years ago
- MoE-Visualizer is a tool designed to visualize the selection of experts in Mixture-of-Experts (MoE) models.☆16Apr 8, 2025Updated last year
- Curated collection of papers in MoE model inference☆430Mar 12, 2026Updated 7 months ago