The official implementation of the paper "Towards Efficient Mixture of Experts: A Holistic Study of Compression Techniques (TMLR)".
☆93Oct 2, 2026Updated last month
Alternatives and similar repositories for Unified-MoE-Compression
Users that are interested in Unified-MoE-Compression are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- The open-source Mixture of Depths code and the official implementation of the paper "Router-Tuning: A Simple and Effective Approach for E…☆34Oct 2, 2026Updated last month
- Source code of ACL 2023 Main Conference Paper "PAD-Net: An Efficient Framework for Dynamic Networks".☆14Oct 2, 2026Updated last month
- The official implementation of the paper "Capacity-Aware Inference: Mitigating the Straggler Effect in Mixture of Experts" (ICLR 2026).☆23Oct 2, 2026Updated last month
- The official implementation of the paper "Understanding and Harnessing Sparsity in Unified Multimodal Models" (TMLR).☆24Oct 2, 2026Updated last month
- The source code of "Merging Experts into One: Improving Computational Efficiency of Mixture of Experts (EMNLP 2023)":☆49Oct 2, 2026Updated last month
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- The official implementation of the paper "Uncovering the Redundancy in Transformers via a Unified Study of Layer Dropping (TMLR)".☆193Oct 2, 2026Updated last month
- Source code of EMNLP 2022 Findings paper "SparseAdapter: An Easy Approach for Improving the Parameter-Efficiency of Adapters"☆23Oct 2, 2026Updated last month
- The official implementation of the paper "Rethinking Pruning for Vision-Language Models: Strategies for Effective Sparsity".☆17Oct 2, 2026Updated last month
- [ECCV 26] DENSE VIDEO UNDERSTANDING WITH GATED RESIDUAL TOKENIZATION☆14Oct 26, 2026Updated 3 weeks ago
- Pytorch Code for FedHyper☆11Aug 28, 2024Updated 2 years ago
- [NeurIPS 2025] Neural Discrete Token Representation Learning for Extreme Token Reduction in Video Large Language Models☆17Aug 19, 2026Updated 3 months ago
- Efficient Expert Pruning for Sparse Mixture-of-Experts Language Models: Enhancing Performance and Reducing Inference Costs☆25Nov 11, 2025Updated last year
- Mixture-of-Basis-Experts for Compressing MoE-based LLMs☆41Updated this week
- [ACL 2024] Not All Experts are Equal: Efficient Expert Pruning and Skipping for Mixture-of-Experts Large Language Models☆124May 24, 2024Updated 2 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- A block pruning framework for LLMs.☆28May 17, 2025Updated last year
- [ICLR‘24 Spotlight] Code for the paper "Merge, Then Compress: Demystify Efficient SMoE with Hints from Its Routing Policy"☆111Jun 20, 2025Updated last year
- ☆23Nov 26, 2024Updated last year
- ☆14Aug 18, 2022Updated 4 years ago
- Implementation for EACL 2024 paper "Corpus-Steered Query Expansion with Large Language Models"☆14Mar 19, 2024Updated 2 years ago
- A repository aimed at pruning DeepSeek V3, R1 and R1-zero to a usable size☆89Sep 5, 2025Updated last year
- Code release for AdapMoE accepted by ICCAD 2024☆40Apr 28, 2025Updated last year
- 🚀enhanced GRPO with more verifiable rewards and real-time evaluators☆37Jan 27, 2026Updated 9 months ago
- ☆22Oct 3, 2024Updated 2 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- [ICLR 2025, IEEE TPAMI 2026] Mixture Compressor & MC#☆79Feb 12, 2025Updated last year
- [ICLR 2025] Dynamic Mixture of Experts: An Auto-Tuning Approach for Efficient Transformer Models☆165Jul 9, 2025Updated last year
- The first Object-Oriented Programming (OOP) Evaluation Benchmark for LLMs☆27Jan 15, 2025Updated last year
- [ICLR 2025] Linear Combination of Saved Checkpoints Makes Consistency and Diffusion Models Better☆16Feb 15, 2025Updated last year
- Official Pytorch Implementation of "Outlier Weighed Layerwise Sparsity (OWL): A Missing Secret Sauce for Pruning LLMs to High Sparsity"☆81Jul 7, 2025Updated last year
- 用该代码生成一对公钥和私钥,并用私钥加密一段明文“Today is a nice day”。☆11Jun 15, 2017Updated 9 years ago
- Activation-aware Singular Value Decomposition for Compressing Large Language Models☆95Oct 22, 2024Updated 2 years ago
- The code of "NEURALSLICE: Neural 3D Triangle Mesh Reconstruction via Slicing 4D Tetrahedral Meshes (ICML 2023)"☆25Jul 17, 2024Updated 2 years ago
- ☆10Dec 29, 2025Updated 10 months ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- [ICLR 2023] "Sparse MoE as the New Dropout: Scaling Dense and Self-Slimmable Transformers" by Tianlong Chen*, Zhenyu Zhang*, Ajay Jaiswal…☆56Feb 28, 2023Updated 3 years ago
- ☆14Dec 22, 2024Updated last year
- [NeurIPS 2026] ThinkJEPA: Empowering Latent World Models with Large Vision-Language Reasoning Model☆60Jul 19, 2026Updated 4 months ago
- This is an official code for the [ACL 2025 Demo] paper: Know-MRI: A Knowledge Mechanisms Revealer&Interpreter for Large Language Models☆15Jan 8, 2026Updated 10 months ago
- Transformer☆11Nov 29, 2018Updated 7 years ago
- ☆47Nov 8, 2024Updated 2 years ago
- ⛷️ LLaMA-MoE: Building Mixture-of-Experts from LLaMA with Continual Pre-training (EMNLP 2024)☆1,004Dec 6, 2024Updated last year
Are these results useful?