Official code for the paper "Examining Post-Training Quantization for Mixture-of-Experts: A Benchmark"
☆31Jun 30, 2025Updated last year
Alternatives and similar repositories for MoE-Quantization
Users that are interested in MoE-Quantization are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- [ICLR 2025, IEEE TPAMI 2026] Mixture Compressor & MC#☆79Feb 12, 2025Updated last year
- [ICML 2025] MxMoE: Mixed-precision Quantization for MoE with Accuracy and Performance Co-Design☆33Jul 4, 2025Updated last year
- Code for data-aware compression of DeepSeek models☆75Dec 11, 2025Updated 11 months ago
- [ICLR‘24 Spotlight] Code for the paper "Merge, Then Compress: Demystify Efficient SMoE with Hints from Its Routing Policy"☆111Jun 20, 2025Updated last year
- [ICML 2024] Code for the paper "MoE-RBench: Towards Building Reliable Language Models with Sparse Mixture-of-Experts"☆11Jul 1, 2024Updated 2 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- ☆127Feb 26, 2026Updated 8 months ago
- Code repo for efficient quantized MoE inference with mixture of low-rank compensators☆39Apr 14, 2025Updated last year
- Fast and accurate coarse-grained neural network molecular dynamics☆16Nov 8, 2026Updated last week
- [TMLR] Official PyTorch implementation of CD-MOE☆12Mar 18, 2026Updated 8 months ago
- ☆29Dec 2, 2024Updated last year
- [ECCV 2024] Code for the paper "Mew: Multiplexed Immunofluorescence Image Analysis through an Efficient Multiplex Network"☆16Jul 27, 2024Updated 2 years ago
- Code to reproduce the experiments of the ICLR24-paper: "Sparse Model Soups: A Recipe for Improved Pruning via Model Averaging"☆12Oct 14, 2025Updated last year
- REAM: Merging Improves Pruning of Experts in LLMs☆30Apr 16, 2026Updated 7 months ago
- An algorithm for weight-activation quantization (W4A4, W4A8) of LLMs, supporting both static and dynamic quantization☆178Nov 26, 2025Updated 11 months ago
- Deploy open-source AI quickly and easily - Special Bonus Offer • AdRunpod Hub is built for open source. One-click deployment and autoscaling endpoints without provisioning your own infrastructure.
- Code repo for the paper "SpinQuant LLM quantization with learned rotations"☆443Feb 14, 2025Updated last year
- [NeurIPS 2024 Oral🔥] DuQuant: Distributing Outliers via Dual Transformation Makes Stronger Quantized LLMs.☆190Apr 24, 2026Updated 6 months ago
- Efficient Mixture of Experts for LLM Paper List☆191Jun 16, 2026Updated 5 months ago
- ☆18Apr 7, 2025Updated last year
- Learning to Skip the Middle Layers of Transformers☆17Aug 7, 2025Updated last year
- Official code for the paper "HEXA-MoE: Efficient and Heterogeneous-Aware MoE Acceleration with Zero Computation Redundancy"☆16Mar 6, 2025Updated last year
- ☆130Mar 18, 2026Updated 8 months ago
- ☆29May 24, 2024Updated 2 years ago
- [ICML 2024] Official Repository for the paper "Transformers Get Stable: An End-to-End Signal Propagation Theory for Language Models"☆11Jul 19, 2024Updated 2 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- [ICLR25] STBLLM: Breaking the 1-Bit Barrier with Structured Binary LLMs☆20Jun 3, 2025Updated last year
- [ICML 2023] Meta-SAGE: Scale Meta-Learning Scheduled Adaptation with Guided Exploration for Mitigating Scale Shift on Combinatorial Optim…☆11Dec 19, 2023Updated 2 years ago
- The official source code for "Single-cell RNA-seq data imputation using Bi-level Feature Propagation", accepted at Briefings in Bioinform…☆10May 9, 2024Updated 2 years ago
- [ICML 2024 Oral] This project is the official implementation of our Accurate LoRA-Finetuning Quantization of LLMs via Information Retenti…☆65Sep 11, 2026Updated 2 months ago
- Are gradient information useful for pruning of LLMs?☆48Aug 23, 2025Updated last year
- [NAACL'25 🏆 SAC Award] Official code for "Advancing MoE Efficiency: A Collaboration-Constrained Routing (C2R) Strategy for Better Expert…☆18Feb 4, 2025Updated last year
- Code for paper: "RemovalNet: DNN model fingerprinting removal attack", IEEE TDSC 2023.☆10Nov 27, 2023Updated 2 years ago
- ☆54May 20, 2025Updated last year
- QuTLASS: CUTLASS-Powered Quantized BLAS for Deep Learning☆205Sep 2, 2026Updated 2 months ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- The artifact for NDSS '25 paper "ASGARD: Protecting On-Device Deep Neural Networks with Virtualization-Based Trusted Execution Environmen…☆15Oct 16, 2025Updated last year
- The official source code for "Global Context-aware Representation Learning for Spatially Resolved Transcriptomics", accepted at ICML2025☆14Aug 20, 2025Updated last year
- Code for RepNAS☆14Dec 21, 2021Updated 4 years ago
- 🎓Automatically Update circult-eda-mlsys-tinyml Papers Daily using Github Actions (Update Every 8th hours)☆10Nov 9, 2026Updated last week
- ☆173Mar 9, 2023Updated 3 years ago
- Curated collection of papers in MoE model inference☆434Mar 12, 2026Updated 8 months ago
- ☆12Oct 4, 2023Updated 3 years ago
Are these results useful?