Code repo for efficient quantized MoE inference with mixture of low-rank compensators
☆31Apr 14, 2025Updated 10 months ago
Alternatives and similar repositories for MiLo
Users that are interested in MiLo are comparing it to the libraries listed below
Sorting:
- Continuous Pipelined Speculative Decoding☆16Jan 4, 2026Updated last month
- Code for "Adaptive Self-improvement LLM Agentic System for ML Library Development" (ICML 2025)☆15Jan 6, 2026Updated last month
- [ICML 2025] MxMoE: Mixed-precision Quantization for MoE with Accuracy and Performance Co-Design☆22Jul 4, 2025Updated 7 months ago
- [ACL 2025 main] FR-Spec: Frequency-Ranked Speculative Sampling☆50Jul 15, 2025Updated 7 months ago
- [ICLR 2025] TidalDecode: A Fast and Accurate LLM Decoding with Position Persistent Sparse Attention☆52Aug 6, 2025Updated 6 months ago
- Repo for EmbedLLM: Learning Compact Representations of Large Language Models☆27Sep 25, 2025Updated 5 months ago
- ☆32Oct 13, 2025Updated 4 months ago
- The open-source Mixture of Depths code and the official implementation of the paper "Router-Tuning: A Simple and Effective Approach for E…☆28Feb 18, 2026Updated last week
- [COLM 2025] Official PyTorch implementation of "Quantization Hurts Reasoning? An Empirical Study on Quantized Reasoning Models"☆71Jul 8, 2025Updated 7 months ago
- Official code for the paper "Examining Post-Training Quantization for Mixture-of-Experts: A Benchmark"☆29Jun 30, 2025Updated 8 months ago
- The first spoken long-text dataset derived from live streams, designed to reflect the redundancy-rich and conversational nature of real-w…☆12Jun 28, 2025Updated 8 months ago
- A Text2SQL benchmark for evaluation of Large Language Models☆41Updated this week
- ☆28May 24, 2025Updated 9 months ago
- ☆26Sep 3, 2020Updated 5 years ago
- [ICML 2024] When Linear Attention Meets Autoregressive Decoding: Towards More Effective and Efficient Linearized Large Language Models☆35Jun 12, 2024Updated last year
- ☆18Jun 10, 2025Updated 8 months ago
- Code release for AdapMoE accepted by ICCAD 2024☆35Apr 28, 2025Updated 10 months ago
- [NeurIPS ENLSP Workshop'24] CSKV: Training-Efficient Channel Shrinking for KV Cache in Long-Context Scenarios☆16Oct 18, 2024Updated last year
- ☆11Jun 22, 2025Updated 8 months ago
- [ICLR 2026] ParallelBench: Understanding the Tradeoffs of Parallel Decoding in Diffusion LLMs☆30Updated this week
- The official implement of paper 《DaMo: Data Mixing Optimizer in Fine-tuning Multimodal LLMs for Mobile Phone Agents》☆29Oct 23, 2025Updated 4 months ago
- A Framework for Evaluating AI Agent Safety in Realistic Environments☆30Oct 2, 2025Updated 4 months ago
- [ICML 2024] Official Repository for the paper "Transformers Get Stable: An End-to-End Signal Propagation Theory for Language Models"☆10Jul 19, 2024Updated last year
- Symphony — A decentralized multi-agent framework that enables intelligent agents to collaborate seamlessly across heterogeneous edge devi…☆30Oct 30, 2025Updated 4 months ago
- ☆18Dec 30, 2025Updated 2 months ago
- ☆53May 19, 2025Updated 9 months ago
- ☆12Jun 11, 2025Updated 8 months ago
- Entropy-Driven GRPO with Guided Error Correction for Advantage Diversity☆22Aug 28, 2025Updated 6 months ago
- FlappyBird愤怒的小鸟 c++游戏实现 学习代码☆10Nov 16, 2018Updated 7 years ago
- ☆16Sep 17, 2024Updated last year
- [ML4H'25] m1: Unleash the Potential of Test-Time Scaling for Medical Reasoning in Large Language Models☆48Dec 21, 2025Updated 2 months ago
- ☆12Dec 15, 2025Updated 2 months ago
- ☆25Aug 19, 2025Updated 6 months ago
- Official Implementation of HIMA (COLM'25)☆19Nov 25, 2025Updated 3 months ago
- LLM-DSE: Searching Accelerator Parameters with LLM Agents☆13May 22, 2025Updated 9 months ago
- US Neighborhood data in GeoJSON format from OpenSource Zillow Neighborhood Boundaries Shapefiles☆11Oct 27, 2016Updated 9 years ago
- ☆13Feb 2, 2025Updated last year
- Network on chip based neural network accelerator☆10Mar 25, 2021Updated 4 years ago
- ☆24Jan 8, 2026Updated last month