[ICLR 2026] SERE: Similarity-Based Expert Re-routing for Efficient Batch Decoding in MoE Models
☆24Feb 4, 2026Updated 9 months ago
Alternatives and similar repositories for SERE
Users that are interested in SERE are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- [ICML 2025] Retraining-Free Merging of Sparse MoE via Hierarchical Clustering☆24Oct 26, 2025Updated last year
- [OSDI 2025] DecDEC: A Systems Approach to Advancing Low‑Bit LLM Quantization☆27Oct 13, 2026Updated last month
- A Model Agnostic function to directly remove specified layers from the LLM☆11May 23, 2024Updated 2 years ago
- [NeurIPS 2025] Speculate Deep and Accurate☆25Aug 10, 2026Updated 3 months ago
- ⚡ Official code for “ReaDy: Recurrent States as Dynamic Context for Speculative Drafting in Hybrid Linear Attention Large Language Models…☆17Oct 15, 2026Updated last month
- Deploy open-source AI quickly and easily - Special Bonus Offer • AdRunpod Hub is built for open source. One-click deployment and autoscaling endpoints without provisioning your own infrastructure.
- [ACL 2024] Not All Experts are Equal: Efficient Expert Pruning and Skipping for Mixture-of-Experts Large Language Models☆124May 24, 2024Updated 2 years ago
- [ICML'26] Learning Query-Aware Budget-Tier Routing for Runtime Agent Memory☆26Oct 1, 2026Updated last month
- D^2-MoE: Delta Decompression for MoE-based LLMs Compression☆89Mar 25, 2025Updated last year
- ☆13Aug 1, 2026Updated 3 months ago
- ☆19Oct 7, 2026Updated last month
- Efficient Expert Pruning for Sparse Mixture-of-Experts Language Models: Enhancing Performance and Reducing Inference Costs☆25Nov 11, 2025Updated last year
- Sample-Efficient Parametric Learning from Natural Language☆13Feb 5, 2026Updated 9 months ago
- [USENIX OSDI 2026] Revisiting Pipeline Parallelism for LLM Serving☆14Oct 30, 2026Updated 2 weeks ago
- Official repository for the paper: "You Only Prune Once: Designing Calibration-Free Model Compression With Policy Learning" [ICLR 2025]☆10Apr 13, 2025Updated last year
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- This is the official code for the paper "Is One Layer Enough? Understanding Inference Dynamics in Tabular Foundation Models".☆14May 7, 2026Updated 6 months ago
- A simple database including Common Operators, Query Optimization, Transactions, Rollback and Recovery☆13Aug 8, 2017Updated 9 years ago
- MobileNetV2: Inverted Residuals and Linear Bottlenecks☆10Jul 22, 2019Updated 7 years ago
- A real-world mobile-agent evaluation framework.☆11Mar 30, 2026Updated 7 months ago
- Lumos, a decision-tree-based throughput predictor for adaptive streaming - IEEE INFOCOM 2022 & IEEE TMC 2023☆12Jan 3, 2024Updated 2 years ago
- ☆13Jan 15, 2026Updated 10 months ago
- Routing-aware expert paging for memory-constrained MoE serving — a vLLM plug-in with byte-identical outputs and joint expert/KV memory al…☆16Sep 15, 2026Updated 2 months ago
- SutroYaro — Sutro Group research workspace for energy-efficient AI training. Point any coding agent at the repo and it becomes a research…☆17May 29, 2026Updated 5 months ago
- ☆47Jun 14, 2026Updated 5 months ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Yet Another LLM Inference System☆18Mar 1, 2026Updated 8 months ago
- Curated collection of papers in MoE model inference☆434Mar 12, 2026Updated 8 months ago
- Code for the paper "Self-Compacting Language Model Agents"☆17Jun 26, 2026Updated 4 months ago
- LTP: Megatron-LM component☆15Sep 3, 2026Updated 2 months ago
- Sparsity as a Variance Regulator for Improved Depth Utilization in Language Models☆16May 11, 2026Updated 6 months ago
- (ICLR '26) Safety Subspaces are Not Linearly Distinct: A Fine-Tuning Case Study☆13Oct 4, 2025Updated last year
- ☆35Jul 28, 2026Updated 3 months ago
- Code for paper "Rethinking Text-based Protein Understanding: Retrieval or LLM?"☆21Oct 7, 2025Updated last year
- ☆19Oct 22, 2026Updated 3 weeks ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- Official PyTorch implementation of the paper "Accelerating Diffusion Large Language Models with SlowFast Sampling: The Three Golden Princ…☆47Jul 18, 2025Updated last year
- The official implementation of the paper "Capacity-Aware Inference: Mitigating the Straggler Effect in Mixture of Experts" (ICLR 2026).☆23Oct 2, 2026Updated last month
- Official implementation of the paper: "A deeper look at depth pruning of LLMs"☆15Jul 24, 2024Updated 2 years ago
- This is the unofficial re-implementation of "Antidote: Post-fine-tuning Safety Alignment for Large Language Models against Harmful Fine-t…☆13Jul 14, 2025Updated last year
- [ICLR 2026] Fewer Weights, More Problems: A Practical Attack on LLM Pruning☆14Apr 6, 2026Updated 7 months ago
- Implementation for Revela: Dense Retriever Learning via Language Modeling - ICLR 2026 Oral☆24Mar 26, 2026Updated 7 months ago
- The Easiest Pytorch Implementation of Branching-DQN☆12Feb 10, 2021Updated 5 years ago
Are these results useful?