[ICLR 2026] SERE: Similarity-Based Expert Re-routing for Efficient Batch Decoding in MoE Models
☆24Feb 4, 2026Updated 8 months ago
Alternatives and similar repositories for SERE
Users that are interested in SERE are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- [ICML 2025] Retraining-Free Merging of Sparse MoE via Hierarchical Clustering☆24Oct 26, 2025Updated last year
- Implementation of NM sparsity recipe presented in the paper "Progressive Gradient Flow for Robust N:M Sparsity Training in Transformers".☆11Feb 5, 2024Updated 2 years ago
- A Model Agnostic function to directly remove specified layers from the LLM☆11May 23, 2024Updated 2 years ago
- [NeurIPS 2025] Speculate Deep and Accurate☆25Aug 10, 2026Updated 2 months ago
- [ICML'26] Learning Query-Aware Budget-Tier Routing for Runtime Agent Memory☆26Oct 1, 2026Updated 3 weeks ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Efficient Expert Pruning for Sparse Mixture-of-Experts Language Models: Enhancing Performance and Reducing Inference Costs☆25Nov 11, 2025Updated 11 months ago
- MobileNetV2: Inverted Residuals and Linear Bottlenecks☆10Jul 22, 2019Updated 7 years ago
- Official repository for the paper: "You Only Prune Once: Designing Calibration-Free Model Compression With Policy Learning" [ICLR 2025]☆10Apr 13, 2025Updated last year
- This is the official code for the paper "Is One Layer Enough? Understanding Inference Dynamics in Tabular Foundation Models".☆14May 7, 2026Updated 5 months ago
- Serving LLMs on heterogeneous decentralized clusters.☆11Nov 30, 2023Updated 2 years ago
- A time & energy benchmark suite for generative AI☆18May 10, 2026Updated 5 months ago
- Yet Another LLM Inference System☆18Mar 1, 2026Updated 7 months ago
- Code for the paper "Self-Compacting Language Model Agents"☆17Jun 26, 2026Updated 4 months ago
- Sparsity as a Variance Regulator for Improved Depth Utilization in Language Models☆16May 11, 2026Updated 5 months ago
- End-to-end encrypted email - Proton Mail • AdSpecial offer: 40% Off Yearly / 80% Off First Month. All Proton services are open source and independently audited for security.
- SutroYaro — Sutro Group research workspace for energy-efficient AI training. Point any coding agent at the repo and it becomes a research…☆17May 29, 2026Updated 5 months ago
- Understanding Agent Scaling in LLM-Based Multi-Agent Systems via Diversity☆16May 7, 2026Updated 5 months ago
- ☆46Jun 14, 2026Updated 4 months ago
- ☆34Jul 28, 2026Updated 3 months ago
- Code release for AdapMoE accepted by ICCAD 2024☆40Apr 28, 2025Updated last year
- ☆11Jun 27, 2021Updated 5 years ago
- ☆18Oct 22, 2026Updated last week
- A high-throughput LLM serving engine with non-uniform KV cache compression, built on vLLM☆16Sep 9, 2026Updated last month
- The official implementation of the paper "Capacity-Aware Inference: Mitigating the Straggler Effect in Mixture of Experts" (ICLR 2026).☆23Oct 2, 2026Updated 3 weeks ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Official PyTorch implementation of the paper "Accelerating Diffusion Large Language Models with SlowFast Sampling: The Three Golden Princ…☆46Jul 18, 2025Updated last year
- Plato is a system for viewport adaptation based bitrate adaptive VR video streaming.☆15May 1, 2018Updated 8 years ago
- ☆13Apr 27, 2024Updated 2 years ago
- Official implementation of the paper: "A deeper look at depth pruning of LLMs"☆15Jul 24, 2024Updated 2 years ago
- [ACL 2024] Not All Experts are Equal: Efficient Expert Pruning and Skipping for Mixture-of-Experts Large Language Models☆124May 24, 2024Updated 2 years ago
- Implementation for Revela: Dense Retriever Learning via Language Modeling - ICLR 2026 Oral☆24Mar 26, 2026Updated 7 months ago
- ☆19Oct 11, 2025Updated last year
- A Suite for Parallel Inference of Diffusion Transformers (DiTs) on multi-GPU Clusters☆58May 3, 2026Updated 5 months ago
- The Easiest Pytorch Implementation of Branching-DQN☆12Feb 10, 2021Updated 5 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- [NeurIPS 2025] Panacea: Mitigating Harmful Fine-tuning for Large Language Models via Post-fine-tuning Perturbation.☆14Jul 28, 2026Updated 3 months ago
- [ICLR‘24 Spotlight] Code for the paper "Merge, Then Compress: Demystify Efficient SMoE with Hints from Its Routing Policy"☆111Jun 20, 2025Updated last year
- Code for The Truth Lies Somewhere in the Middle (of the Generated Tokens)☆23May 12, 2026Updated 5 months ago
- Efficient 2:4 sparse training algorithms and implementations☆63Dec 8, 2024Updated last year
- ☆31Feb 3, 2026Updated 8 months ago
- The Live Object Detection web application is a Flask-based application that allows users to perform real-time object detection on a live …☆31Aug 7, 2023Updated 3 years ago
- ☆15Jan 24, 2025Updated last year