Alternatives and similar repositories for RouterArena

Users that are interested in RouterArena are comparing it to the libraries listed below

• inclusionAI / dInfer
  dInfer: An Efficient Inference Framework for Diffusion Language Models
  ☆389Updated last week
• hao-ai-lab / Dynasor
  [NeurIPS 2025] Simple extension on vLLM to help you speed up reasoning model without training.
  ☆217Updated 7 months ago
• antgroup / OmniKV
  Dynamic Context Selection for Efficient Long-Context LLMs
  ☆53Updated 8 months ago
• UCB-ADRS / ADRS
  AI-Driven Research Systems (ADRS)
  ☆117Updated last month
• cornserve-ai / cornserve
  Easy, Fast, and Scalable Multimodal AI
  ☆92Updated this week
• Infini-AI-Lab / APE
  ☆36Updated 11 months ago
• thu-nics / MoA
  [CoLM'25] The official implementation of the paper <MoA: Mixture of Sparse Attention for Automatic Large Language Model Compression>
  ☆153Updated last week
• RLsys-Foundation / TritonForge
  🔥 LLM-powered GPU kernel synthesis: Train models to convert PyTorch ops into optimized Triton kernels via SFT+RL. Multi-turn compilation…
  ☆112Updated 2 months ago
• NVlabs / QeRL
  QeRL enables RL for 32B LLMs on a single H100 GPU.
  ☆473Updated last month
• long-horizon-execution / measuring-execution
  ☆49Updated 4 months ago
• wdlctc / headinfer
  ☆63Updated 8 months ago
• hao-ai-lab / LookaheadReasoning
  [NeurIPS 2025] Scaling Speculative Decoding with Lookahead Reasoning
  ☆59Updated 2 months ago
• nanomaoli / llm_reproducibility
  ☆69Updated this week
• snu-mllab / KVzip
  [NeurIPS'25 Oral] Query-agnostic KV cache eviction: 3–4× reduction in memory and 2× decrease in latency (Qwen3/2.5, Gemma3, LLaMA3)
  ☆183Updated 3 weeks ago
• zenrran4nlp / Awesome-LLM-Inference-Serving
  ☆47Updated 8 months ago
• Multiverse4FM / Multiverse
  ☆90Updated 7 months ago
• CASE-Lab-UMD / Unified-MoE-Compression
  The official implementation of the paper "Towards Efficient Mixture of Experts: A Holistic Study of Compression Techniques (TMLR)".
  ☆88Updated 10 months ago
• ZhangYiqun018 / AvengersPro
  [DAI 2025] Beyond GPT-5: Making LLMs Cheaper and Better via Performance–Efficiency Optimized Routing
  ☆198Updated last month
• VectorSpaceLab / Infomatica
  Data Synthesis for Deep Research Based on Semi-Structured Data
  ☆191Updated last month
• Infini-AI-Lab / Kinetics
  Kinetics: Rethinking Test-Time Scaling Laws
  ☆85Updated 6 months ago
• deepseek-ai / LPLB
  An early research stage expert-parallel load balancer for MoE models based on linear programming.
  ☆485Updated 2 months ago
• microsoft / ParrotServe
  [OSDI'24] Serving LLM-based Applications Efficiently with Semantic Variable
  ☆207Updated last year
• hao-ai-lab / vllm-ltr
  [NeurIPS 2024] Efficient LLM Scheduling by Learning to Rank
  ☆67Updated last year
• AI9Stars / AutoTriton
  ☆60Updated 6 months ago
• zhenyuhe00 / SWE-Swiss
  SWE-Swiss: A Multi-Task Fine-Tuning and RL Recipe for High-Performance Issue Resolution
  ☆101Updated 3 months ago
• Infini-AI-Lab / GRESO
  ☆73Updated 6 months ago
• guanyilin428 / Dynamic-Speculative-Planning
  ☆34Updated 4 months ago
• Infini-AI-Lab / Multiverse
  ☆110Updated 4 months ago
• hyx1999 / SAM-Decoding
  Official Implementation of SAM-Decoding: Speculative Decoding via Suffix Automaton
  ☆39Updated 11 months ago
• mit-han-lab / duo-attention
  [ICLR 2025] DuoAttention: Efficient Long-Context LLM Inference with Retrieval and Streaming Heads
  ☆519Updated 11 months ago