Alternatives and similar repositories for MASS

Users that are interested in MASS are comparing it to the libraries listed below

• TreeAI-Lab / Awesome-KV-Cache-Management
  This repository serves as a comprehensive survey of LLM development, featuring numerous research papers along with their corresponding co…
  ☆264Updated last month
• EachSheep / ShortcutsBench
  ShortcutsBench: A Large-Scale Real-World Benchmark for API-Based Agents
  ☆108Updated 6 months ago
• hao-ai-lab / vllm-ltr
  [NeurIPS 2024] Efficient LLM Scheduling by Learning to Rank
  ☆67Updated last year
• wangyu-ustc / Mem-alpha
  The official implementation of the paper "Mem-α: Learning Memory Construction via Reinforcement Learning"
  ☆141Updated 2 weeks ago
• zwxandy / Awesome-Efficient-CoT-Reasoning-Summary
  🔥 How to efficiently and effectively compress the CoTs or directly generate concise CoTs during inference while maintaining the reasonin…
  ☆64Updated 7 months ago
• YaoJiayi / CacheBlend
  ☆160Updated 5 months ago
• SuDIS-ZJU / llm-inference-all-in-one
  ☆16Updated 10 months ago
• hemingkx / Awesome-Efficient-Reasoning
  Paper list for Efficient Reasoning.
  ☆784Updated 2 weeks ago
• smart-lty / ParallelSpeculativeDecoding
  [ICLR 2025] PEARL: Parallel Speculative Decoding with Adaptive Draft Length
  ☆144Updated 2 weeks ago
• omni-ai-npu / omni-infer
  Omni_Infer is a suite of inference accelerators designed for the Ascend NPU platform, offering native support and an expanding feature se…
  ☆96Updated this week
• thunlp / FR-Spec
  [ACL 2025 main] FR-Spec: Frequency-Ranked Speculative Sampling
  ☆49Updated 5 months ago
• ifromeast / AI_analysis
  analyse problems of AI with Math and Code
  ☆27Updated 5 months ago
• yuandong-tian / arXiv_recbot
  A Telegram bot to recommend arXiv papers
  ☆298Updated 2 months ago
• microsoft / ParrotServe
  [OSDI'24] Serving LLM-based Applications Efficiently with Semantic Variable
  ☆206Updated last year
• MASWorks / MASLab
  ☆208Updated 5 months ago
• tsinghua-ideal / Twilight
  [NeurIPS'25 Spotlight] Adaptive Attention Sparsity with Hierarchical Top-p Pruning
  ☆83Updated last month
• TemporaryLoRA / Block-Attention
  ☆41Updated 9 months ago
• TsinghuaC3I / Awesome-Memory-for-Agents
  A Collection of Papers about Memory for Language Agents
  ☆245Updated 3 weeks ago
• yaof20 / Flash-RL
  Implementation for FP8/INT8 Rollout for RL training without performence drop.
  ☆281Updated 2 months ago
• LiuXiaoxuanPKU / OSD
  ☆64Updated last year
• qingkelab / qingketalk
  青稞Talk
  ☆184Updated this week
• Zefan-Cai / Awesome-LLM-KV-Cache
  Awesome-LLM-KV-Cache: A curated list of 📙Awesome LLM KV Cache Papers with Codes.
  ☆405Updated 10 months ago
• DataArcTech / Awesome-FinLLMs
  🥇 A curated list of awesome large language models in finance(FinLLMs), including papers,models,datasets and codebases. 金融大模型列表，特别是中英双语大模…
  ☆56Updated 11 months ago
• hao-ai-lab / Dynasor
  [NeurIPS 2025] Simple extension on vLLM to help you speed up reasoning model without training.
  ☆216Updated 7 months ago
• songxxzp / OpenReviewers
  Openreviewers: Multi Agent Academic Review Simulation System
  ☆23Updated last year
• tiingweii-shii / Awesome-Resource-Efficient-LLM-Papers
  a curated list of high-quality papers on resource-efficient LLMs 🌱
  ☆154Updated 9 months ago
• October2001 / Awesome-KV-Cache-Compression
  📰 Must-read papers on KV Cache Compression (constantly updating 🤗).
  ☆631Updated 3 months ago
• microsoft / SeerAttention
  SeerAttention: Learning Intrinsic Sparse Attention in Your LLMs
  ☆182Updated 3 months ago
• FFY0 / AdaKV
  The Official Implementation of Ada-KV [NeurIPS 2025]
  ☆123Updated last month
• mit-han-lab / Quest
  [ICML 2024] Quest: Query-Aware Sparsity for Efficient Long-Context LLM Inference
  ☆362Updated 6 months ago