Alternatives and similar repositories for MASS

Users that are interested in MASS are comparing it to the libraries listed below

• TreeAI-Lab / Awesome-KV-Cache-Management
  This repository serves as a comprehensive survey of LLM development, featuring numerous research papers along with their corresponding co…
  ☆278Updated last month
• EachSheep / ShortcutsBench
  ShortcutsBench: A Large-Scale Real-World Benchmark for API-Based Agents
  ☆108Updated 7 months ago
• YaoJiayi / CacheBlend
  ☆164Updated 6 months ago
• DataArcTech / Awesome-FinLLMs
  🥇 A curated list of awesome large language models in finance(FinLLMs), including papers,models,datasets and codebases. 金融大模型列表，特别是中英双语大模…
  ☆56Updated last year
• NetX-lab / Ayo
  [ASPLOS'25] Towards End-to-End Optimization of LLM-based Applications with Ayo
  ☆60Updated 5 months ago
• hao-ai-lab / vllm-ltr
  [NeurIPS 2024] Efficient LLM Scheduling by Learning to Rank
  ☆69Updated last year
• songxxzp / OpenReviewers
  Openreviewers: Multi Agent Academic Review Simulation System
  ☆23Updated last year
• Zefan-Cai / Awesome-LLM-KV-Cache
  Awesome-LLM-KV-Cache: A curated list of 📙Awesome LLM KV Cache Papers with Codes.
  ☆411Updated 10 months ago
• UbiquitousLearning / Efficient_Foundation_Model_Survey
  Survey Paper List - Efficient LLM and Foundation Models
  ☆260Updated last year
• thinkwee / AgentsMeetRL
  Awesome List for Agentic RL
  ☆738Updated last month
• nex-agi / NexRL
  NexRL is an ultra-loosely-coupled LLM post-training framework.
  ☆87Updated this week
• withinmiaov / A-Survey-on-Mixture-of-Experts-in-LLMs
  [TKDE'25] The official GitHub page for the survey paper "A Survey on Mixture of Experts in Large Language Models".
  ☆480Updated 6 months ago
• zwxandy / Awesome-Efficient-CoT-Reasoning-Summary
  🔥 How to efficiently and effectively compress the CoTs or directly generate concise CoTs during inference while maintaining the reasonin…
  ☆64Updated 8 months ago
• hemingkx / Awesome-Efficient-Reasoning
  Paper list for Efficient Reasoning.
  ☆813Updated this week
• MoE-Inf / awesome-moe-inference
  Curated collection of papers in MoE model inference
  ☆339Updated 3 months ago
• wangyu-ustc / Mem-alpha
  The official implementation of the paper "Mem-α: Learning Memory Construction via Reinforcement Learning"
  ☆154Updated last month
• dhcode-cpp / NSA-pytorch
  DeepSeek Native Sparse Attention pytorch implementation
  ☆114Updated last month
• tsinghua-ideal / Twilight
  [NeurIPS'25 Spotlight] Adaptive Attention Sparsity with Hierarchical Top-p Pruning
  ☆87Updated 2 months ago
• Ketonmi / Awesome-Large-Scale-LLM-Serving
  Must-read papers on improving efficiency for LLM serving clusters
  ☆32Updated 8 months ago
• MASWorks / MASLab
  ☆213Updated 6 months ago
• keli-wen / AGI-Study
  The blog, read report and code example for AGI/LLM related knowledge.
  ☆55Updated last year
• SuDIS-ZJU / llm-inference-all-in-one
  ☆17Updated 11 months ago
• microsoft / ParrotServe
  [OSDI'24] Serving LLM-based Applications Efficiently with Semantic Variable
  ☆208Updated last year
• omni-ai-npu / omni-infer
  Omni_Infer is a suite of inference accelerators designed for the Ascend NPU platform, offering native support and an expanding feature se…
  ☆102Updated this week
• ifromeast / AI_analysis
  analyse problems of AI with Math and Code
  ☆27Updated 6 months ago
• interestingLSY / swiftLLM
  A tiny yet powerful LLM inference system tailored for researching purpose. vLLM-equivalent performance with only 2k lines of code (2% of …
  ☆312Updated 7 months ago
• October2001 / Awesome-KV-Cache-Compression
  📰 Must-read papers on KV Cache Compression (constantly updating 🤗).
  ☆646Updated 4 months ago
• MLSys-Learner-Resources / Awesome-MLSys-Blogger
  The repository has collected a batch of noteworthy MLSys bloggers (Algorithms/Systems)
  ☆317Updated last year
• hao-ai-lab / Dynasor
  [NeurIPS 2025] Simple extension on vLLM to help you speed up reasoning model without training.
  ☆218Updated 8 months ago
• yaof20 / Flash-RL
  Implementation for FP8/INT8 Rollout for RL training without performence drop.
  ☆288Updated 2 months ago