Alternatives and similar repositories for MASS

Users that are interested in MASS are comparing it to the libraries listed below

• EachSheep / ShortcutsBench
  ShortcutsBench: A Large-Scale Real-World Benchmark for API-Based Agents
  ☆103Updated 3 weeks ago
• TreeAI-Lab / Awesome-KV-Cache-Management
  This repository serves as a comprehensive survey of LLM development, featuring numerous research papers along with their corresponding co…
  ☆162Updated 3 weeks ago
• hao-ai-lab / vllm-ltr
  [NeurIPS 2024] Efficient LLM Scheduling by Learning to Rank
  ☆49Updated 8 months ago
• Zefan-Cai / Awesome-LLM-KV-Cache
  Awesome-LLM-KV-Cache: A curated list of 📙Awesome LLM KV Cache Papers with Codes.
  ☆325Updated 4 months ago
• UbiquitousLearning / Efficient_Foundation_Model_Survey
  Survey Paper List - Efficient LLM and Foundation Models
  ☆252Updated 9 months ago
• PKUFlyingPig / MIT6.5940_TinyML
  Course materials for MIT6.5940: TinyML and Efficient Deep Learning Computing
  ☆49Updated 6 months ago
• MoE-Inf / awesome-moe-inference
  Curated collection of papers in MoE model inference
  ☆204Updated 4 months ago
• microsoft / ParrotServe
  [OSDI'24] Serving LLM-based Applications Efficiently with Semantic Variable
  ☆168Updated 9 months ago
• lambda7xx / awesome-AI-system
  paper and its code for AI System
  ☆316Updated 3 months ago
• PKU-DAIR / Starter-Guide
  A comprehensive guide for beginners in the field of data management and artificial intelligence.
  ☆345Updated 3 months ago
• Relaxed-System-Lab / COMP6211J_Course_HKUST
  ☆42Updated 7 months ago
• YaoJiayi / CacheBlend
  ☆120Updated 6 months ago
• UbiquitousLearning / Paper-list-resource-efficient-large-language-model
  ☆100Updated last year
• UChi-JCL / CacheGen
  ☆110Updated 9 months ago
• tiingweii-shii / Awesome-Resource-Efficient-LLM-Papers
  a curated list of high-quality papers on resource-efficient LLMs 🌱
  ☆128Updated 3 months ago
• NetX-lab / Ayo
  [ASPLOS'25] Towards End-to-End Optimization of LLM-based Applications with Ayo
  ☆29Updated last week
• MASWorks / MASLab
  ☆142Updated this week
• Ying1123 / VTC-artifact
  ☆32Updated last year
• PKU-SEC-Lab / HybriMoE
  [DAC'25] Official implement of "HybriMoE: Hybrid CPU-GPU Scheduling and Cache Management for Efficient MoE Inference"
  ☆58Updated last month
• EfficientMoE / MoE-Infinity
  PyTorch library for cost-effective, fast and easy serving of MoE models.
  ☆207Updated last week
• openpsi-project / ReaLHF
  Super-Efficient RLHF Training of LLMs with Parameter Reallocation
  ☆306Updated 2 months ago
• LiuXiaoxuanPKU / OSD
  ☆54Updated 7 months ago
• fanlai0990 / CS598
  Systems for GenAI
  ☆142Updated 2 months ago
• October2001 / Awesome-KV-Cache-Compression
  📰 Must-read papers on KV Cache Compression (constantly updating 🤗).
  ☆481Updated 2 weeks ago
• hao-ai-lab / Dynasor
  Simple extension on vLLM to help you speed up reasoning model without training.
  ☆166Updated last month
• ifromeast / AI_analysis
  analyse problems of AI with Math and Code
  ☆18Updated last week
• tonyzhao-jt / LLM-PQ
  Official Repo for "LLM-PQ: Serving LLM on Heterogeneous Clusters with Phase-Aware Partition and Adaptive Quantization"
  ☆34Updated last week
• smart-lty / ParallelSpeculativeDecoding
  [ICLR 2025] PEARL: Parallel Speculative Decoding with Adaptive Draft Length
  ☆93Updated 3 months ago
• yuandong-tian / arXiv_recbot
  A Telegram bot to recommend arXiv papers
  ☆276Updated 3 months ago
• DataArcTech / Awesome-FinLLMs
  🥇 A curated list of awesome large language models in finance(FinLLMs), including papers,models,datasets and codebases. 金融大模型列表，特别是中英双语大模…
  ☆44Updated 6 months ago