Alternatives and similar repositories for MASS

Users that are interested in MASS are comparing it to the libraries listed below

• EachSheep / ShortcutsBench
  ShortcutsBench: A Large-Scale Real-World Benchmark for API-Based Agents
  ☆103Updated last month
• TreeAI-Lab / Awesome-KV-Cache-Management
  This repository serves as a comprehensive survey of LLM development, featuring numerous research papers along with their corresponding co…
  ☆172Updated last week
• Relaxed-System-Lab / COMP6211J_Course_HKUST
  ☆42Updated 8 months ago
• hao-ai-lab / vllm-ltr
  [NeurIPS 2024] Efficient LLM Scheduling by Learning to Rank
  ☆51Updated 9 months ago
• MASWorks / MASLab
  ☆160Updated last week
• YaoJiayi / CacheBlend
  ☆125Updated 3 weeks ago
• Zefan-Cai / Awesome-LLM-KV-Cache
  Awesome-LLM-KV-Cache: A curated list of 📙Awesome LLM KV Cache Papers with Codes.
  ☆343Updated 5 months ago
• DataArcTech / Awesome-FinLLMs
  🥇 A curated list of awesome large language models in finance(FinLLMs), including papers,models,datasets and codebases. 金融大模型列表，特别是中英双语大模…
  ☆44Updated 6 months ago
• NetX-lab / Ayo
  [ASPLOS'25] Towards End-to-End Optimization of LLM-based Applications with Ayo
  ☆30Updated 2 weeks ago
• yuandong-tian / arXiv_recbot
  A Telegram bot to recommend arXiv papers
  ☆281Updated 3 months ago
• zwxandy / Awesome-Efficient-CoT-Reasoning-Summary
  🔥 How to efficiently and effectively compress the CoTs or directly generate concise CoTs during inference while maintaining the reasonin…
  ☆56Updated 2 months ago
• UbiquitousLearning / Efficient_Foundation_Model_Survey
  Survey Paper List - Efficient LLM and Foundation Models
  ☆253Updated 10 months ago
• tonyzhao-jt / LLM-PQ
  Official Repo for "LLM-PQ: Serving LLM on Heterogeneous Clusters with Phase-Aware Partition and Adaptive Quantization"
  ☆34Updated last month
• lambda7xx / awesome-AI-system
  paper and its code for AI System
  ☆318Updated 3 months ago
• keli-wen / AGI-Study
  The blog, read report and code example for AGI/LLM related knowledge.
  ☆40Updated 6 months ago
• fanlai0990 / CS598
  Systems for GenAI
  ☆142Updated 3 months ago
• PKU-DAIR / Starter-Guide
  A comprehensive guide for beginners in the field of data management and artificial intelligence.
  ☆376Updated 3 months ago
• MLSys-Learner-Resources / Awesome-MLSys-Blogger
  The repository has collected a batch of noteworthy MLSys bloggers (Algorithms/Systems)
  ☆263Updated 7 months ago
• microsoft / ParrotServe
  [OSDI'24] Serving LLM-based Applications Efficiently with Semantic Variable
  ☆170Updated 10 months ago
• yanweiyue / masrouter
  ☆76Updated 2 months ago
• Hsword / Awesome-Machine-Learning-System-Papers
  ☆74Updated 3 years ago
• sii-research / siiRL
  siiRL: Shanghai Innovation Institute RL Framework for Advanced LLMs and Multi-Agent Systems
  ☆130Updated last week
• ifromeast / AI_analysis
  analyse problems of AI with Math and Code
  ☆18Updated last week
• hemingkx / Awesome-Efficient-Reasoning
  Paper list for Efficient Reasoning.
  ☆573Updated this week
• modelscope / Trinity-RFT
  Trinity-RFT is a general-purpose, flexible and scalable framework designed for reinforcement fine-tuning (RFT) of large language models (…
  ☆204Updated this week
• SuDIS-ZJU / llm-inference-all-in-one
  ☆13Updated 5 months ago
• UChi-JCL / CacheGen
  ☆115Updated 9 months ago
• MoE-Inf / awesome-moe-inference
  Curated collection of papers in MoE model inference
  ☆220Updated this week
• KaiLv69 / DuoDecoding
  DuoDecoding: Hardware-aware Heterogeneous Speculative Decoding with Dynamic Multi-Sequence Drafting
  ☆15Updated 5 months ago
• interestingLSY / swiftLLM
  A tiny yet powerful LLM inference system tailored for researching purpose. vLLM-equivalent performance with only 2k lines of code (2% of …
  ☆238Updated last month