Alternatives and similar repositories for Apt-Serve

Users that are interested in Apt-Serve are comparing it to the libraries listed below

• AISys-01 / vllm-CachedAttention

  View on GitHub
  The code based on vLLM for the paper “ Cost-Efficient Large Language Model Serving for Multi-turn Conversations with CachedAttention”.
  ☆11Sep 19, 2024Updated last year
• yichuan-w / MLsys_reading_list

  View on GitHub
  A record of reading list on some MLsys popular topic
  ☆21Mar 20, 2025Updated 10 months ago
• junhe / wiser

  View on GitHub
  A fast text search engine built for SSDs, written in C++.
  ☆11Aug 29, 2022Updated 3 years ago
• hao-ai-lab / vllm-ltr

  View on GitHub
  [NeurIPS 2024] Efficient LLM Scheduling by Learning to Rank
  ☆70Nov 4, 2024Updated last year
• James-QiuHaoran / LLM-serving-with-proxy-models

  View on GitHub
  Efficient Interactive LLM Serving with Proxy Model-based Sequence Length Prediction | A tiny BERT model can tell you the verbosity of an …
  ☆46Jun 1, 2024Updated last year
• MultiagentBench / MARBLE

  View on GitHub
  (ACL 2025 Main) Code for MultiAgentBench : Evaluating the Collaboration and Competition of LLM agents https://www.arxiv.org/pdf/2503.019…
  ☆32Jun 21, 2025Updated 7 months ago
• bentoml / BentoLMDeploy

  View on GitHub
  Self-host LLMs with LMDeploy and BentoML
  ☆22Dec 26, 2025Updated last month
• YaoJiayi / CacheBlend

  View on GitHub
  ☆165Jul 15, 2025Updated 7 months ago
• dywsjtu / apparate

  View on GitHub
  Artifact for "Apparate: Rethinking Early Exits to Tame Latency-Throughput Tensions in ML Serving" [SOSP '24]
  ☆25Nov 21, 2024Updated last year
• All-less / faas-scheduling-benchmark

  View on GitHub
  A benchmark suite for evaluating FaaS scheduler.
  ☆23Nov 5, 2022Updated 3 years ago
• ShaharBand / sentinel

  View on GitHub
  A user-friendly Command & Control (C&C) web platform for remote monitoring, management, and task automation across multiple devices.
  ☆14Dec 15, 2024Updated last year
• lingfenghsiang / Persistent-Memory-Study

  View on GitHub
  ☆26Mar 31, 2022Updated 3 years ago
• PluralisResearch / AsyncPP

  View on GitHub
  Asynchronous pipeline parallel optimization
  ☆19Feb 2, 2026Updated 2 weeks ago
• thustorage / Medusa

  View on GitHub
  Medusa: Accelerating Serverless LLM Inference with Materialization [ASPLOS'25]
  ☆41May 13, 2025Updated 9 months ago
• OpenRL-Lab / Ray_Tutorial

  View on GitHub
  Tutorial for Ray
  ☆36Mar 31, 2024Updated last year
• microsoft / chunk-attention

  View on GitHub
  ☆85Apr 18, 2025Updated 9 months ago
• GradientHQ / symphony

  View on GitHub
  Symphony — A decentralized multi-agent framework that enables intelligent agents to collaborate seamlessly across heterogeneous edge devi…
  ☆30Oct 30, 2025Updated 3 months ago
• hao-ai-lab / d3LLM

  View on GitHub
  d3LLM: Ultra-Fast Diffusion LLM 🚀
  ☆91Feb 4, 2026Updated last week
• t123yh / MIPSCPU

  View on GitHub
  A simple MIPS CPU for BUAA CO course (and now NSCSCC).
  ☆10May 15, 2021Updated 4 years ago
• schencoding / lits

  View on GitHub
  LITS: An Optimized Learned Index for Strings
  ☆13Jun 18, 2025Updated 7 months ago
• chenyiqun / Agentic-RAG

  View on GitHub
  This is the code of a agentic rag method with dynamic workflow.
  ☆13Jan 22, 2026Updated 3 weeks ago
• lzhangbv / acpsgd

  View on GitHub
  [ICDCS 2023] Evaluation and Optimization of Gradient Compression for Distributed Deep Learning
  ☆10Apr 28, 2023Updated 2 years ago
• 2bgm / KIE-HVQA

  View on GitHub
  ☆14Jun 10, 2025Updated 8 months ago
• hao-ai-lab / DistCA

  View on GitHub
  Efficient Long-context Language Model Training by Core Attention Disaggregation
  ☆89Jan 29, 2026Updated 2 weeks ago
• zxjcarrot / spitfire

  View on GitHub
  Source code for Spitfire: A Three-Tier Buffer Manager for Volatile and Non-Volatile Memory
  ☆39Jan 7, 2023Updated 3 years ago
• li1553770945 / PAL_OperatingSystem

  View on GitHub
  A simple OperatingSystem
  ☆10Sep 9, 2022Updated 3 years ago
• unit-mesh / unit-eval

  View on GitHub
  UnitEval is a benchmarking and evaluation tools for AutoDev Coder.
  ☆13Jan 2, 2024Updated 2 years ago
• johnMinelli / MovingObjectRemoval

  View on GitHub
  CV approach aimed to remove moving objects in videos (dynamic and static camera)
  ☆11Mar 21, 2021Updated 4 years ago
• LeoLin4258 / Infofusion

  View on GitHub
  A 100% locally run AI web tool for generating WeChat replies using the RWKV runner
  ☆10Oct 29, 2024Updated last year
• Pretend-to / Faden_api_server

  View on GitHub
  提供了一个极简的发电文案接口和一些云崽插件
  ☆11Jan 17, 2025Updated last year
• hydro-project / cidr2021

  View on GitHub
  paper and code for New Directions in Cloud Programming, CIDR 2021
  ☆11Feb 17, 2021Updated 4 years ago
• yutxie / cpu-riscv

  View on GitHub
  ACM Class 2017 Computer Architecture
  ☆10Jan 11, 2018Updated 8 years ago
• ARM-software / nomali-model

  View on GitHub
  A simple Mali 6xx/7xx register interface model that doesn't do any rendering.
  ☆13Jan 29, 2016Updated 10 years ago
• yanliu1111 / ChatGPT-API-embeddings-Supabase

  View on GitHub
  🤖 It is basic tools build for scraping & embedding text. The main technologies included OpenAI embeddings, Supabase and Next.js.
  ☆16Apr 12, 2023Updated 2 years ago
• nowfalvaasits / vivoto

  View on GitHub
  VIVOTO is an android simple video and photo editor that can remove anything that you want to remove object. In this app, you can use trim…
  ☆11Jun 16, 2020Updated 5 years ago
• ValyrianTech / F5-TTS_server

  View on GitHub
  API server for F5-TTS
  ☆19Jan 24, 2026Updated 3 weeks ago
• doppeltilde / image_video_classification

  View on GitHub
  Containerized self-hosted REST API for vision classification, utilizing Hugging Face transformers.
  ☆10Dec 5, 2024Updated last year
• parallel101 / hw08

  View on GitHub
  ☆11Sep 12, 2023Updated 2 years ago
• iantbutler01 / ditty

  View on GitHub
  A library for simplifying training with multi gpu setups in the HuggingFace / PyTorch ecosystem.
  ☆16Jan 9, 2026Updated last month