☆21Jun 9, 2025Updated last year
Alternatives and similar repositories for Apt-Serve
Users that are interested in Apt-Serve are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- The code based on vLLM for the paper “ Cost-Efficient Large Language Model Serving for Multi-turn Conversations with CachedAttention”.☆11Sep 19, 2024Updated 2 years ago
- [NeurIPS 2024] Efficient LLM Scheduling by Learning to Rank☆85Nov 4, 2024Updated 2 years ago
- ☆33Jan 16, 2025Updated last year
- BlitzScale Router - Distributed LLM Inference Router (Rust)☆17May 25, 2026Updated 5 months ago
- ☆15Apr 11, 2024Updated 2 years ago
- Deploy open-source AI quickly and easily - Special Bonus Offer • AdRunpod Hub is built for open source. One-click deployment and autoscaling endpoints without provisioning your own infrastructure.
- Understanding and Reusing Test Suites Across Database Systems. SIGMOD'25☆11Jan 13, 2026Updated 9 months ago
- Efficient Interactive LLM Serving with Proxy Model-based Sequence Length Prediction | A tiny BERT model can tell you the verbosity of an …☆53Jun 1, 2024Updated 2 years ago
- ☆25Mar 31, 2022Updated 4 years ago
- ☆208Jul 15, 2025Updated last year
- Preview Code for Continuum Paper☆112Oct 26, 2026Updated last week
- 🧠Plan-and-Budget: Training-free test-time reasoning framework for adaptive token allocation in large language models (ICLR 2026).☆20Mar 2, 2026Updated 8 months ago
- PipeRAG: Fast Retrieval-Augmented Generation via Algorithm-System Co-design (KDD 2025)☆32Jun 14, 2024Updated 2 years ago
- ☆13Jan 5, 2026Updated 10 months ago
- ☆47Oct 11, 2025Updated last year
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- Unofficial TypeScript SDK for FeiShu/Lark API☆11Oct 20, 2026Updated 2 weeks ago
- FlowWalker is a practical off-line taint analysis framework with high efficiency and low overhead.☆12Feb 11, 2015Updated 11 years ago
- ☆23Aug 24, 2026Updated 2 months ago
- Artifact Evaluation for SOSP 2025☆23Aug 16, 2025Updated last year
- Artifact for "Apparate: Rethinking Early Exits to Tame Latency-Throughput Tensions in ML Serving" [SOSP '24]☆25Nov 21, 2024Updated last year
- ☆25Oct 3, 2026Updated last month
- ☆89Apr 18, 2025Updated last year
- ☆11Feb 7, 2022Updated 4 years ago
- ☆12Dec 17, 2022Updated 3 years ago
- Simple, predictable pricing with DigitalOcean hosting • AdAlways know what you'll pay with monthly caps and flat pricing. Enterprise-grade infrastructure trusted by 600k+ customers.
- 大学做过的各种作业项目等。☆14Dec 20, 2018Updated 7 years ago
- ☆22Mar 2, 2025Updated last year
- A docker image for One Student One Chip's debug exam☆10Sep 22, 2023Updated 3 years ago
- Serverless LLM Serving for Everyone.☆717Sep 4, 2026Updated 2 months ago
- ☆101Nov 25, 2024Updated last year
- A benchmark suite for evaluating FaaS scheduler.☆23Nov 5, 2022Updated 4 years ago
- LITS: An Optimized Learned Index for Strings☆13Sep 30, 2026Updated last month
- ☆10Dec 17, 2020Updated 5 years ago
- The Official Implementation of Ada-KV [NeurIPS 2025]☆143Nov 26, 2025Updated 11 months ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- ☆32Feb 3, 2026Updated 9 months ago
- KEEP：Official code for "KEEP: A KV-Cache-Centric Memory Management System for Efficient Embodied Planning". A memory management system op…☆13Jul 9, 2026Updated 3 months ago
- Finetune LLaMA-2-7b-chat to perform safety evaluation of user-bot conversation☆11Jun 2, 2025Updated last year
- 实验报告自动生成☆11Jun 6, 2020Updated 6 years ago
- 基于DouZero实现API交互斗地主AI☆40Dec 22, 2024Updated last year
- ☆30May 2, 2026Updated 6 months ago
- The official implementation for the intra-stage fusion technique introduced in https://arxiv.org/abs/2409.13221☆32Apr 22, 2025Updated last year