A programmable system for high-performance model serving
☆242Nov 18, 2026Updated this week
Alternatives and similar repositories for pie
Users that are interested in pie are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- A Rust-based embedded operating system designed to enable memory-safe, robust, and responsive embedded applications.☆83Apr 14, 2025Updated last year
- [ASPLOS'25] Towards End-to-End Optimization of LLM-based Applications with Ayo☆80Mar 11, 2026Updated 8 months ago
- [OSDI'24] Serving LLM-based Applications Efficiently with Semantic Variable☆228Oct 14, 2026Updated last month
- ☆17Updated this week
- Tempo is a system for declarative, efficient, end-to-end compiled dynamic deep learning☆31Oct 21, 2025Updated last year
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- ☆46Oct 15, 2025Updated last year
- ☆38Nov 28, 2024Updated last year
- A framework for generating realistic LLM serving workloads☆196Aug 27, 2026Updated 2 months ago
- ☆97Sep 15, 2025Updated last year
- ☆21May 11, 2026Updated 6 months ago
- Code repository for the SOSP'25 paper DCP: Addressing Input Dynamism In Long-Context Training via Dynamic Context Parallelism.☆23Nov 28, 2025Updated 11 months ago
- This is the public repo for DREAM accepted to ICS 2025.☆12Dec 28, 2025Updated 10 months ago
- Preview Code for Continuum Paper☆113Oct 26, 2026Updated 3 weeks ago
- A tiny yet powerful LLM inference system tailored for researching purpose. vLLM-equivalent performance with only 2k lines of code (2% of …☆366Jun 10, 2025Updated last year
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- An efficient service for transparent GPU multiplexing with VRAM oversubscription, OSDI '26☆14Sep 24, 2026Updated last month
- ☆20Dec 4, 2025Updated 11 months ago
- A throughput-oriented high-performance serving framework for LLMs☆978Mar 29, 2026Updated 7 months ago
- A low-latency & high-throughput serving engine for LLMs☆539Updated this week
- SC'25 UltraAttn: Efficiently Parallelizing Attention through Hierarchical Context-Tiling☆16Aug 14, 2025Updated last year
- ☆19Sep 27, 2026Updated last month
- GPU Functional Descriptor for memory access☆36May 24, 2026Updated 5 months ago
- ☆136Nov 11, 2024Updated 2 years ago
- ARIES is an open-source experimentation framework for agent serving systems research.☆40Updated this week
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- PyTorch library for cost-effective, fast and easy serving of MoE models.☆385Updated this week
- Disaggregated serving system for Large Language Models (LLMs).☆847Apr 6, 2025Updated last year
- High-Throughput Batch Inference☆22Updated this week
- The official implementation of OSDI'25 paper BlitzScale☆50Apr 15, 2026Updated 7 months ago
- Large Language Model (LLM) Systems Paper List☆2,328Oct 20, 2026Updated 3 weeks ago
- Lightweight Benchmark Server for Agentic GPU Programming☆59Updated this week
- Reverse-engineered instruction set architecture database for NVIDIA SM120 (Blackwell) GPUs.☆31Updated this week
- Serverless LLM Serving for Everyone.☆720Sep 4, 2026Updated 2 months ago
- ☆19Aug 16, 2025Updated last year
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- InfiniGen: Efficient Generative Inference of Large Language Models with Dynamic KV Cache Management (OSDI'24)☆197Jul 10, 2024Updated 2 years ago
- [ASPLOS'26] Taming the Long-Tail: Efficient Reasoning RL Training with Adaptive Drafter☆187Feb 27, 2026Updated 8 months ago
- Accelerating Large-Scale Reasoning Model Inference with Sparse Self-Speculative Decoding☆123Dec 2, 2025Updated 11 months ago
- Artifact for "Marconi: Prefix Caching for the Era of Hybrid LLMs" [MLSys '25 Outstanding Paper Award, Honorable Mention]☆74Mar 5, 2025Updated last year
- A Machine Learning Framework for High Performance written in Rust☆28Sep 1, 2022Updated 4 years ago
- Stateful LLM Serving☆111Mar 11, 2025Updated last year
- Easy, Fast, and Scalable Multimodal AI☆135Jun 2, 2026Updated 5 months ago
Are these results useful?