Pie: Programmable LLM Serving
☆184Jul 20, 2026Updated this week
Alternatives and similar repositories for pie
Users that are interested in pie are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- A Rust-based embedded operating system designed to enable memory-safe, robust, and responsive embedded applications.☆85Apr 14, 2025Updated last year
- [ASPLOS'25] Towards End-to-End Optimization of LLM-based Applications with Ayo☆75Mar 11, 2026Updated 4 months ago
- Tempo is a system for declarative, efficient, end-to-end compiled dynamic deep learning☆30Oct 21, 2025Updated 8 months ago
- ☆45Oct 15, 2025Updated 9 months ago
- ☆20May 11, 2026Updated 2 months ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- ☆40Nov 28, 2024Updated last year
- Code repository for the SOSP'25 paper DCP: Addressing Input Dynamism In Long-Context Training via Dynamic Context Parallelism.☆21Nov 28, 2025Updated 7 months ago
- ☆20Dec 4, 2025Updated 7 months ago
- SC'25 UltraAttn: Efficiently Parallelizing Attention through Hierarchical Context-Tiling☆16Aug 14, 2025Updated 11 months ago
- A framework for generating realistic LLM serving workloads☆161May 11, 2026Updated 2 months ago
- PyTorch library for cost-effective, fast and easy serving of MoE models.☆319Jul 6, 2026Updated 2 weeks ago
- Preview Code for Continuum Paper☆89Jul 13, 2026Updated last week
- The official implementation of OSDI'25 paper BlitzScale☆48Apr 15, 2026Updated 3 months ago
- A low-latency & high-throughput serving engine for LLMs☆511Jan 8, 2026Updated 6 months ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- A throughput-oriented high-performance serving framework for LLMs☆968Mar 29, 2026Updated 3 months ago
- [OSDI'24] Serving LLM-based Applications Efficiently with Semantic Variable☆222Sep 21, 2024Updated last year
- Layered prefill changes the scheduling axis from tokens to layers and removes redundant MoE weight reloads while keeping decode stall fre…☆18Mar 9, 2026Updated 4 months ago
- verl Zero-Mismatch Dense/MoE HuggingFace Rollout☆61Updated this week
- Large Language Model (LLM) Systems Paper List☆2,195Updated this week
- ☆44Oct 11, 2025Updated 9 months ago
- ☆37Aug 7, 2025Updated 11 months ago
- ☆39Jun 4, 2026Updated last month
- Medusa: Accelerating Serverless LLM Inference with Materialization [ASPLOS'25]☆47May 13, 2025Updated last year
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- A ChatGPT(GPT-3.5) & GPT-4 Workload Trace to Optimize LLM Serving Systems☆279Jun 30, 2026Updated 3 weeks ago
- Scaling Up Memory Disaggregated Applications with SMART☆35Apr 23, 2024Updated 2 years ago
- a simple API to use CUPTI☆10Aug 19, 2025Updated 11 months ago
- [ASPLOS'26] Taming the Long-Tail: Efficient Reasoning RL Training with Adaptive Drafter☆174Feb 27, 2026Updated 4 months ago
- Virtualized Elastic KV Cache for Dynamic GPU Sharing and Beyond☆1,106Updated this week
- Open-source implementation for "Helix: Serving Large Language Models over Heterogeneous GPUs and Network via Max-Flow"☆93Oct 15, 2025Updated 9 months ago
- Can AI Agents Build Bespoke Systems?☆84Updated this week
- Artifact for "Marconi: Prefix Caching for the Era of Hybrid LLMs" [MLSys '25 Outstanding Paper Award, Honorable Mention]☆63Mar 5, 2025Updated last year
- ☆32Jan 16, 2025Updated last year
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- ☆21Jul 13, 2026Updated last week
- AI model training on heterogeneous, geo-distributed resources☆46Nov 24, 2025Updated 7 months ago
- Utilities for paper writing.☆12Jan 11, 2026Updated 6 months ago
- A Streaming-Native Serving Engine for TTS/STS Models☆74Jun 20, 2026Updated last month
- EMT: An OS Framework for New Memory Translation Architectures☆36Jul 22, 2025Updated 11 months ago
- The artifact for NDSS '25 paper "ASGARD: Protecting On-Device Deep Neural Networks with Virtualization-Based Trusted Execution Environmen…☆16Oct 16, 2025Updated 9 months ago
- RPCNIC: A High-Performance and Reconfigurable PCIe-attached RPC Accelerator [HPCA2025]☆15Dec 9, 2024Updated last year