The official implementation of OSDI'25 paper BlitzScale
☆50Apr 15, 2026Updated 6 months ago
Alternatives and similar repositories for blitz-scale
Users that are interested in blitz-scale are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Medusa: Accelerating Serverless LLM Inference with Materialization [ASPLOS'25]☆50May 13, 2025Updated last year
- BlitzScale Router - Distributed LLM Inference Router (Rust)☆17May 25, 2026Updated 5 months ago
- Artifact evaluation repo for EuroSys'24.☆30Nov 7, 2023Updated 2 years ago
- ☆10Apr 5, 2025Updated last year
- An OS kernel module for fast **remote** fork using advanced datacenter networking (RDMA).☆73Feb 15, 2025Updated last year
- Deploy open-source AI quickly and easily - Special Bonus Offer • AdRunpod Hub is built for open source. One-click deployment and autoscaling endpoints without provisioning your own infrastructure.
- ☆21May 11, 2026Updated 5 months ago
- A scheduling framework for multitasking over diverse XPUs, including GPUs, NPUs, ASICs, and FPGAs☆14Jun 17, 2026Updated 4 months ago
- Ths is a fast RDMA abstraction layer that works both in the kernel and user-space.☆58Nov 12, 2024Updated last year
- Project Mitosis Introduction☆19Nov 13, 2022Updated 3 years ago
- A rust-based benchmark for BlueField SmartNICs.☆30Jul 5, 2023Updated 3 years ago
- Repo to replay Qwen trace☆36Jan 9, 2026Updated 9 months ago
- [FAST'25] ShiftLock: Mitigate One-sided RDMA Lock Contention via Handover.☆20Feb 11, 2025Updated last year
- code repo for GCR [FAST'26]☆18Mar 3, 2026Updated 7 months ago
- ☆10Oct 22, 2026Updated last week
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- ☆21Jul 10, 2025Updated last year
- DeDe (OSDI '25): an optimization framework for large-scale resource allocation☆15May 18, 2026Updated 5 months ago
- [ASPLOS'24] FaaSMem: Improving Memory Efficiency of Serverless Computing with Memory Pool Architecture☆12Nov 4, 2024Updated last year
- Mini-SGLang is a mini version of SGLang project ().☆13Sep 24, 2025Updated last year
- A lightweight CuTe-based CUDA kernel for DuoAttention, optimized for large language model inference.☆12Dec 25, 2025Updated 10 months ago
- Resource Multiplexing in Tuning and Serving Large Language Models (USENIX ATC 2025)☆10Apr 21, 2026Updated 6 months ago
- ☆19May 28, 2024Updated 2 years ago
- NEO is a LLM inference engine built to save the GPU memory crisis by CPU offloading☆99Jun 16, 2025Updated last year
- ☆45Nov 15, 2022Updated 3 years ago
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- A decentralized scalar timestamp scheme☆16Apr 12, 2021Updated 5 years ago
- A Rust RDMA library.☆13Oct 16, 2026Updated last week
- ☆184Apr 23, 2026Updated 6 months ago
- ☆17May 10, 2024Updated 2 years ago
- ☆18Sep 27, 2026Updated last month
- Code repository for the SOSP'25 paper DCP: Addressing Input Dynamism In Long-Context Training via Dynamic Context Parallelism.☆23Nov 28, 2025Updated 11 months ago
- Medusa: Accelerating Serverless LLM Inference with Materialization [ASPLOS'25]☆12Nov 8, 2024Updated last year
- Fastswap, a fast swap system for far memory through RDMA☆85Nov 19, 2023Updated 2 years ago
- Serverless LLM Serving for Everyone.☆718Sep 4, 2026Updated last month
- Deploy open-source AI quickly and easily - Special Bonus Offer • AdRunpod Hub is built for open source. One-click deployment and autoscaling endpoints without provisioning your own infrastructure.
- Reading seminar in Harvard Cloud Networking and Systems Group☆16Aug 29, 2022Updated 4 years ago
- An adaptive collective communication library for distributed training☆14Apr 29, 2024Updated 2 years ago
- PilotFish harvests the free GPU cycles of cloud gaming with deep learning training☆14Jul 2, 2022Updated 4 years ago
- Fast OS-level support for GPU checkpoint and restore☆298Sep 28, 2025Updated last year
- ☆35Feb 2, 2024Updated 2 years ago
- ☆27Oct 1, 2025Updated last year
- ☆24Sep 29, 2026Updated last month