BlitzScale Router - Distributed LLM Inference Router (Rust)
☆18May 25, 2026Updated 5 months ago
Alternatives and similar repositories for blitz-router
Users that are interested in blitz-router are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- The repository for ATC'25 paper "Greyhound: Hunting Fail-Slows in Hybrid-Parallel Training at Scale"☆19Sep 7, 2026Updated 2 months ago
- ☆11Oct 29, 2026Updated 2 weeks ago
- W4A16 MoE GEMM CUDA kernel. Tuned for H200, B200 & B300.☆14Oct 30, 2026Updated 2 weeks ago
- Resource Multiplexing in Tuning and Serving Large Language Models (USENIX ATC 2025)☆10Apr 21, 2026Updated 6 months ago
- An efficient service for transparent GPU multiplexing with VRAM oversubscription, OSDI '26☆14Sep 24, 2026Updated last month
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- a simple API to use CUPTI☆10Aug 19, 2025Updated last year
- ROS下玩转四旋翼无人机(仿真)☆10Jul 20, 2017Updated 9 years ago
- A lightweight CuTe-based CUDA kernel for DuoAttention, optimized for large language model inference.☆12Dec 25, 2025Updated 10 months ago
- ☆25Updated this week
- The official implementation of OSDI'25 paper BlitzScale☆50Apr 15, 2026Updated 7 months ago
- A scheduling framework for multitasking over diverse XPUs, including GPUs, NPUs, ASICs, and FPGAs☆14Jun 17, 2026Updated 5 months ago
- Artifact evaluation repo for EuroSys'24.☆30Nov 7, 2023Updated 3 years ago
- Repo to replay Qwen trace☆36Jan 9, 2026Updated 10 months ago
- [EuroSys27] TokenCake: A KV-Cache-centric Serving Framework for LLM-based Multi-Agent Applications☆15Nov 10, 2026Updated last week
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- Mini-SGLang is a mini version of SGLang project ().☆13Sep 24, 2025Updated last year
- A benchmark suite for evaluating FaaS scheduler.☆23Nov 5, 2022Updated 4 years ago
- ☆192Apr 23, 2026Updated 6 months ago
- A high-performance, RDMA-native data-plane library for large-scale heterogeneous memory pools, developed by the Tencent Astral Network Te…☆35Aug 6, 2026Updated 3 months ago
- ☆21May 11, 2026Updated 6 months ago
- ☆21Jul 10, 2025Updated last year
- Medusa: Accelerating Serverless LLM Inference with Materialization [ASPLOS'25]☆50May 13, 2025Updated last year
- This is an unoffical LaTeX Template for SJTU Exam☆10Sep 1, 2025Updated last year
- LoRAFusion: Efficient LoRA Fine-Tuning for LLMs☆30Jul 2, 2026Updated 4 months ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- DynaFlow: Transparent and Flexible Intra-Device Parallelism via Programmable Operator Scheduling [MLSys'26]☆14May 21, 2026Updated 5 months ago
- 🎙️ Intelligently sync, transcribe, and organize Apple Voice Memos with AI - OpenClaw Skill☆12Mar 9, 2026Updated 8 months ago
- High-Throughput Batch Inference☆22Updated this week
- 2023/12/22 电三 420 每周会议技术分享:「容器」的 slides 和附件☆10Dec 22, 2023Updated 2 years ago
- An LLM inference engine, written in C++☆20Mar 30, 2026Updated 7 months ago
- MetaAttention: A Unified and Performant Attention Framework Across Hardware Backends(PPoPP'26)☆19Aug 6, 2026Updated 3 months ago
- Implementation from scratch in C of the Multi-head latent attention used in the Deepseek-v3 technical paper.☆18Jan 15, 2025Updated last year
- RLib is a header-only library for easier usage of RDMA.☆45Apr 10, 2021Updated 5 years ago
- 从零实现 LLM 推理引擎:15步学懂 vLLM 核心原理☆39Sep 9, 2026Updated 2 months ago
- Open source password manager - Proton Pass • AdSecurely store, share, and autofill your credentials with Proton Pass, the end-to-end encrypted password manager trusted by millions.
- A rust-version of NVIDIA BlueField DOCA kit.☆13Jun 11, 2023Updated 3 years ago
- [NSDI'26] PolyRL is a reinforcement learning framework for LLM that harvest spot instances on the cloud to reduce cost.☆20Mar 30, 2026Updated 7 months ago
- ☆21Jun 9, 2025Updated last year
- ☆13Jul 29, 2025Updated last year
- PowerSwitch: a adaptive mode switch engine for distributed parrallel graph computation☆16Dec 23, 2013Updated 12 years ago
- Early-stage Rust drop-in alternative frontend for vLLM☆73May 22, 2026Updated 5 months ago
- ☆24Sep 29, 2026Updated last month
Are these results useful?