An efficient service for transparent GPU multiplexing with VRAM oversubscription, OSDI '26
☆12Sep 24, 2026Updated last month
Alternatives and similar repositories for Nixie
Users that are interested in Nixie are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Repo for ECHO: Efficient KV Cache Offloading with Lossless Prefetching for Serving Native Sparse Attention LLMs (OSDI'26)☆42Jul 12, 2026Updated 3 months ago
- BlitzScale Router - Distributed LLM Inference Router (Rust)☆17May 25, 2026Updated 5 months ago
- a simple API to use CUPTI☆10Aug 19, 2025Updated last year
- Reduce kernel based on CUTLASS CuTe and TMA.☆12Sep 25, 2025Updated last year
- A collection of command-line tools based on Dyninst☆18Jun 3, 2021Updated 5 years ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- Deduplication over dis-aggregated memory for Serverless Computing☆14Mar 21, 2022Updated 4 years ago
- [EuroSys27] TokenCake: A KV-Cache-centric Serving Framework for LLM-based Multi-Agent Applications☆15Updated this week
- Source code for paper Fused3S: Fast Sparse Attention on Tensor Cores☆11Oct 13, 2025Updated last year
- Medusa: Accelerating Serverless LLM Inference with Materialization [ASPLOS'25]☆50May 13, 2025Updated last year
- ☆27Jan 18, 2026Updated 9 months ago
- ☆24May 27, 2025Updated last year
- ☆16Jul 19, 2026Updated 3 months ago
- code repo for GCR [FAST'26]☆18Mar 3, 2026Updated 8 months ago
- Foundry materializes CUDA graphs along with its execution context to disk to support fast cold start of serving engines.☆68Updated this week
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- SocksDirect code repository☆20May 6, 2026Updated 6 months ago
- Boosting GPU utilization for LLM serving via dynamic spatial-temporal prefill & decode orchestration☆56Sep 23, 2026Updated last month
- MetaAttention: A Unified and Performant Attention Framework Across Hardware Backends(PPoPP'26)☆18Aug 6, 2026Updated 3 months ago
- SC'25 UltraAttn: Efficiently Parallelizing Attention through Hierarchical Context-Tiling☆16Aug 14, 2025Updated last year
- ☆13Jan 17, 2024Updated 2 years ago
- [NeurIPS'25] KVCOMM: Online Cross-context KV-cache Communication for Efficient LLM-based Multi-agent Systems☆18Nov 1, 2025Updated last year
- ☆21May 11, 2026Updated 5 months ago
- High-Throughput Batch Inference☆19Updated this week
- Artifacts for SWARM: Replicating Shared Disaggregated-Memory Data in No Time☆10Sep 25, 2024Updated 2 years ago
- End-to-end encrypted email - Proton Mail • AdSpecial offer: 40% Off Yearly / 80% Off First Month. All Proton services are open source and independently audited for security.
- MAGIS: Memory Optimization via Coordinated Graph Transformation and Scheduling for DNN (ASPLOS'24)☆58May 29, 2024Updated 2 years ago
- 2023/12/22 电三 420 每周会议技术分享：「容器」的 slides 和附件☆10Dec 22, 2023Updated 2 years ago
- Reverse-engineered instruction set architecture database for NVIDIA SM120 (Blackwell) GPUs.☆28Updated this week
- This is the implementation repository of our SOSP'24 paper: Aceso: Achieving Efficient Fault Tolerance in Memory-Disaggregated Key-Value …☆24Oct 20, 2024Updated 2 years ago
- ☆17Jun 15, 2026Updated 4 months ago
- A Dual-Core example project for STM32H745 microcontroller using Nucleo-H745 devboard☆13Mar 4, 2024Updated 2 years ago
- ☆11Jun 4, 2026Updated 5 months ago
- A hybrid GPU cluster simulator for ML system performance estimation☆56Jul 15, 2026Updated 3 months ago
- [ASPLOS'24] FaaSMem: Improving Memory Efficiency of Serverless Computing with Memory Pool Architecture☆12Nov 4, 2024Updated 2 years ago
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- This is Official implementation for T2S-Bench & Structure-of-Thought: Benchmarking and Prompting Comprehensive Text-to-Structure Reasonin…☆25Mar 5, 2026Updated 8 months ago
- Share your GPU without MIG or MPS☆54Oct 23, 2026Updated 2 weeks ago
- Code repository for the SOSP'25 paper DCP: Addressing Input Dynamism In Long-Context Training via Dynamic Context Parallelism.☆23Nov 28, 2025Updated 11 months ago
- A fault-tolerant RDMA-based disaggregated key-value store with 1-RTT UPDATEs and GETs thanks to the SWARM replication protocol☆14Sep 25, 2024Updated 2 years ago
- ☆28Sep 17, 2024Updated 2 years ago
- ☆14Jun 16, 2026Updated 4 months ago
- A RV32I pipeline CPU and applications transplanted from AM, NJU-Project-N☆13Feb 25, 2022Updated 4 years ago