Foundry materializes CUDA graphs along with its execution context to disk to support fast cold start of serving engines.
☆45Jul 8, 2026Updated this week
Alternatives and similar repositories for foundry
Users that are interested in foundry are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- a simple API to use CUPTI☆10Aug 19, 2025Updated 10 months ago
- ☆13Oct 13, 2025Updated 9 months ago
- MetaAttention: A Unified and Performant Attention Framework Across Hardware Backends(PPoPP'26)☆16Dec 31, 2025Updated 6 months ago
- Low overhead tracing library and trace visualizer for pipelined CUDA kernels☆136Nov 26, 2025Updated 7 months ago
- ☆20Jun 11, 2026Updated last month
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- ☆20Jul 11, 2024Updated 2 years ago
- MAGIS: Memory Optimization via Coordinated Graph Transformation and Scheduling for DNN (ASPLOS'24)☆57May 29, 2024Updated 2 years ago
- Network Traffic Transformer to learn network dynamics from packet traces. Learn fundamental dynamics with pre-training and fine-tune to m…☆24Jan 17, 2024Updated 2 years ago
- A language-model–powered compressor for natural language text☆52Oct 23, 2025Updated 8 months ago
- A fault-tolerant RDMA-based disaggregated key-value store with 1-RTT UPDATEs and GETs thanks to the SWARM replication protocol☆14Sep 25, 2024Updated last year
- [MLSys 26] 🥇 Solution for Gated Delta Net Track of MLSys 26 Flash infer competition☆35May 22, 2026Updated last month
- This is the implementation repository of our SOSP'24 paper: Aceso: Achieving Efficient Fault Tolerance in Memory-Disaggregated Key-Value …☆24Oct 20, 2024Updated last year
- Deduplication over dis-aggregated memory for Serverless Computing☆14Mar 21, 2022Updated 4 years ago
- FlashInfer Bench @ MLSys 2026: Building AI agents to write high performance GPU kernels☆174Apr 26, 2026Updated 2 months ago
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- ☆40Jul 1, 2026Updated last week
- ☆66May 7, 2026Updated 2 months ago
- [Accepted to SOSP 2026] Fast Deterministic LLM Inference☆21Updated this week
- Multi-GPU dynamic scheduler using PGAS style cross-GPU communication☆29Jul 23, 2023Updated 2 years ago
- Batched square compact-Householder QR factorization.☆15Jul 2, 2026Updated last week
- Verification and optimization tool for concurrent code☆28Jul 29, 2025Updated 11 months ago
- Can AI Agents Build Bespoke LLM Serving Systems?☆81Updated this week
- Compact and Agent-Native MoE Training System☆253Updated this week
- Efficient Long-context Language Model Training by Core Attention Disaggregation☆106Apr 7, 2026Updated 3 months ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Repository linking to the software artifacts used for the MigrOS ATC 2021 paper☆18May 31, 2021Updated 5 years ago
- Implementation from scratch in C of the Multi-head latent attention used in the Deepseek-v3 technical paper.☆18Jan 15, 2025Updated last year
- ☆113May 31, 2025Updated last year
- ☆18May 3, 2024Updated 2 years ago
- An agent harness that compiles a model into one provably-correct, self-retargeting CUDA megakernel and self-tunes it past cuBLAS at batch…☆104Jun 29, 2026Updated 2 weeks ago
- NVSHMEM‑Tutorial: Build a DeepEP‑like GPU Buffer☆193Feb 11, 2026Updated 5 months ago
- ☆52May 19, 2025Updated last year
- ☆15Dec 13, 2024Updated last year
- Virtualized Elastic KV Cache for Dynamic GPU Sharing and Beyond☆1,098Jul 2, 2026Updated last week
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- Tiny-DeepSpeed, a minimalistic re-implementation of the DeepSpeed library☆53Aug 20, 2025Updated 10 months ago
- Composable and Embeddable Communication Runtime for Distributed AI Services☆102Jun 5, 2026Updated last month
- PipeSwitch: Fast Pipelined Context Switching for Deep Learning Applications☆127May 9, 2022Updated 4 years ago
- LoRAFusion: Efficient LoRA Fine-Tuning for LLMs☆28Jul 2, 2026Updated last week
- Dataflow-Oriented Reinforcement Learning for (Multi-)Agentic LLMs☆95Updated this week
- ☆65Apr 26, 2025Updated last year
- Transparent checkpoint/restart library for CUDA application.☆12Mar 9, 2015Updated 11 years ago