A model-agnostic GPU runtime for shipping models as verified programs.
☆163Nov 6, 2026Updated this week
Alternatives and similar repositories for kern
Users that are interested in kern are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- OpenAI-compatible speech serving in Rust: streaming TTS and full-duplex voice over GPT-Live. 128 concurrent PersonaPlex sessions on one G…☆50Sep 30, 2026Updated last month
- Pure Rust + CUDA LLM inference engine — no PyTorch, OpenAI-compatible, serves Qwen3 to Kimi-K2☆737Updated this week
- ☆141Updated this week
- A linker for partial GPU kernels.☆47Oct 28, 2026Updated last week
- An Open Compiler Harness for Agentic GPU Programming☆194Updated this week
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- ☆11Oct 29, 2026Updated last week
- High-performance KV cache storage for LLM inference — GPU offloading, SSD caching, and cross-node sharing via RDMA. Works with vLLM and S…☆221Updated this week
- A Rust compiler backend and runtime that compiles Rust kernels to many NPU/GPU accelerators via MLIR — vendor-agnostic (Ascend, Trainium,…☆20Updated this week
- ☆1,117Updated this week
- High-performance LLM operator library built on TileLang.☆202Updated this week
- A high-performance, RDMA-native data-plane library for large-scale heterogeneous memory pools, developed by the Tencent Astral Network Te…☆35Aug 6, 2026Updated 3 months ago
- Understand your LLM before deploy☆35Updated this week
- Efficient and unified implementations for TopK-based sparse attention☆41Jul 10, 2026Updated 3 months ago
- AI infer engine☆10Jul 6, 2026Updated 4 months ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- Kernel Design Agents (KDA) is a agent-centric workflow to write high-performance CUDA Kernels.☆1,541Oct 19, 2026Updated 2 weeks ago
- ☆16Jul 19, 2026Updated 3 months ago
- Breakable CUDA graph capture for PyTorch - capture compatible regions as CUDA graphs while running incompatible operations eagerly betwee…☆30Oct 8, 2026Updated 3 weeks ago
- ☆137Updated this week
- Tile-Based Runtime for Ultra-Low-Latency LLM Inference☆1,887Sep 24, 2026Updated last month
- Production-ready MoE load balancing via real-time expert replication☆263Oct 15, 2026Updated 3 weeks ago
- TokenSpeed is a speed-of-light LLM inference engine.☆2,877Updated this week
- ☆39Updated this week
- ☆119Updated this week
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- SpecPilot: Autonomous Algorithm Discovery and Systems Optimization for Speculative Decoding☆168Updated this week
- BlitzScale Router - Distributed LLM Inference Router (Rust)☆17May 25, 2026Updated 5 months ago
- FlashSampling: Fast and Memory-Efficient Exact Sampling (https://huggingface.co/papers/2603.15854)☆90Updated this week
- ☆30Jul 30, 2026Updated 3 months ago
- NVSHMEM‑Tutorial: Build a DeepEP‑like GPU Buffer☆208Feb 11, 2026Updated 8 months ago
- ☆310Sep 5, 2026Updated 2 months ago
- ☆540Aug 26, 2026Updated 2 months ago
- Phi-Bench (Φ-Bench): 85 open-source LLM-infrastructure engineering tasks for frontier LLMs & coding agents (KFC/LH/E2E). Self-contained p…☆69Updated this week
- NVIDIA cuTile learn☆168Dec 9, 2025Updated 10 months ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- Offline optimization of your disaggregated Dynamo graph☆464Oct 29, 2026Updated last week
- Communication patterns for AI, built on top of NCCL device and host APIs☆74Updated this week
- Tile-based language built for AI computation across all scales☆196Aug 25, 2026Updated 2 months ago
- The agent flow system for token maxxing.☆385Updated this week
- Load public agent-trajectory datasets and agent traces into one ATIF-based run record☆32Updated this week
- A scalable, agentic-first, and HuggingFace-native RL framework for research (9k lines).☆1,218Updated this week
- htop-like TUI for real-time RDMA network monitoring.☆127Oct 27, 2026Updated last week