W4A16 MoE GEMM CUDA kernel. Tuned for H200, B200 & B300.
☆14Oct 30, 2026Updated 2 weeks ago
Alternatives and similar repositories for chord
Users that are interested in chord are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆11Oct 29, 2026Updated 2 weeks ago
- ☆12Nov 21, 2025Updated 11 months ago
- A lightweight CuTe-based CUDA kernel for DuoAttention, optimized for large language model inference.☆12Dec 25, 2025Updated 10 months ago
- PegaFlow is a high-performance KV cache offloading solution for vLLM v1 on single-node multi-GPU setups.☆25Jan 7, 2026Updated 10 months ago
- BlitzScale Router - Distributed LLM Inference Router (Rust)☆18May 25, 2026Updated 5 months ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Code repository for the SOSP'25 paper DCP: Addressing Input Dynamism In Long-Context Training via Dynamic Context Parallelism.☆23Nov 28, 2025Updated 11 months ago
- Code and reproducibility artifacts for reconstructing megakernel persistence with CUDA PDL☆27Aug 5, 2026Updated 3 months ago
- Mini-SGLang is a mini version of SGLang project ().☆13Sep 24, 2025Updated last year
- Reliable Sandbox for Agent, with agent-aware Checkpoint and Restore ability.☆15Aug 31, 2026Updated 2 months ago
- A resume template written in typst, designed for zh_CN.☆13Mar 3, 2025Updated last year
- Quantization-Aware Training for NVFP4 Reasoning Models☆14Jul 10, 2026Updated 4 months ago
- DeepGEMM: clean and efficient FP8 GEMM kernels with fine-grained scaling☆47Updated this week
- Sample Codes using NVSHMEM on Multi-GPU☆30Jan 22, 2023Updated 3 years ago
- Rust bindings for the [3FS USRBIO API](https://github.com/deepseek-ai/3FS/blob/main/src/lib/api/UsrbIo.md).☆11Nov 4, 2026Updated last week
- Simple, predictable pricing with DigitalOcean hosting • AdAlways know what you'll pay with monthly caps and flat pricing. Enterprise-grade infrastructure trusted by 600k+ customers.
- ☆18Jul 19, 2026Updated 3 months ago
- The repository for ATC'25 paper "Greyhound: Hunting Fail-Slows in Hybrid-Parallel Training at Scale"☆19Sep 7, 2026Updated 2 months ago
- Some funny cute/cuteDSL code snippets☆35Mar 2, 2026Updated 8 months ago
- CuteDSL Swizzle Visualize Tool☆14Feb 22, 2026Updated 8 months ago
- GPU Functional Descriptor for memory access☆36May 24, 2026Updated 5 months ago
- LLM Kernel Library for Rust☆32Oct 30, 2026Updated 2 weeks ago
- High-performance Rust benchmark client for vLLM serving endpoints.☆53Aug 3, 2026Updated 3 months ago
- NCCL communication API layer, and transport layer created from first principles.☆16Aug 20, 2025Updated last year
- CroissAttn: FP4 attention forward and backward, with analysis of stochastic rounding, zero-sum softmax gradients, and sampled centering.☆16Oct 25, 2026Updated 2 weeks ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- a size profiler for cuda binary☆74Oct 3, 2026Updated last month
- [NSDI'26] PolyRL is a reinforcement learning framework for LLM that harvest spot instances on the cloud to reduce cost.☆20Mar 30, 2026Updated 7 months ago
- ☆54May 19, 2025Updated last year
- ☆19May 9, 2025Updated last year
- ☆46Oct 15, 2025Updated last year
- Tools for generating TPC-* datasets☆33Jun 23, 2024Updated 2 years ago
- Make FP4 on 5090 Great Again☆24Jul 20, 2026Updated 3 months ago
- pretrain experiments☆14Updated this week
- Custom trained GRACE-OFFF models☆12Nov 4, 2026Updated last week
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- A Triton-only attention backend for vLLM☆28Jul 14, 2026Updated 3 months ago
- [ASPLOS' 26] TetriServe: Efficiently Serving Mixed DiT Workloads☆20Mar 12, 2026Updated 8 months ago
- Surgical GPU kernel benchmark: 7 hard problems, frontier coding agents, roofline-graded against hardware peak.☆19Jun 12, 2026Updated 5 months ago
- A high-performance, RDMA-native data-plane library for large-scale heterogeneous memory pools, developed by the Tencent Astral Network Te…☆35Aug 6, 2026Updated 3 months ago
- Frontier: A Discrete-Event Simulator for Modern LLM Serving☆180Updated this week
- An optimized Merkle Patricia Trie implementation on GPU, fully compatible with and integrable into Ethereum. The paper is published on VL…☆14Apr 15, 2024Updated 2 years ago
- High performance RMSNorm Implement by using SM Core Storage(Registers and Shared Memory)☆31Jan 22, 2026Updated 9 months ago
Are these results useful?