Codes & examples for "CUDA - From Correctness to Performance"
☆189Oct 24, 2024Updated 2 years ago
Alternatives and similar repositories for CUDA-From-Correctness-To-Performance-Code
Users that are interested in CUDA-From-Correctness-To-Performance-Code are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- A tiny yet powerful LLM inference system tailored for researching purpose. vLLM-equivalent performance with only 2k lines of code (2% of …☆366Jun 10, 2025Updated last year
- 北京大学未名超算队与北京大学学生 Linux 俱乐部合办的暑期 AI Infra 系列活动仓库☆258Aug 22, 2026Updated 2 months ago
- ☆17Jan 18, 2023Updated 3 years ago
- ☆11Oct 29, 2026Updated 3 weeks ago
- A cross-modal vector index with fast construction on heterogeneous CPU-GPU environment. Published on DaMoN@SIGMOD 2025.☆16Jul 16, 2025Updated last year
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- ☆13Feb 2, 2026Updated 9 months ago
- ☆18Jul 19, 2026Updated 4 months ago
- ☆23Jun 1, 2026Updated 5 months ago
- ☆15Feb 5, 2026Updated 9 months ago
- ☆37Aug 7, 2025Updated last year
- ☆27Jan 8, 2024Updated 2 years ago
- The simplest, fastest repository for training/finetuning medium-sized GPTs.☆11Nov 29, 2023Updated 2 years ago
- Xiao's CUDA Optimization Guide [NO LONGER ADDING NEW CONTENT]☆332Nov 8, 2022Updated 4 years ago
- Learning TileLang with 10 puzzles!☆401Aug 11, 2026Updated 3 months ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- A toolkit for modeling and simulation of cloud-native applications.☆16Aug 4, 2025Updated last year
- 🦙🦙.🦀☆28Sep 24, 2023Updated 3 years ago
- High performance Transformer implementation in C++.☆165Jan 18, 2025Updated last year
- An Open-source book with Modern CUDA learning Notes for Beginners - BF16/FP8/FP4, HGEMM, CuTe, Flash-Attention, etc.☆12,205Updated this week
- Materials for learning SGLang☆906Jan 5, 2026Updated 10 months ago
- A model-agnostic GPU runtime for shipping models as verified programs.☆214Updated this week
- Implement Flash Attention using Cute.☆113Dec 17, 2024Updated last year
- Examples of CUDA implementations by Cutlass CuTe☆284Jul 1, 2025Updated last year
- A scheduling framework for multitasking over diverse XPUs, including GPUs, NPUs, ASICs, and FPGAs☆14Jun 17, 2026Updated 5 months ago
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- GPTQ inference TVM kernel☆41Apr 25, 2024Updated 2 years ago
- Kernel Design Agents (KDA) is a agent-centric workflow to write high-performance CUDA Kernels.☆1,597Oct 19, 2026Updated last month
- ☆19Nov 21, 2024Updated last year
- Multiple GEMM operators are constructed with cutlass to support LLM inference.☆20Aug 3, 2025Updated last year
- FLA but cuTile☆27Apr 17, 2026Updated 7 months ago
- flash attention tutorial written in python, triton, cuda, cutlass☆542Nov 9, 2026Updated last week
- MoonEP: A Perfectly Balanced Expert Parallelism Library via Dynamic Redundant Experts☆1,215Oct 12, 2026Updated last month
- Performance of the C++ interface of flash attention and flash attention v2 in large language model (LLM) inference scenarios.☆46Feb 27, 2025Updated last year
- Efficient and easy multi-instance LLM serving☆561Mar 12, 2026Updated 8 months ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Flash Attention in ~100 lines of CUDA (forward pass only)☆1,202Dec 30, 2024Updated last year
- High performance RMSNorm Implement by using SM Core Storage(Registers and Shared Memory)☆31Jan 22, 2026Updated 9 months ago
- A cross-node expert-parallel MoE training library for computation-communication overlap.☆16Nov 13, 2026Updated last week
- Wiki fo HPC☆143Jul 23, 2025Updated last year
- A lightweight design for computation-communication overlap.☆253Jan 20, 2026Updated 9 months ago
- ☆46Oct 15, 2025Updated last year
- A compact implementation of SGLang, designed to demystify the complexities of modern LLM serving systems.☆5,614May 17, 2026Updated 6 months ago
Are these results useful?