GPU programming related news and material links
☆2,047Mar 8, 2026Updated last week
Alternatives and similar repositories for resource-stream
Users that are interested in resource-stream are comparing it to the libraries listed below
Sorting:
- Material for gpu-mode lectures☆5,841Feb 1, 2026Updated last month
- An ML Systems Onboarding list☆1,008Feb 19, 2026Updated last month
- Tile primitives for speedy kernels☆3,232Updated this week
- ☆176Feb 3, 2024Updated 2 years ago
- Cataloging released Triton kernels.☆298Sep 9, 2025Updated 6 months ago
- Puzzles for learning Triton☆2,336Updated this week
- CUDA Templates and Python DSLs for High-Performance Linear Algebra☆9,442Updated this week
- Fast CUDA matrix multiplication from scratch☆1,088Sep 2, 2025Updated 6 months ago
- FlashInfer: Kernel Library for LLM Serving☆5,145Updated this week
- Machine Learning Engineering Open Book☆17,440Updated this week
- PyTorch native quantization and sparsity for training and inference☆2,730Updated this week
- Development repository for the Triton language and compiler☆18,656Updated this week
- how to optimize some algorithm in cuda.☆2,872Updated this week
- A subset of PyTorch's neural network modules, written in Python using OpenAI's Triton.☆598Aug 12, 2025Updated 7 months ago
- A PyTorch native platform for training generative AI models☆5,139Mar 13, 2026Updated last week
- ☆261Jul 11, 2024Updated last year
- Efficient Triton Kernels for LLM Training☆6,216Updated this week
- What would you do with 1000 H100s...☆1,161Jan 10, 2024Updated 2 years ago
- Building blocks for foundation models.☆612Jan 3, 2024Updated 2 years ago
- ☆307Updated this week
- Solve puzzles. Learn CUDA.☆11,997Sep 1, 2024Updated last year
- Flash Attention in ~100 lines of CUDA (forward pass only)☆1,092Dec 30, 2024Updated last year
- 🚀 Efficient implementations of state-of-the-art linear attention models☆4,630Updated this week
- Experiment of using Tangent to autodiff triton☆82Jan 22, 2024Updated 2 years ago
- A library for accelerating Transformer models on NVIDIA GPUs, including using 8-bit and 4-bit floating point (FP8 and FP4) precision on H…☆3,211Updated this week
- Simple and efficient pytorch-native transformer text generation in <1000 LOC of python.☆6,188Aug 22, 2025Updated 6 months ago
- Fast and memory-efficient exact attention☆22,832Updated this week
- Parallel Associative Scan for Language Models☆18Jan 8, 2024Updated 2 years ago
- 📚LeetCUDA: Modern CUDA Learn Notes with PyTorch for Beginners🐑, 200+ CUDA Kernels, Tensor Cores, HGEMM, FA-2 MMA.🎉☆9,932Updated this week
- Applied AI experiments and examples for PyTorch☆319Aug 22, 2025Updated 6 months ago
- Distributed Compiler based on Triton for Parallel Systems☆1,386Mar 11, 2026Updated last week
- Domain-specific language designed to streamline the development of high-performance GPU/CPU/Accelerators kernels☆5,364Mar 13, 2026Updated last week
- Minimalistic large language model 3D-parallelism training☆2,609Feb 19, 2026Updated last month
- ring-attention experiments☆168Oct 17, 2024Updated last year
- LLM training in simple, raw C/CUDA☆29,143Jun 26, 2025Updated 8 months ago
- flash attention tutorial written in python, triton, cuda, cutlass☆491Jan 20, 2026Updated 2 months ago
- Mirage Persistent Kernel: Compiling LLMs into a MegaKernel☆2,156Mar 12, 2026Updated last week
- Training materials associated with NVIDIA's CUDA Training Series (www.olcf.ornl.gov/cuda-training-series/)☆947Aug 19, 2024Updated last year
- Minimalistic 4D-parallelism distributed training framework for education purpose☆2,116Aug 26, 2025Updated 6 months ago