gpu-mode / resource-stream
GPU programming related news and material links
☆1,412Updated 2 months ago
Alternatives and similar repositories for resource-stream:
Users that are interested in resource-stream are comparing it to the libraries listed below
- Puzzles for learning Triton☆1,508Updated 4 months ago
- Material for gpu-mode lectures☆4,075Updated last month
- Fast CUDA matrix multiplication from scratch☆663Updated last year
- Flash Attention in ~100 lines of CUDA (forward pass only)☆732Updated 2 months ago
- An ML Systems Onboarding list☆730Updated last month
- Tile primitives for speedy kernels☆2,153Updated this week
- What would you do with 1000 H100s...☆1,016Updated last year
- A subset of PyTorch's neural network modules, written in Python using OpenAI's Triton.☆524Updated last month
- Training materials associated with NVIDIA's CUDA Training Series (www.olcf.ornl.gov/cuda-training-series/)☆721Updated 7 months ago
- UNet diffusion model in pure CUDA☆600Updated 8 months ago
- Building blocks for foundation models.☆464Updated last year
- Minimalistic 4D-parallelism distributed training framework for education purpose☆935Updated 2 weeks ago
- PyTorch native quantization and sparsity for training and inference☆1,913Updated this week
- FlashInfer: Kernel Library for LLM Serving☆2,439Updated this week
- Mirage: Automatically Generating Fast GPU Kernels without Programming in Triton/CUDA☆769Updated this week
- ☆139Updated 7 months ago
- ☆149Updated last year
- A library for accelerating Transformer models on NVIDIA GPUs, including using 8-bit floating point (FP8) precision on Hopper and Ada GPUs…☆2,293Updated this week
- Make PyTorch models up to 40% faster! Thunder is a source to source compiler for PyTorch. It enables using different hardware executors a…☆1,310Updated this week
- A curated list of resources for learning and exploring Triton, OpenAI's programming language for writing efficient GPU code.☆306Updated last week
- Learn CUDA Programming, published by Packt☆1,120Updated last year
- Slides, notes, and materials for the workshop☆320Updated 9 months ago
- Cataloging released Triton kernels.☆204Updated 2 months ago
- CUDA Learning guide☆340Updated 9 months ago
- Pipeline Parallelism for PyTorch☆757Updated 7 months ago
- Minimalistic large language model 3D-parallelism training☆1,701Updated this week
- This is a series of GPU optimization topics. Here we will introduce how to optimize the CUDA kernel in detail. I will introduce several…☆960Updated last year
- An open-source efficient deep learning framework/compiler, written in python.☆691Updated 3 weeks ago