SzymonOzog / GPU_Programming
☆42Updated 2 weeks ago
Alternatives and similar repositories for GPU_Programming:
Users that are interested in GPU_Programming are comparing it to the libraries listed below
- ☆28Updated 2 months ago
- ☆151Updated last year
- Small scale distributed training of sequential deep learning models, built on Numpy and MPI.☆126Updated last year
- Cataloging released Triton kernels.☆204Updated 2 months ago
- A curated list of resources for learning and exploring Triton, OpenAI's programming language for writing efficient GPU code.☆306Updated last week
- High-Performance SGEMM on CUDA devices☆86Updated 2 months ago
- Learning about CUDA by writing PTX code.☆124Updated last year
- An implementation of the transformer architecture onto an Nvidia CUDA kernel☆174Updated last year
- Fast low-bit matmul kernels in Triton☆267Updated this week
- ☆191Updated this week
- A subset of PyTorch's neural network modules, written in Python using OpenAI's Triton.☆524Updated last month
- Collection of kernels written in Triton language☆114Updated last month
- Mixed precision training from scratch with Tensors and CUDA☆21Updated 10 months ago
- Fastest kernels written from scratch☆199Updated 2 weeks ago
- Applied AI experiments and examples for PyTorch☆249Updated this week
- KernelBench: Can LLMs Write GPU Kernels? - Benchmark with Torch -> CUDA problems☆234Updated this week
- Write a fast kernel and run it on Discord. See how you compare against the best!☆34Updated this week
- ☆136Updated 2 months ago
- LLM training in simple, raw C/CUDA☆92Updated 10 months ago
- Fast Matrix Multiplications for Lookup Table-Quantized LLMs☆232Updated last month
- Solve puzzles. Learn CUDA.☆63Updated last year
- ring-attention experiments☆127Updated 5 months ago
- extensible collectives library in triton☆84Updated 6 months ago
- Recreating PyTorch from scratch (C/C++, CUDA, NCCL and Python, with multi-GPU support and automatic differentiation!)☆145Updated 9 months ago
- ☆67Updated last year
- ☆86Updated last year
- This repository contains the experimental PyTorch native float8 training UX☆222Updated 7 months ago
- CUDA Matrix Multiplication Optimization☆173Updated 8 months ago