lessw2020 / triton_kernels_for_fun_and_profitLinks
Custom kernels in Triton language for accelerating LLMs
☆23Updated last year
Alternatives and similar repositories for triton_kernels_for_fun_and_profit
Users that are interested in triton_kernels_for_fun_and_profit are comparing it to the libraries listed below
Sorting:
- Small scale distributed training of sequential deep learning models, built on Numpy and MPI.☆137Updated last year
- Cataloging released Triton kernels.☆247Updated 6 months ago
- ☆227Updated this week
- Write a fast kernel and run it on Discord. See how you compare against the best!☆48Updated this week
- ring-attention experiments☆146Updated 9 months ago
- Learn CUDA with PyTorch☆33Updated 2 weeks ago
- Fast low-bit matmul kernels in Triton☆339Updated this week
- Collection of kernels written in Triton language☆142Updated 4 months ago
- ☆162Updated last year
- A bunch of kernels that might make stuff slower 😉☆56Updated last week
- A repository to unravel the language of GPUs, making their kernel conversations easy to understand☆188Updated 2 months ago
- PTX-Tutorial Written Purely By AIs (Deep Research of Openai and Claude 3.7)☆66Updated 4 months ago
- This repository contains the experimental PyTorch native float8 training UX☆224Updated last year
- Applied AI experiments and examples for PyTorch☆289Updated 2 months ago
- A curated collection of resources, tutorials, and best practices for learning and mastering NVIDIA CUTLASS☆205Updated 3 months ago
- extensible collectives library in triton☆88Updated 4 months ago
- a minimal cache manager for PagedAttention, on top of llama3.☆110Updated 11 months ago
- Experiment of using Tangent to autodiff triton☆80Updated last year
- The simplest but fast implementation of matrix multiplication in CUDA.☆37Updated last year
- 🚀 Collection of components for development, training, tuning, and inference of foundation models leveraging PyTorch native components.☆206Updated last week
- Custom triton kernels for training Karpathy's nanoGPT.☆19Updated 9 months ago
- ☆28Updated 6 months ago
- LLM training in simple, raw C/CUDA☆102Updated last year
- High-Performance SGEMM on CUDA devices☆98Updated 6 months ago
- Learning about CUDA by writing PTX code.☆133Updated last year
- Official Problem Sets / Reference Kernels for the GPU MODE Leaderboard!☆69Updated 3 weeks ago
- An extension of the nanoGPT repository for training small MOE models.☆164Updated 4 months ago
- A subset of PyTorch's neural network modules, written in Python using OpenAI's Triton.☆565Updated last week
- Personal solutions to the Triton Puzzles☆19Updated last year
- ☆83Updated last year