lessw2020 / triton_kernels_for_fun_and_profit
Custom kernels in Triton language for accelerating LLMs
☆17Updated 10 months ago
Alternatives and similar repositories for triton_kernels_for_fun_and_profit:
Users that are interested in triton_kernels_for_fun_and_profit are comparing it to the libraries listed below
- Write a fast kernel and run it on Discord. See how you compare against the best!☆17Updated this week
- Learn CUDA with PyTorch☆16Updated 2 weeks ago
- Cataloging released Triton kernels.☆164Updated last month
- Fast low-bit matmul kernels in Triton☆231Updated this week
- ☆175Updated this week
- Small scale distributed training of sequential deep learning models, built on Numpy and MPI.☆117Updated last year
- Make triton easier☆43Updated 8 months ago
- extensible collectives library in triton☆82Updated 4 months ago
- Experiment of using Tangent to autodiff triton☆75Updated last year
- A place to store reusable transformer components of my own creation or found on the interwebs☆44Updated this week
- Collection of kernels written in Triton language☆97Updated this week
- ring-attention experiments☆123Updated 3 months ago
- ☆21Updated 3 months ago
- Applied AI experiments and examples for PyTorch☆223Updated this week
- LLM training in simple, raw C/CUDA☆91Updated 9 months ago
- Learning about CUDA by writing PTX code.☆35Updated 11 months ago
- Demo of the unit_scaling library, showing how a model can be easily adapted to train in FP8.☆43Updated 6 months ago
- ☆141Updated last year
- This repository contains the experimental PyTorch native float8 training UX☆221Updated 6 months ago
- Google TPU optimizations for transformers models☆96Updated 3 weeks ago
- ☆67Updated 3 months ago
- This is a port of Mistral-7B model in JAX☆31Updated 7 months ago
- KernelBench: Can LLMs Write GPU Kernels? - Benchmark with Torch -> CUDA problems☆166Updated this week
- ☆45Updated last year
- High-Performance SGEMM on CUDA devices☆73Updated 3 weeks ago
- ☆86Updated 11 months ago
- ☆75Updated 7 months ago
- Tritonbench is a collection of PyTorch custom operators with example inputs to measure their performance.☆86Updated this week
- train with kittens!☆53Updated 3 months ago