SzymonOzog / FastSoftmaxLinks
Step by step implementation of a fast softmax kernel in CUDA
☆60Updated last year
Alternatives and similar repositories for FastSoftmax
Users that are interested in FastSoftmax are comparing it to the libraries listed below
Sorting:
- Official Problem Sets / Reference Kernels for the GPU MODE Leaderboard!☆201Updated this week
- Cataloging released Triton kernels.☆292Updated 5 months ago
- ☆286Updated last week
- Fast low-bit matmul kernels in Triton☆427Updated last week
- High-Performance FP32 GEMM on CUDA devices☆117Updated last year
- ☆104Updated last year
- QuTLASS: CUTLASS-Powered Quantized BLAS for Deep Learning☆165Updated 2 months ago
- A curated collection of resources, tutorials, and best practices for learning and mastering NVIDIA CUTLASS☆251Updated 9 months ago
- Tritonbench is a collection of PyTorch custom operators with example inputs to measure their performance.☆324Updated last week
- ☆130Updated 3 months ago
- Learn CUDA with PyTorch☆200Updated this week
- CUDA Matrix Multiplication Optimization☆256Updated last year
- extensible collectives library in triton☆95Updated 10 months ago
- Collection of kernels written in Triton language☆178Updated 2 weeks ago
- Learning about CUDA by writing PTX code.☆152Updated last year
- ☆89Updated 3 months ago
- High-speed GEMV kernels, at most 2.7x speedup compared to pytorch baseline.☆127Updated last year
- Ship correct and fast LLM kernels to PyTorch☆140Updated 3 weeks ago
- Applied AI experiments and examples for PyTorch☆315Updated 5 months ago
- coding CUDA everyday!☆73Updated this week
- Small scale distributed training of sequential deep learning models, built on Numpy and MPI.☆155Updated 2 years ago
- TritonParse: A Compiler Tracer, Visualizer, and Reproducer for Triton Kernels☆194Updated this week
- Fastest kernels written from scratch☆532Updated 4 months ago
- Helpful kernel tutorials and examples for tile-based GPU programming☆630Updated this week
- Explore training for quantized models☆26Updated 6 months ago
- A bunch of kernels that might make stuff slower 😉☆75Updated this week
- Efficient implementation of DeepSeek Ops (Blockwise FP8 GEMM, MoE, and MLA) for AMD Instinct MI300X☆75Updated last week
- Framework to reduce autotune overhead to zero for well known deployments.☆96Updated 4 months ago
- AMD RAD's multi-GPU Triton-based framework for seamless multi-GPU programming☆168Updated this week
- ring-attention experiments☆165Updated last year