Alternatives and similar repositories for FastSoftmax:

Users that are interested in FastSoftmax are comparing it to the libraries listed below

• SzymonOzog / GPU_Programming
  ☆51Updated this week
• siboehm / ShallowSpeed
  Small scale distributed training of sequential deep learning models, built on Numpy and MPI.
  ☆130Updated last year
• gpu-mode / triton-index
  Cataloging released Triton kernels.
  ☆217Updated 3 months ago
• Deep-Learning-Profiling-Tools / triton-viz
  ☆201Updated this week
• MekkCyber / CutlassAcademy
  A curated collection of resources, tutorials, and best practices for learning and mastering NVIDIA CUTLASS
  ☆165Updated last month
• mobiusml / gemlite
  Fast low-bit matmul kernels in Triton
  ☆294Updated this week
• zinccat / Awesome-Triton-Kernels
  Collection of kernels written in Triton language
  ☆120Updated 3 weeks ago
• pranjalssh / fast.cu
  Fastest kernels written from scratch
  ☆245Updated 3 weeks ago
• cchan / tccl
  extensible collectives library in triton
  ☆85Updated 3 weeks ago
• vdesai2014 / inference-optimization-blog-post
  ☆87Updated last year
• salykova / sgemm.cu
  High-Performance SGEMM on CUDA devices
  ☆90Updated 3 months ago
• gpu-mode / profiling-cuda-in-torch
  ☆154Updated last year
• gpu-mode / discord-cluster-manager
  Write a fast kernel and run it on Discord. See how you compare against the best!
  ☆41Updated this week
• unixpickle / learn-ptx
  Learning about CUDA by writing PTX code.
  ☆128Updated last year
• cloneofsimo / ptx-tutorial-by-aislop
  PTX-Tutorial Written Purely By AIs (Deep Research of Openai and Claude 3.7)
  ☆65Updated last month
• pytorch-labs / tritonbench
  Tritonbench is a collection of PyTorch custom operators with example inputs to measure their performance.
  ☆116Updated this week
• triton-lang / kernels
  ☆78Updated 5 months ago
• bertmaher / simplegemm
  ☆98Updated last month
• MekkCyber / TritonAcademy
  A repository to unravel the language of GPUs, making their kernel conversations easy to understand
  ☆178Updated last week
• pytorch-labs / float8_experimental
  This repository contains the experimental PyTorch native float8 training UX
  ☆224Updated 8 months ago
• gpu-mode / reference-kernels
  Reference Kernels for the Leaderboard
  ☆33Updated last week
• pytorch-labs / applied-ai
  Applied AI experiments and examples for PyTorch
  ☆262Updated last month
• srush / triton-autodiff
  Experiment of using Tangent to autodiff triton
  ☆78Updated last year
• mayank31398 / cute-kernels
  A bunch of kernels that might make stuff slower 😉
  ☆34Updated this week
• gpu-mode / ring-attention
  ring-attention experiments
  ☆130Updated 6 months ago
• andylolu2 / simpleGEMM
  The simplest but fast implementation of matrix multiplication in CUDA.
  ☆34Updated 9 months ago
• gau-nernst / quantized-training
  Explore training for quantized models
  ☆18Updated 3 months ago
• linjames0 / Transformer-CUDA
  An implementation of the transformer architecture onto an Nvidia CUDA kernel
  ☆179Updated last year
• stanford-futuredata / stk
  ☆103Updated 8 months ago
• lessw2020 / triton_kernels_for_fun_and_profit
  Custom kernels in Triton language for accelerating LLMs
  ☆18Updated last year