Alternatives and similar repositories for triton-autodiff

Users that are interested in triton-autodiff are comparing it to the libraries listed below

• srush / tangent

  View on GitHub
  Source-to-Source Debuggable Derivatives in Pure Python
  ☆15Jan 23, 2024Updated 2 years ago
• HazyResearch / train-tk

  View on GitHub
  train with kittens!
  ☆63Oct 25, 2024Updated last year
• srush / mamba-scans

  View on GitHub
  Blog post
  ☆17Feb 16, 2024Updated 2 years ago
• ethansmith2000 / TransformerExperiments

  View on GitHub
  ☆19Dec 4, 2025Updated 2 months ago
• glassroom / heinsen_attention

  View on GitHub
  Reference implementation of "Softmax Attention with Constant Cost per Token" (Heinsen, 2024)
  ☆24Jun 6, 2024Updated last year
• yikangshen / megablocks

  View on GitHub
  ☆20May 30, 2024Updated last year
• sustcsonglin / mamba-triton

  View on GitHub
  ☆51Jan 28, 2024Updated 2 years ago
• maximzubkov / fft-scan

  View on GitHub
  Efficient PScan implementation in PyTorch
  ☆17Jan 2, 2024Updated 2 years ago
• GindaChen / FlexFlashAttention3

  View on GitHub
  FlexAttention w/ FlashAttention3 Support
  ☆27Oct 5, 2024Updated last year
• fw-ai / llama-cuda-graph-example

  View on GitHub
  Example of applying CUDA graphs to LLaMA-v2
  ☆12Aug 25, 2023Updated 2 years ago
• mgmalek / efficient_cross_entropy

  View on GitHub
  ☆124May 28, 2024Updated last year
• BobMcDear / attorch

  View on GitHub
  A subset of PyTorch's neural network modules, written in Python using OpenAI's Triton.
  ☆596Aug 12, 2025Updated 6 months ago
• Aleph-Alpha-Research / NeurIPS-WANT-submission-efficient-parallelization-layouts

  View on GitHub
  ☆22Dec 15, 2023Updated 2 years ago
• AlirezaMorsali / MLP-Attention

  View on GitHub
  ☆16Dec 19, 2024Updated last year
• srush / LLM-Talk

  View on GitHub
  ☆53Jan 30, 2024Updated 2 years ago
• renll / SeqBoat

  View on GitHub
  [NeurIPS 2023] Sparse Modular Activation for Efficient Sequence Modeling
  ☆40Dec 2, 2023Updated 2 years ago
• srush / anynp

  View on GitHub
  Proof-of-concept of global switching between numpy/jax/pytorch in a library.
  ☆18Jun 18, 2024Updated last year
• proger / nanokitchen

  View on GitHub
  Parallel Associative Scan for Language Models
  ☆18Jan 8, 2024Updated 2 years ago
• habanero-lab / APPy

  View on GitHub
  APPy (Annotated Parallelism for Python) enables users to annotate loops and tensor expressions in Python with compiler directives akin to…
  ☆30Jan 28, 2026Updated 2 weeks ago
• srush / mamba-primer

  View on GitHub
  ☆39Apr 5, 2024Updated last year
• stanford-futuredata / stk

  View on GitHub
  ☆115Aug 26, 2024Updated last year
• EleutherAI / rnngineering

  View on GitHub
  Engineering the state of RNN language models (Mamba, RWKV, etc.)
  ☆32May 25, 2024Updated last year
• Edward-Sun / gpt-accelera

  View on GitHub
  Simple and efficient pytorch-native transformer training and inference (batched)
  ☆79Apr 2, 2024Updated last year
• subho406 / agalite

  View on GitHub
  AGaLiTe: Approximate Gated Linear Transformers for Online Reinforcement Learning (Published in TMLR)
  ☆23Oct 15, 2024Updated last year
• ptillet / triton-llvm-releases

  View on GitHub
  ☆20Oct 11, 2023Updated 2 years ago
• Deep-Learning-Profiling-Tools / triton-viz

  View on GitHub
  ☆288Updated this week
• sjelassi / transformers_ssm_copy

  View on GitHub
  ☆35Feb 26, 2024Updated last year
• Doraemonzzz / nanoTransNormer

  View on GitHub
  ☆11Oct 11, 2023Updated 2 years ago
• iesl / s-diora

  View on GitHub
  ☆12Jan 29, 2021Updated 5 years ago
• jbaron34 / torchwindow

  View on GitHub
  Display tensors directly from GPU
  ☆11Oct 12, 2025Updated 4 months ago
• Noahs-ARK / PaLM

  View on GitHub
  PyTorch implementation for PaLM: A Hybrid Parser and Language Model.
  ☆10Jan 7, 2020Updated 6 years ago
• rycolab / aflt-f2023

  View on GitHub
  Advanced Formal Language Theory (263-5352-00L; Frühjahr 2023)
  ☆10Feb 21, 2023Updated 2 years ago
• haileyschoelkopf / triton-index

  View on GitHub
  See https://github.com/cuda-mode/triton-index/ instead!
  ☆11May 8, 2024Updated last year
• srush / annotated-mamba

  View on GitHub
  Annotated version of the Mamba paper
  ☆496Feb 27, 2024Updated last year
• proger / accelerated-scan

  View on GitHub
  Accelerated First Order Parallel Associative Scan
  ☆196Jan 7, 2026Updated last month
• HazyResearch / zoology

  View on GitHub
  Understand and test language model architectures on synthetic tasks.
  ☆252Jan 12, 2026Updated last month
• bdusell / stack-attention

  View on GitHub
  Code for the paper "Stack Attention: Improving the Ability of Transformers to Model Hierarchical Patterns"
  ☆18Mar 15, 2024Updated last year
• samblouir / birdie

  View on GitHub
  ☆13Dec 15, 2025Updated 2 months ago
• test-time-training / ttt-tk

  View on GitHub
  ☆44Nov 1, 2025Updated 3 months ago