srush / triton-autodiffLinks
Experiment of using Tangent to autodiff triton
☆79Updated last year
Alternatives and similar repositories for triton-autodiff
Users that are interested in triton-autodiff are comparing it to the libraries listed below
Sorting:
- ☆78Updated 11 months ago
- A library for unit scaling in PyTorch☆125Updated 6 months ago
- Demo of the unit_scaling library, showing how a model can be easily adapted to train in FP8.☆45Updated 11 months ago
- ☆108Updated last year
- Make triton easier☆46Updated last year
- A simple library for scaling up JAX programs☆139Updated 7 months ago
- A place to store reusable transformer components of my own creation or found on the interwebs☆56Updated this week
- Minimal but scalable implementation of large language models in JAX☆35Updated 7 months ago
- Triton Implementation of HyperAttention Algorithm☆48Updated last year
- The simplest implementation of recent Sparse Attention patterns for efficient LLM inference.☆70Updated last week
- An implementation of the Llama architecture, to instruct and delight☆21Updated 3 weeks ago
- train with kittens!☆59Updated 7 months ago
- supporting pytorch FSDP for optimizers☆82Updated 6 months ago
- Accelerated First Order Parallel Associative Scan☆182Updated 10 months ago
- seqax = sequence modeling + JAX☆159Updated last week
- JAX bindings for Flash Attention v2☆89Updated 11 months ago
- PyTorch centric eager mode debugger☆47Updated 6 months ago
- ☆21Updated 3 months ago
- CUDA implementation of autoregressive linear attention, with all the latest research findings☆44Updated 2 years ago
- ☆53Updated last year
- Learn CUDA with PyTorch☆25Updated 2 weeks ago
- If it quacks like a tensor...☆58Updated 7 months ago
- ☆37Updated last year
- FlexAttention w/ FlashAttention3 Support☆26Updated 8 months ago
- Triton-based implementation of Sparse Mixture of Experts.☆219Updated 6 months ago
- ☆53Updated 8 months ago
- Personal solutions to the Triton Puzzles☆19Updated 11 months ago
- Write a fast kernel and run it on Discord. See how you compare against the best!☆46Updated this week
- JAX implementation of the Mistral 7b v0.2 model☆35Updated 11 months ago
- Understand and test language model architectures on synthetic tasks.☆217Updated 2 weeks ago