proger / accelerated-scanLinks
Accelerated First Order Parallel Associative Scan
☆184Updated 11 months ago
Alternatives and similar repositories for accelerated-scan
Users that are interested in accelerated-scan are comparing it to the libraries listed below
Sorting:
- JAX bindings for Flash Attention v2☆90Updated this week
- A library for unit scaling in PyTorch☆128Updated 3 weeks ago
- Understand and test language model architectures on synthetic tasks.☆221Updated 2 weeks ago
- A MAD laboratory to improve AI architecture designs 🧪☆123Updated 7 months ago
- Experiment of using Tangent to autodiff triton☆79Updated last year
- supporting pytorch FSDP for optimizers☆84Updated 7 months ago
- Code for exploring Based models from "Simple linear attention language models balance the recall-throughput tradeoff"☆238Updated last month
- ☆53Updated 9 months ago
- FlashFFTConv: Efficient Convolutions for Long Sequences with Tensor Cores☆325Updated 7 months ago
- ☆206Updated 8 months ago
- ☆113Updated last year
- Efficient optimizers☆252Updated last week
- ☆147Updated 2 years ago
- seqax = sequence modeling + JAX☆165Updated last week
- ☆40Updated last year
- FlashRNN - Fast RNN Kernels with I/O Awareness☆93Updated last month
- A simple library for scaling up JAX programs☆140Updated 9 months ago
- The simplest, fastest repository for training/finetuning medium-sized GPTs.☆149Updated last month
- ☆274Updated last year
- This repository contains the experimental PyTorch native float8 training UX☆224Updated last year
- 🧱 Modula software package☆210Updated this week
- CIFAR-10 speedruns: 94% in 2.6 seconds and 96% in 27 seconds☆274Updated 2 weeks ago
- ☆64Updated 8 months ago
- ☆82Updated last year
- Normalized Transformer (nGPT)☆185Updated 8 months ago
- LoRA for arbitrary JAX models and functions☆140Updated last year
- Triton-based implementation of Sparse Mixture of Experts.☆230Updated 8 months ago
- Griffin MQA + Hawk Linear RNN Hybrid☆88Updated last year
- ☆137Updated last week
- Implementation of Flash Attention in Jax☆215Updated last year