johnryan465 / pscan
☆36Updated 10 months ago
Related projects ⓘ
Alternatives and complementary repositories for pscan
- Unofficial but Efficient Implementation of "Mamba: Linear-Time Sequence Modeling with Selective State Spaces" in JAX☆78Updated 9 months ago
- ☆29Updated last month
- ☆46Updated last month
- ☆27Updated 6 months ago
- Pytorch-like dataloaders in JAX.☆59Updated 3 weeks ago
- Parallelizing non-linear sequential models over the sequence length☆44Updated last week
- Implementation of GateLoop Transformer in Pytorch and Jax☆86Updated 4 months ago
- Parallel Associative Scan for Language Models☆18Updated 10 months ago
- A simple library for scaling up JAX programs☆125Updated last week
- ☆45Updated 9 months ago
- Experiment of using Tangent to autodiff triton☆71Updated 9 months ago
- Non official implementation of the Linear Recurrent Unit (LRU, Orvieto et al. 2023)☆48Updated this week
- If it quacks like a tensor...☆52Updated 8 months ago
- Lightning-like training API for JAX with Flax☆32Updated 6 months ago
- JAX bindings for Flash Attention v2☆79Updated 3 months ago
- A State-Space Model with Rational Transfer Function Representation.☆70Updated 5 months ago
- Transformer with Mu-Parameterization, implemented in Jax/Flax. Supports FSDP on TPU pods.☆29Updated last week
- ☆53Updated 9 months ago
- flexible meta-learning in jax☆12Updated last year
- Accelerated First Order Parallel Associative Scan☆162Updated 2 months ago
- Efficient PScan implementation in PyTorch☆15Updated 10 months ago
- LoRA for arbitrary JAX models and functions☆131Updated 8 months ago
- Blog post☆16Updated 8 months ago
- A MAD laboratory to improve AI architecture designs 🧪☆95Updated 6 months ago
- Automatically take good care of your preemptible TPUs☆31Updated last year
- ☆116Updated this week
- ☆16Updated 2 months ago
- Code implementing "Efficient Parallelization of a Ubiquitious Sequential Computation" (Heinsen, 2023)☆85Updated 10 months ago
- Fast Discounted Cumulative Sums in PyTorch☆95Updated 3 years ago
- ☆50Updated 5 months ago