johnryan465 / pscan
☆38Updated last year
Alternatives and similar repositories for pscan:
Users that are interested in pscan are comparing it to the libraries listed below
- Parallelizing non-linear sequential models over the sequence length☆51Updated 2 months ago
- Non official implementation of the Linear Recurrent Unit (LRU, Orvieto et al. 2023)☆52Updated 4 months ago
- ☆31Updated 11 months ago
- Parallel Associative Scan for Language Models☆18Updated last year
- ☆30Updated 3 months ago
- Experiments on the impact of depth in transformers and SSMs.☆23Updated 4 months ago
- ☆52Updated 5 months ago
- Unofficial but Efficient Implementation of "Mamba: Linear-Time Sequence Modeling with Selective State Spaces" in JAX☆83Updated last year
- ☆47Updated last year
- ☆30Updated 5 months ago
- Implementation of GateLoop Transformer in Pytorch and Jax☆87Updated 9 months ago
- Minimal but scalable implementation of large language models in JAX☆34Updated 4 months ago
- ☆16Updated 6 months ago
- A PyTorch wrapper of parallel exclusive scan in CUDA☆10Updated last year
- Efficient PScan implementation in PyTorch☆16Updated last year
- Blog post☆17Updated last year
- JAX bindings for Flash Attention v2☆87Updated 8 months ago
- Implementations of various linear RNN layers using pytorch and triton☆50Updated last year
- Experiment of using Tangent to autodiff triton☆76Updated last year
- ☆33Updated last year
- ☆51Updated 9 months ago
- Pytorch-like dataloaders for JAX.☆76Updated 5 months ago
- Accelerated First Order Parallel Associative Scan☆175Updated 6 months ago
- ☆37Updated 11 months ago
- If it quacks like a tensor...☆57Updated 4 months ago
- Implementation of PSGD optimizer in JAX☆28Updated 2 months ago
- Triton Implementation of HyperAttention Algorithm☆47Updated last year
- Einsum-like high-level array sharding API for JAX☆33Updated 8 months ago
- Codes accompanying the paper "LaProp: a Better Way to Combine Momentum with Adaptive Gradient"☆27Updated 4 years ago
- The official Languini Kitchen repository☆14Updated 10 months ago