AndPotap / einsum-search
☆29Updated 3 months ago
Alternatives and similar repositories for einsum-search:
Users that are interested in einsum-search are comparing it to the libraries listed below
- ☆50Updated 3 months ago
- Efficient PScan implementation in PyTorch☆15Updated last year
- ☆30Updated 2 months ago
- ☆31Updated 9 months ago
- The Energy Transformer block, in JAX☆54Updated last year
- Unofficial but Efficient Implementation of "Mamba: Linear-Time Sequence Modeling with Selective State Spaces" in JAX☆82Updated last year
- Triton Implementation of HyperAttention Algorithm☆46Updated last year
- Blog post☆16Updated 11 months ago
- Xmixers: A collection of SOTA efficient token/channel mixers☆12Updated 2 months ago
- Experiments on the impact of depth in transformers and SSMs.☆22Updated 2 months ago
- ☆51Updated 8 months ago
- Parallel Associative Scan for Language Models☆18Updated last year
- Source-to-Source Debuggable Derivatives in Pure Python☆15Updated last year
- Code for GFlowNet-EM, a novel algorithm for fitting latent variable models with compositional latents and an intractable true posterior.☆41Updated 11 months ago
- Code for "Accelerating Training with Neuron Interaction and Nowcasting Networks"☆17Updated 3 weeks ago
- Engineering the state of RNN language models (Mamba, RWKV, etc.)☆32Updated 8 months ago
- Official code for the paper "Attention as a Hypernetwork"☆23Updated 7 months ago
- Transformer with Mu-Parameterization, implemented in Jax/Flax. Supports FSDP on TPU pods.☆30Updated last month
- ☆24Updated 4 months ago
- ☆30Updated 11 months ago
- Here we will test various linear attention designs.☆58Updated 9 months ago
- An implementation of PSGD Kron second-order optimizer for PyTorch☆29Updated 3 weeks ago
- ☆23Updated 4 months ago
- ☆24Updated last week
- Experiment of using Tangent to autodiff triton☆74Updated last year
- Awesome Triton Resources☆19Updated last month
- ☆46Updated last year
- Meta-learning inductive biases in the form of useful conserved quantities.☆37Updated 2 years ago
- JAX implementation of "Fine-Tuning Language Models with Just Forward Passes"☆19Updated last year
- An annotated implementation of the Hyena Hierarchy paper☆32Updated last year