Alternatives and similar repositories for lookahead-keys-attention

Users that are interested in lookahead-keys-attention are comparing it to the libraries listed below

• krafton-ai / mambaformer-icl
  MambaFormer in-context learning experiments and implementation for https://arxiv.org/abs/2402.04248
  ☆57Updated last year
• WailordHe / DenseSSM
  A repository for DenseSSMs
  ☆89Updated last year
• goombalab / hydra
  Official implementation of "Hydra: Bidirectional State Space Models Through Generalized Matrix Mixers"
  ☆161Updated 8 months ago
• fkodom / soft-mixture-of-experts
  PyTorch implementation of Soft MoE by Google Brain in "From Sparse to Soft Mixtures of Experts" (https://arxiv.org/pdf/2308.00951.pdf)
  ☆78Updated 2 years ago
• lucidrains / agent-attention-pytorch
  Implementation of Agent Attention in Pytorch
  ☆91Updated last year
• LUMIA-Group / FourierTransformer
  The official Pytorch implementation of the paper "Fourier Transformer: Fast Long Range Modeling by Removing Sequence Redundancy with FFT …
  ☆40Updated last year
• GFNOrg / GFlowNet-EM
  Code for GFlowNet-EM, a novel algorithm for fitting latent variable models with compositional latents and an intractable true posterior.
  ☆41Updated last year
• lucidrains / infini-transformer-pytorch
  Implementation of Infini-Transformer in Pytorch
  ☆113Updated 9 months ago
• Benjamin-Walker / selective-ssms-and-linear-cdes
  Code for "Theoretical Foundations of Deep Selective State-Space Models" (NeurIPS 2024)
  ☆15Updated 9 months ago
• lucidrains / gateloop-transformer
  Implementation of GateLoop Transformer in Pytorch and Jax
  ☆90Updated last year
• OpenNLPLab / HGRN2
  HGRN2: Gated Linear RNNs with State Expansion
  ☆55Updated last year
• badripatro / mamba360
  State Space Models
  ☆70Updated last year
• expz / annotated-hyena
  An annotated implementation of the Hyena Hierarchy paper
  ☆34Updated 2 years ago
• kyegomez / Griffin
  Implementation of Griffin from the paper: "Griffin: Mixing Gated Linear Recurrences with Local Attention for Efficient Language Models"
  ☆56Updated this week
• IdoAmos / not-from-scratch
  ☆33Updated last year
• PKU-ML / non_neg
  Official Code for ICLR 2024 Paper: Non-negative Contrastive Learning
  ☆46Updated last year
• annosubmission / GRC-Cache
  ☆16Updated 2 years ago
• lucidrains / scaling-vin-pytorch
  Exploration into the Scaling Value Iteration Networks paper, from Schmidhuber's group
  ☆37Updated last year
• bwconrad / soft-moe
  PyTorch implementation of "From Sparse to Soft Mixtures of Experts"
  ☆65Updated 2 years ago
• MambaMixer / M2
  ☆47Updated last year
• lucidrains / mirasol-pytorch
  Implementation of 🌻 Mirasol, SOTA Multimodal Autoregressive model out of Google Deepmind, in Pytorch
  ☆88Updated last year
• lucidrains / simplicial-attention
  Implementation of 2-simplicial attention proposed by Clift et al. (2019) and the recent attempt to make practical in Fast and Simplex, Ro…
  ☆47Updated last month
• lucidrains / quartic-transformer
  Exploring an idea where one forgets about efficiency and carries out attention across each edge of the nodes (tokens)
  ☆55Updated 7 months ago
• ethanbar11 / ssm_2d
  More dimensions = More fun
  ☆25Updated last year
• Sherrylone / Zero-CL
  ICLR 2022 paper
  ☆15Updated 3 years ago
• lucidrains / sinkhorn-router-pytorch
  Self contained pytorch implementation of a sinkhorn based router, for mixture of experts or otherwise
  ☆39Updated last year
• lucidrains / kalman-filtering-attention
  Implementation of the Kalman Filtering Attention proposed in "Kalman Filtering Attention for User Behavior Modeling in CTR Prediction"
  ☆59Updated 2 years ago
• Doraemonzzz / tnn-pytorch
  ☆19Updated 2 years ago
• thjashin / multires-conv
  Sequence Modeling with Multiresolution Convolutional Memory (ICML 2023)
  ☆127Updated 2 years ago
• lucidrains / contrastive-rl
  Contrastive Reinforcement Learning
  ☆46Updated last month