Alternatives and similar repositories for hyena-dna

Users that are interested in hyena-dna are comparing it to the libraries listed below

• lucidrains / flash-genomics-model
  My own attempt at a long context genomics model, leveraging recent advances in long context attention modeling (Flash Attention + other h…
  ☆55Updated 2 years ago
• LiibanMo / scikit-jax
  Your favourite classical machine learning algos on the GPU/TPU
  ☆20Updated 3 weeks ago
• smearle / autoverse
  Generative cellular automaton-like learning environments for RL.
  ☆20Updated 11 months ago
• irhum / hyena
  JAX/Flax implementation of the Hyena Hierarchy
  ☆34Updated 2 years ago
• MiguelAguilera / explosive-neural-networks
  Code reproducing the results in the article Aguilera, M, Morales, PA, Rosas, FE, M & Shimazaki H (2025)
  ☆36Updated 6 months ago
• lucidrains / genetic-algorithm-pytorch
  Toy genetic algorithm in Pytorch
  ☆54Updated 8 months ago
• lucidrains / transformer-directed-evolution
  Explorations into whether a transformer with RL can direct a genetic algorithm to converge faster
  ☆71Updated 7 months ago
• NousResearch / StripedHyenaTrainer
  ☆62Updated 2 years ago
• OpenBioML / project-proposal-template
  The project proposal template for OpenBioML community projects.
  ☆18Updated 2 years ago
• Algomancer / VCReg
  Minimal Implimentation of VCRec (2024) for collapse provention.
  ☆17Updated 11 months ago
• joey00072 / Attention-as-graph
  alternative way to calculating self attention
  ☆18Updated last year
• okarthikb / state-space-models
  ☆27Updated last year
• lucidrains / coordinate-descent-attention
  Implementation of an Attention layer where each head can attend to more than just one token, using coordinate descent to pick topk
  ☆47Updated 2 years ago
• anh-tong / nanoGPT-equinox
  nanoGPT using Equinox
  ☆14Updated 2 years ago
• lucidrains / frame-averaging-pytorch
  Pytorch implementation of a simple way to enable (Stochastic) Frame Averaging for any network
  ☆51Updated last year
• expz / annotated-hyena
  An annotated implementation of the Hyena Hierarchy paper
  ☆34Updated 2 years ago
• EleutherAI / rnngineering
  Engineering the state of RNN language models (Mamba, RWKV, etc.)
  ☆32Updated last year
• lucidrains / grokfast-pytorch
  Explorations into the proposal from the paper "Grokfast, Accelerated Grokking by Amplifying Slow Gradients"
  ☆103Updated last year
• kyegomez / MambaFormer
  Implementation of MambaFormer in Pytorch ++ Zeta from the paper: "Can Mamba Learn How to Learn? A Comparative Study on In-Context Learnin…
  ☆20Updated 2 weeks ago
• lucidrains / gateloop-transformer
  Implementation of GateLoop Transformer in Pytorch and Jax
  ☆91Updated last year
• KhoomeiK / complexity-scaling
  gzip Predicts Data-dependent Scaling Laws
  ☆34Updated last year
• metagene-ai / metagene-pretrain
  Pretraining Code for METAGENE-1
  ☆68Updated last year
• kyegomez / Pairformer
  Implementation of the Pairformer model used in AlphaFold 3
  ☆14Updated last month
• google-deepmind / understanding_deep_generative_models_with_generalized_empirical_likelihood
  ☆34Updated 2 years ago
• ESHyperscale / nano-egg
  Evolution Pretraining Fully in Int Formats
  ☆135Updated 3 weeks ago
• lucidrains / GAF-microbatch-pytorch
  Implementation of Gradient Agreement Filtering, from Chaubard et al. of Stanford, but for single machine microbatches, in Pytorch
  ☆25Updated 11 months ago
• watcl-lab / positional_attention
  Source code for the paper "Positional Attention: Expressivity and Learnability of Algorithmic Computation"
  ☆14Updated 7 months ago
• andrew-silva / clean-rl-mlx
  Clean RL implementation using MLX
  ☆34Updated last year
• lucidrains / triangle-multiplicative-module
  Implementation of the Triangle Multiplicative module, used in Alphafold2 as an efficient way to mix rows or columns of a 2d feature map, …
  ☆39Updated 4 years ago
• lucidrains / quartic-transformer
  Exploring an idea where one forgets about efficiency and carries out attention across each edge of the nodes (tokens)
  ☆55Updated 9 months ago