Alternatives and similar repositories for hyena-dna

Users that are interested in hyena-dna are comparing it to the libraries listed below

• lucidrains / flash-genomics-model
  My own attempt at a long context genomics model, leveraging recent advances in long context attention modeling (Flash Attention + other h…
  ☆55Updated 2 years ago
• LiibanMo / scikit-jax
  Your favourite classical machine learning algos on the GPU/TPU
  ☆21Updated last month
• irhum / hyena
  JAX/Flax implementation of the Hyena Hierarchy
  ☆34Updated 2 years ago
• smearle / autoverse
  Generative cellular automaton-like learning environments for RL.
  ☆20Updated last year
• lucidrains / transformer-directed-evolution
  Explorations into whether a transformer with RL can direct a genetic algorithm to converge faster
  ☆71Updated 8 months ago
• lucidrains / genetic-algorithm-pytorch
  Toy genetic algorithm in Pytorch
  ☆55Updated 9 months ago
• NousResearch / StripedHyenaTrainer
  ☆62Updated 2 years ago
• MiguelAguilera / explosive-neural-networks
  Code reproducing the results in the article Aguilera, M, Morales, PA, Rosas, FE, M & Shimazaki H (2025)
  ☆36Updated 7 months ago
• OpenBioML / project-proposal-template
  The project proposal template for OpenBioML community projects.
  ☆18Updated 2 years ago
• lucidrains / gateloop-transformer
  Implementation of GateLoop Transformer in Pytorch and Jax
  ☆92Updated last year
• lucidrains / frame-averaging-pytorch
  Pytorch implementation of a simple way to enable (Stochastic) Frame Averaging for any network
  ☆51Updated last year
• metagene-ai / metagene-pretrain
  Pretraining Code for METAGENE-1
  ☆68Updated last year
• expz / annotated-hyena
  An annotated implementation of the Hyena Hierarchy paper
  ☆34Updated 2 years ago
• ESHyperscale / nano-egg
  Evolution Pretraining Fully in Int Formats
  ☆135Updated last month
• okarthikb / state-space-models
  ☆27Updated last year
• domluna / pubmedFastRAG
  ☆33Updated 11 months ago
• ekiefl / maple
  A virtual dog-sitter that tracks, classifies, and responds to dog audio.
  ☆37Updated 3 years ago
• lucidrains / GAF-microbatch-pytorch
  Implementation of Gradient Agreement Filtering, from Chaubard et al. of Stanford, but for single machine microbatches, in Pytorch
  ☆25Updated last year
• lucidrains / coordinate-descent-attention
  Implementation of an Attention layer where each head can attend to more than just one token, using coordinate descent to pick topk
  ☆47Updated 2 years ago
• lucidrains / grokfast-pytorch
  Explorations into the proposal from the paper "Grokfast, Accelerated Grokking by Amplifying Slow Gradients"
  ☆103Updated last year
• lucidrains / holodeck-pytorch
  Implementation of a holodeck, written in Pytorch
  ☆18Updated 2 years ago
• KhoomeiK / complexity-scaling
  gzip Predicts Data-dependent Scaling Laws
  ☆34Updated last year
• Algomancer / VCReg
  Minimal Implimentation of VCRec (2024) for collapse provention.
  ☆17Updated last year
• kyegomez / MambaFormer
  Implementation of MambaFormer in Pytorch ++ Zeta from the paper: "Can Mamba Learn How to Learn? A Comparative Study on In-Context Learnin…
  ☆21Updated last week
• watcl-lab / positional_attention
  Source code for the paper "Positional Attention: Expressivity and Learnability of Algorithmic Computation"
  ☆14Updated 8 months ago
• kyegomez / Pairformer
  Implementation of the Pairformer model used in AlphaFold 3
  ☆14Updated this week
• etimush / ARC_NCA
  Repo for solving arc problems with an Neural Cellular Automata
  ☆23Updated 8 months ago
• joey00072 / Attention-as-graph
  alternative way to calculating self attention
  ☆18Updated last year
• leloykun / modded-nanogpt
  NanoGPT (124M) quality in 2.67B tokens
  ☆28Updated 4 months ago
• lucidrains / taylor-series-linear-attention
  Explorations into the recently proposed Taylor Series Linear Attention
  ☆100Updated last year