Alternatives and similar repositories for hyena-dna

Users that are interested in hyena-dna are comparing it to the libraries listed below

• lucidrains / flash-genomics-model
  My own attempt at a long context genomics model, leveraging recent advances in long context attention modeling (Flash Attention + other h…
  ☆53Updated last year
• LiibanMo / scikit-jax
  Your favourite classical machine learning algos on the GPU/TPU
  ☆20Updated 4 months ago
• lucidrains / gateloop-transformer
  Implementation of GateLoop Transformer in Pytorch and Jax
  ☆88Updated 10 months ago
• lucidrains / coordinate-descent-attention
  Implementation of an Attention layer where each head can attend to more than just one token, using coordinate descent to pick topk
  ☆46Updated last year
• lucidrains / GAF-microbatch-pytorch
  Implementation of Gradient Agreement Filtering, from Chaubard et al. of Stanford, but for single machine microbatches, in Pytorch
  ☆25Updated 3 months ago
• lucidrains / frame-averaging-pytorch
  Pytorch implementation of a simple way to enable (Stochastic) Frame Averaging for any network
  ☆50Updated 9 months ago
• irhum / hyena
  JAX/Flax implementation of the Hyena Hierarchy
  ☆34Updated 2 years ago
• EleutherAI / rnngineering
  Engineering the state of RNN language models (Mamba, RWKV, etc.)
  ☆32Updated 11 months ago
• lucidrains / transformer-directed-evolution
  Explorations into whether a transformer with RL can direct a genetic algorithm to converge faster
  ☆68Updated 3 weeks ago
• lucidrains / holodeck-pytorch
  Implementation of a holodeck, written in Pytorch
  ☆17Updated last year
• Algomancer / VCReg
  Minimal Implimentation of VCRec (2024) for collapse provention.
  ☆16Updated 3 months ago
• NousResearch / StripedHyenaTrainer
  ☆61Updated last year
• colbyford / pemfauxlizumab
  Pembrolizumab-like Antibody Hallucination using AlphaFold2
  ☆16Updated last year
• lucidrains / tranception-pytorch
  Implementation of Tranception, an attention network, paired with retrieval, that is SOTA for protein fitness prediction
  ☆32Updated 2 years ago
• okarthikb / state-space-models
  ☆27Updated 10 months ago
• lucidrains / quartic-transformer
  Exploring an idea where one forgets about efficiency and carries out attention across each edge of the nodes (tokens)
  ☆51Updated last month
• lucidrains / genetic-algorithm-pytorch
  Toy genetic algorithm in Pytorch
  ☆51Updated 2 weeks ago
• kyegomez / MambaFormer
  Implementation of MambaFormer in Pytorch ++ Zeta from the paper: "Can Mamba Learn How to Learn? A Comparative Study on In-Context Learnin…
  ☆21Updated 3 weeks ago
• ekiefl / maple
  A virtual dog-sitter that tracks, classifies, and responds to dog audio.
  ☆36Updated 3 years ago
• opallab / positional_attention
  Source code for the paper "Positional Attention: Out-of-Distribution Generalization and Expressivity for Neural Algorithmic Reasoning"
  ☆14Updated 3 months ago
• kyegomez / Pairformer
  Implementation of the Pairformer model used in AlphaFold 3
  ☆12Updated this week
• cambridge-mlg / jolt
  ☆11Updated 3 months ago
• expz / annotated-hyena
  An annotated implementation of the Hyena Hierarchy paper
  ☆33Updated last year
• anh-tong / nanoGPT-equinox
  nanoGPT using Equinox
  ☆13Updated 2 years ago
• LumenPallidium / jepa
  Experiments in Joint Embedding Predictive Architectures (JEPAs).
  ☆40Updated last year
• evanatyourservice / llm-jax
  Train a SmolLM-style llm on fineweb-edu in JAX/Flax with an assortment of optimizers.
  ☆17Updated 2 months ago
• smearle / autoverse
  Generative cellular automaton-like learning environments for RL.
  ☆19Updated 3 months ago
• catid / dataloader
  High-performance tokenized language data-loader for Python C++ extension
  ☆13Updated 9 months ago
• bazingagin / npc_lv
  ☆8Updated last year
• joey00072 / Attention-as-graph
  alternative way to calculating self attention
  ☆18Updated 11 months ago