Alternatives and similar repositories for hyena-dna:

Users that are interested in hyena-dna are comparing it to the libraries listed below

• ekiefl / maple
  A virtual dog-sitter that tracks, classifies, and responds to dog audio.
  ☆32Updated 2 years ago
• lucidrains / flash-genomics-model
  My own attempt at a long context genomics model, leveraging recent advances in long context attention modeling (Flash Attention + other h…
  ☆52Updated last year
• irhum / hyena
  JAX/Flax implementation of the Hyena Hierarchy
  ☆33Updated last year
• LiibanMo / scikit-jax
  Your favourite classical machine learning algos on the GPU/TPU
  ☆20Updated last month
• lucidrains / genetic-algorithm-pytorch
  Toy genetic algorithm in Pytorch
  ☆33Updated 2 weeks ago
• lucidrains / tranception-pytorch
  Implementation of Tranception, an attention network, paired with retrieval, that is SOTA for protein fitness prediction
  ☆31Updated 2 years ago
• lucidrains / coordinate-descent-attention
  Implementation of an Attention layer where each head can attend to more than just one token, using coordinate descent to pick topk
  ☆46Updated last year
• okarthikb / state-space-models
  ☆27Updated 7 months ago
• Algomancer / VCReg
  Minimal Implimentation of VCRec (2024) for collapse provention.
  ☆16Updated 3 weeks ago
• crowsonkb / torch-dist-utils
  Utilities for PyTorch distributed
  ☆23Updated last year
• NousResearch / StripedHyenaTrainer
  ☆60Updated last year
• OpenBioML / project-proposal-template
  The project proposal template for OpenBioML community projects.
  ☆18Updated 2 years ago
• smearle / autoverse
  Generative cellular automaton-like learning environments for RL.
  ☆19Updated 3 weeks ago
• google-deepmind / understanding_deep_generative_models_with_generalized_empirical_likelihood
  ☆34Updated last year
• catid / dataloader
  High-performance tokenized language data-loader for Python C++ extension
  ☆12Updated 6 months ago
• lucidrains / gateloop-transformer
  Implementation of GateLoop Transformer in Pytorch and Jax
  ☆87Updated 8 months ago
• colbyford / pemfauxlizumab
  Pembrolizumab-like Antibody Hallucination using AlphaFold2
  ☆16Updated last year
• lucidrains / frame-averaging-pytorch
  Pytorch implementation of a simple way to enable (Stochastic) Frame Averaging for any network
  ☆49Updated 6 months ago
• lucidrains / holodeck-pytorch
  Implementation of a holodeck, written in Pytorch
  ☆17Updated last year
• kyegomez / Pairformer
  Implementation of the Pairformer model used in AlphaFold 3
  ☆12Updated this week
• lightonai / RITA
  RITA is a family of autoregressive protein models, developed by LightOn in collaboration with the OATML group at Oxford and the Debora Ma…
  ☆96Updated 2 years ago
• KhoomeiK / complexity-scaling
  gzip Predicts Data-dependent Scaling Laws
  ☆34Updated 8 months ago
• joey00072 / Attention-as-graph
  alternative way to calculating self attention
  ☆18Updated 8 months ago
• expz / annotated-hyena
  An annotated implementation of the Hyena Hierarchy paper
  ☆32Updated last year
• EleutherAI / rnngineering
  Engineering the state of RNN language models (Mamba, RWKV, etc.)
  ☆32Updated 8 months ago
• Rose-STL-Lab / Multi-Fidelity-Deep-Active-Learning
  ☆14Updated last year
• catid / spectral_ssm
  Implementation of Spectral State Space Models
  ☆16Updated 11 months ago
• evanatyourservice / llm-jax
  Train a SmolLM-style llm on fineweb-edu in JAX/Flax with an assortment of optimizers.
  ☆17Updated 2 weeks ago
• doomslide / autoloom
  ☆20Updated 3 months ago
• lucidrains / evolutionary-design-molecules
  Implementation of the algorithm detailed in paper "Evolutionary design of molecules based on deep learning and a genetic algorithm"
  ☆22Updated last year