Alternatives and similar repositories for hyena-dna:

Users that are interested in hyena-dna are comparing it to the libraries listed below

• irhum / hyena
  JAX/Flax implementation of the Hyena Hierarchy
  ☆34Updated last year
• LiibanMo / scikit-jax
  Your favourite classical machine learning algos on the GPU/TPU
  ☆20Updated 2 months ago
• okarthikb / state-space-models
  ☆27Updated 8 months ago
• lucidrains / flash-genomics-model
  My own attempt at a long context genomics model, leveraging recent advances in long context attention modeling (Flash Attention + other h…
  ☆52Updated last year
• lucidrains / frame-averaging-pytorch
  Pytorch implementation of a simple way to enable (Stochastic) Frame Averaging for any network
  ☆49Updated 8 months ago
• ekiefl / maple
  A virtual dog-sitter that tracks, classifies, and responds to dog audio.
  ☆33Updated 3 years ago
• Algomancer / VCReg
  Minimal Implimentation of VCRec (2024) for collapse provention.
  ☆16Updated 2 months ago
• expz / annotated-hyena
  An annotated implementation of the Hyena Hierarchy paper
  ☆32Updated last year
• lucidrains / genetic-algorithm-pytorch
  Toy genetic algorithm in Pytorch
  ☆33Updated this week
• lucidrains / quartic-transformer
  Exploring an idea where one forgets about efficiency and carries out attention across each edge of the nodes (tokens)
  ☆45Updated last month
• lucidrains / coordinate-descent-attention
  Implementation of an Attention layer where each head can attend to more than just one token, using coordinate descent to pick topk
  ☆46Updated last year
• joey00072 / Attention-as-graph
  alternative way to calculating self attention
  ☆18Updated 10 months ago
• EleutherAI / rnngineering
  Engineering the state of RNN language models (Mamba, RWKV, etc.)
  ☆32Updated 10 months ago
• smearle / autoverse
  Generative cellular automaton-like learning environments for RL.
  ☆19Updated last month
• colbyford / pemfauxlizumab
  Pembrolizumab-like Antibody Hallucination using AlphaFold2
  ☆16Updated last year
• kyegomez / Pairformer
  Implementation of the Pairformer model used in AlphaFold 3
  ☆12Updated last week
• opallab / positional_attention
  Source code for the paper "Positional Attention: Out-of-Distribution Generalization and Expressivity for Neural Algorithmic Reasoning"
  ☆14Updated last month
• lucidrains / GAF-microbatch-pytorch
  Implementation of Gradient Agreement Filtering, from Chaubard et al. of Stanford, but for single machine microbatches, in Pytorch
  ☆23Updated 2 months ago
• OpenBioML / project-proposal-template
  The project proposal template for OpenBioML community projects.
  ☆18Updated 2 years ago
• NousResearch / StripedHyenaTrainer
  ☆60Updated last year
• lucidrains / gateloop-transformer
  Implementation of GateLoop Transformer in Pytorch and Jax
  ☆87Updated 9 months ago
• ssokota / mec
  Code for minimum-entropy coupling.
  ☆31Updated 9 months ago
• evanatyourservice / llm-jax
  Train a SmolLM-style llm on fineweb-edu in JAX/Flax with an assortment of optimizers.
  ☆17Updated last week
• vvvm23 / TchAIkovsky
  Using JAX to generate piano music as MIDI
  ☆38Updated last year
• crowsonkb / torch-dist-utils
  Utilities for PyTorch distributed
  ☆23Updated last month
• google-deepmind / understanding_deep_generative_models_with_generalized_empirical_likelihood
  ☆34Updated last year
• patrick-kidger / esm2quinox
  An implementation of ESM2 in Equinox+JAX
  ☆25Updated last month
• lucidrains / holodeck-pytorch
  Implementation of a holodeck, written in Pytorch
  ☆17Updated last year
• AakashKumarNain / mistral_jax
  This is a port of Mistral-7B model in JAX
  ☆32Updated 8 months ago
• OpenBioML / bio-chem-lm
  ☆30Updated 2 years ago