Alternatives and similar repositories for hyena-dna:

Users that are interested in hyena-dna are comparing it to the libraries listed below

• LiibanMo / scikit-jax
  Your favourite classical machine learning algos on the GPU/TPU
  ☆20Updated 3 months ago
• lucidrains / flash-genomics-model
  My own attempt at a long context genomics model, leveraging recent advances in long context attention modeling (Flash Attention + other h…
  ☆52Updated last year
• irhum / hyena
  JAX/Flax implementation of the Hyena Hierarchy
  ☆34Updated 2 years ago
• Algomancer / VCReg
  Minimal Implimentation of VCRec (2024) for collapse provention.
  ☆16Updated 2 months ago
• colbyford / pemfauxlizumab
  Pembrolizumab-like Antibody Hallucination using AlphaFold2
  ☆16Updated last year
• lucidrains / tranception-pytorch
  Implementation of Tranception, an attention network, paired with retrieval, that is SOTA for protein fitness prediction
  ☆31Updated 2 years ago
• kyegomez / Pairformer
  Implementation of the Pairformer model used in AlphaFold 3
  ☆12Updated this week
• lucidrains / holodeck-pytorch
  Implementation of a holodeck, written in Pytorch
  ☆17Updated last year
• lucidrains / genetic-algorithm-pytorch
  Toy genetic algorithm in Pytorch
  ☆39Updated this week
• opallab / positional_attention
  Source code for the paper "Positional Attention: Out-of-Distribution Generalization and Expressivity for Neural Algorithmic Reasoning"
  ☆14Updated 2 months ago
• lucidrains / frame-averaging-pytorch
  Pytorch implementation of a simple way to enable (Stochastic) Frame Averaging for any network
  ☆49Updated 9 months ago
• ekiefl / maple
  A virtual dog-sitter that tracks, classifies, and responds to dog audio.
  ☆35Updated 3 years ago
• smearle / autoverse
  Generative cellular automaton-like learning environments for RL.
  ☆19Updated 2 months ago
• joey00072 / Attention-as-graph
  alternative way to calculating self attention
  ☆18Updated 11 months ago
• anh-tong / nanoGPT-equinox
  nanoGPT using Equinox
  ☆13Updated 2 years ago
• catid / dataloader
  High-performance tokenized language data-loader for Python C++ extension
  ☆13Updated 9 months ago
• OpenBioML / project-proposal-template
  The project proposal template for OpenBioML community projects.
  ☆18Updated 2 years ago
• lucidrains / coordinate-descent-attention
  Implementation of an Attention layer where each head can attend to more than just one token, using coordinate descent to pick topk
  ☆46Updated last year
• google-deepmind / understanding_deep_generative_models_with_generalized_empirical_likelihood
  ☆34Updated last year
• NousResearch / StripedHyenaTrainer
  ☆61Updated last year
• lucidrains / GAF-microbatch-pytorch
  Implementation of Gradient Agreement Filtering, from Chaubard et al. of Stanford, but for single machine microbatches, in Pytorch
  ☆24Updated 3 months ago
• lucidrains / sinkhorn-router-pytorch
  Self contained pytorch implementation of a sinkhorn based router, for mixture of experts or otherwise
  ☆34Updated 7 months ago
• lucidrains / quartic-transformer
  Exploring an idea where one forgets about efficiency and carries out attention across each edge of the nodes (tokens)
  ☆50Updated last month
• okarthikb / state-space-models
  ☆27Updated 9 months ago
• lightonai / RITA
  RITA is a family of autoregressive protein models, developed by LightOn in collaboration with the OATML group at Oxford and the Debora Ma…
  ☆96Updated 2 years ago
• EleutherAI / rnngineering
  Engineering the state of RNN language models (Mamba, RWKV, etc.)
  ☆32Updated 11 months ago
• patrick-kidger / esm2quinox
  An implementation of ESM2 in Equinox+JAX
  ☆25Updated 2 months ago
• lucidrains / gateloop-transformer
  Implementation of GateLoop Transformer in Pytorch and Jax
  ☆87Updated 10 months ago
• enajx / HyperNCA
  ☆38Updated 3 years ago
• lucidrains / assoc-scan
  Associative scan package for DRYing some code between repos
  ☆11Updated this week