Alternatives and similar repositories for hyena-dna:

Users that are interested in hyena-dna are comparing it to the libraries listed below

• irhum / hyena
  JAX/Flax implementation of the Hyena Hierarchy
  ☆33Updated last year
• lucidrains / flash-genomics-model
  My own attempt at a long context genomics model, leveraging recent advances in long context attention modeling (Flash Attention + other h…
  ☆52Updated last year
• LiibanMo / scikit-jax
  Your favourite classical machine learning algos on the GPU/TPU
  ☆20Updated 2 weeks ago
• colbyford / pemfauxlizumab
  Pembrolizumab-like Antibody Hallucination using AlphaFold2
  ☆16Updated last year
• expz / annotated-hyena
  An annotated implementation of the Hyena Hierarchy paper
  ☆31Updated last year
• EleutherAI / rnngineering
  Engineering the state of RNN language models (Mamba, RWKV, etc.)
  ☆32Updated 7 months ago
• NousResearch / StripedHyenaTrainer
  ☆60Updated last year
• ekiefl / maple
  A virtual dog-sitter that tracks, classifies, and responds to dog audio.
  ☆32Updated 2 years ago
• lucidrains / gateloop-transformer
  Implementation of GateLoop Transformer in Pytorch and Jax
  ☆87Updated 7 months ago
• srush / drop7
  ☆18Updated 8 months ago
• KhoomeiK / complexity-scaling
  gzip Predicts Data-dependent Scaling Laws
  ☆33Updated 7 months ago
• augustwester / transformer-xl
  A lightweight PyTorch implementation of the Transformer-XL architecture proposed by Dai et al. (2019)
  ☆37Updated last year
• Algomancer / VCReg
  Minimal Implimentation of VCRec (2024) for collapse provention.
  ☆16Updated last month
• lucidrains / quartic-transformer
  Exploring an idea where one forgets about efficiency and carries out attention across each edge of the nodes (tokens)
  ☆44Updated 3 months ago
• AakashKumarNain / mistral_jax
  This is a port of Mistral-7B model in JAX
  ☆30Updated 6 months ago
• lucidrains / holodeck-pytorch
  Implementation of a holodeck, written in Pytorch
  ☆17Updated last year
• lucidrains / genetic-algorithm-pytorch
  Toy genetic algorithm in Pytorch
  ☆30Updated 10 months ago
• EleutherAI / mdl
  Minimum Description Length probing for neural network representations
  ☆18Updated last week
• lucidrains / tranception-pytorch
  Implementation of Tranception, an attention network, paired with retrieval, that is SOTA for protein fitness prediction
  ☆31Updated 2 years ago
• joey00072 / Attention-as-graph
  alternative way to calculating self attention
  ☆18Updated 7 months ago
• haileyschoelkopf / triton-index
  See https://github.com/cuda-mode/triton-index/ instead!
  ☆11Updated 8 months ago
• zacharyhorvitz / Fk-Diffusion-Steering
  A general framework for inference-time scaling and steering of diffusion models with arbitrary rewards.
  ☆40Updated this week
• lucidrains / coordinate-descent-attention
  Implementation of an Attention layer where each head can attend to more than just one token, using coordinate descent to pick topk
  ☆46Updated last year
• crowsonkb / torch-dist-utils
  Utilities for PyTorch distributed
  ☆23Updated last year
• okarthikb / state-space-models
  ☆27Updated 6 months ago
• ssokota / mec
  Code for minimum-entropy coupling.
  ☆31Updated 6 months ago
• CarperAI / treasure_trove
  ☆22Updated last year
• kyegomez / Pairformer
  Implementation of the Pairformer model used in AlphaFold 3
  ☆12Updated this week