lucidrains / hyena-dna
Fork of HyenaDNA, a long-range genomic foundation model built with Hyena
☆9Updated last year
Related projects ⓘ
Alternatives and complementary repositories for hyena-dna
- My own attempt at a long context genomics model, leveraging recent advances in long context attention modeling (Flash Attention + other h…☆52Updated last year
- Your favourite classical machine learning algos on the GPU/TPU☆20Updated 2 months ago
- A virtual dog-sitter that tracks, classifies, and responds to dog audio.☆31Updated 2 years ago
- Pembrolizumab-like Antibody Hallucination using AlphaFold2☆16Updated last year
- alternative way to calculating self attention☆18Updated 5 months ago
- JAX/Flax implementation of the Hyena Hierarchy☆31Updated last year
- Implementation of MambaFormer in Pytorch ++ Zeta from the paper: "Can Mamba Learn How to Learn? A Comparative Study on In-Context Learnin…☆21Updated last week
- Implementation of a holodeck, written in Pytorch☆17Updated last year
- Implementation of an Attention layer where each head can attend to more than just one token, using coordinate descent to pick topk☆46Updated last year
- Pytorch implementation of a simple way to enable (Stochastic) Frame Averaging for any network☆48Updated 3 months ago
- An annotated implementation of the Hyena Hierarchy paper☆31Updated last year
- The project proposal template for OpenBioML community projects.☆18Updated last year
- Implementation of the Pairformer model used in AlphaFold 3☆11Updated this week
- Generative cellular automaton-like learning environments for RL.☆19Updated last month
- Implementation of GateLoop Transformer in Pytorch and Jax☆86Updated 5 months ago
- Implementation of Tranception, an attention network, paired with retrieval, that is SOTA for protein fitness prediction☆31Updated 2 years ago
- Toy genetic algorithm in Pytorch☆29Updated 8 months ago
- AFusion: AlphaFold 3 GUI☆42Updated this week
- Discovering Interpretable Features in Protein Language Models via Sparse Autoencoders☆91Updated this week
- Engineering the state of RNN language models (Mamba, RWKV, etc.)☆32Updated 5 months ago
- ☆61Updated this week
- Code for minimum-entropy coupling.☆30Updated 4 months ago
- ☆27Updated 4 months ago
- ☆17Updated 9 months ago
- Exploring an idea where one forgets about efficiency and carries out attention across each edge of the nodes (tokens)☆43Updated last month
- ☆36Updated 3 months ago
- High-performance tokenized language data-loader for Python C++ extension☆12Updated 4 months ago