togethercomputer / stripedhyenaLinks
Repository for StripedHyena, a state-of-the-art beyond Transformer architecture
☆381Updated last year
Alternatives and similar repositories for stripedhyena
Users that are interested in stripedhyena are comparing it to the libraries listed below
Sorting:
- Pretraining infrastructure for multi-hybrid AI model architectures☆169Updated last month
- Official implementation for HyenaDNA, a long-range genomic foundation model built with Hyena☆695Updated 2 months ago
- Bi-Directional Equivariant Long-Range DNA Sequence Modeling☆192Updated last week
- Discovering Interpretable Features in Protein Language Models via Sparse Autoencoders☆181Updated 4 months ago
- 🧬 Generative modeling of regulatory DNA sequences with diffusion probabilistic models 💨☆397Updated this week
- Foundation Models for Genomics & Transcriptomics☆640Updated 2 weeks ago
- Implementation of Enformer, Deepmind's attention network for predicting gene expression, in Pytorch☆499Updated 8 months ago
- BioReason: Incentivizing Multimodal Biological Reasoning within a DNA-LLM Model☆212Updated 2 weeks ago
- My own attempt at a long context genomics model, leveraging recent advances in long context attention modeling (Flash Attention + other h…☆53Updated last year
- Inference and numerics for multi-hybrid AI model architectures☆65Updated 3 weeks ago
- Benchmarks for classification of genomic sequences☆147Updated 3 months ago
- ☆190Updated this week
- ☆61Updated last year
- Benchmarking DNA Language Models on Biologically Meaningful Tasks☆120Updated 7 months ago
- Implementation of Alpha Fold 3 from the paper: "Accurate structure prediction of biomolecular interactions with AlphaFold3" in PyTorch☆788Updated this week
- GenSLMs: Genome-scale language models reveal SARS-CoV-2 evolutionary dynamics☆129Updated 10 months ago
- Biological foundation modeling from molecular to genome scale☆1,387Updated 4 months ago
- [ICLR 2024] DNABERT-2: Efficient Foundation Model and Benchmark for Multi-Species Genome☆392Updated 6 months ago
- A collection of awesome bio-foundation models, including protein, RNA, DNA, gene, single-cell, and so on.☆230Updated last month
- ☆109Updated last month
- gReLU is a python library to train, interpret, and apply deep learning models to DNA sequences.☆264Updated this week
- Code for exploring Based models from "Simple linear attention language models balance the recall-throughput tradeoff"☆235Updated 3 weeks ago
- Implementation of the Llama architecture with RLHF + Q-learning☆165Updated 4 months ago
- ☆573Updated last year
- RNA-seq prediction with deep convolutional neural networks.☆160Updated 2 weeks ago
- Orthrus is a mature RNA model for RNA property prediction. It uses a mamba encoder backbone, a variant of state-space models specifical…☆66Updated 5 months ago
- Implementation of AlphaGenome, Deepmind's updated genomic attention model☆30Updated this week
- reasoning model trained using GRPO towards rosetta REF2015 for protein stability☆79Updated last month
- [ISMB 2025] DNABERT_S: Learning Species-Aware DNA Embedding with Genome Foundation Models☆104Updated 4 months ago
- Implementation of 💍 Ring Attention, from Liu et al. at Berkeley AI, in Pytorch☆521Updated last month