togethercomputer / stripedhyena
Repository for StripedHyena, a state-of-the-art beyond Transformer architecture
☆369Updated last year
Alternatives and similar repositories for stripedhyena:
Users that are interested in stripedhyena are comparing it to the libraries listed below
- Pretraining infrastructure for multi-hybrid AI model architectures☆154Updated 2 weeks ago
- Official implementation for HyenaDNA, a long-range genomic foundation model built with Hyena☆673Updated 2 weeks ago
- Bi-Directional Equivariant Long-Range DNA Sequence Modeling☆187Updated 3 months ago
- Discovering Interpretable Features in Protein Language Models via Sparse Autoencoders☆170Updated 3 months ago
- Implementation of Enformer, Deepmind's attention network for predicting gene expression, in Pytorch☆482Updated 7 months ago
- 🧬 Generative modeling of regulatory DNA sequences with diffusion probabilistic models 💨☆389Updated this week
- My own attempt at a long context genomics model, leveraging recent advances in long context attention modeling (Flash Attention + other h…☆52Updated last year
- 🧬 Nucleotide Transformer: Building and Evaluating Robust Foundation Models for Human Genomics☆604Updated 3 weeks ago
- Benchmarking DNA Language Models on Biologically Meaningful Tasks☆114Updated 6 months ago
- Benchmarks for classification of genomic sequences☆142Updated last month
- [ICLR 2024] DNABERT-2: Efficient Foundation Model and Benchmark for Multi-Species Genome☆372Updated 4 months ago
- Biological foundation modeling from molecular to genome scale☆1,368Updated 2 months ago
- Gymnasium framework for training language model agents on constructive tasks☆162Updated 3 weeks ago
- A MAD laboratory to improve AI architecture designs 🧪☆114Updated 4 months ago
- Implementation of Alpha Fold 3 from the paper: "Accurate structure prediction of biomolecular interactions with AlphaFold3" in PyTorch☆784Updated 2 weeks ago
- gReLU is a python library to train, interpret, and apply deep learning models to DNA sequences.☆263Updated 3 weeks ago
- GenSLMs: Genome-scale language models reveal SARS-CoV-2 evolutionary dynamics☆128Updated 8 months ago
- RNA-seq prediction with deep convolutional neural networks.☆146Updated last month
- ☆61Updated last year
- Orthrus is a mature RNA model for RNA property prediction. It uses a mamba encoder backbone, a variant of state-space models specifical…☆62Updated 3 months ago
- AI-Driven Digital Organism (AIDO) is a system of multiscale foundation models for predicting, simulating and programming biology at all l…☆85Updated 4 months ago
- Generation of protein sequences and evolutionary alignments via discrete diffusion models☆590Updated 3 months ago
- Ankh: Optimized Protein Language Model☆222Updated last year
- Official repository for the ProteinGym benchmarks☆300Updated last week
- ☆567Updated last year
- ☆187Updated this week
- Inference and numerics for multi-hybrid AI model architectures☆56Updated last week
- reasoning model trained using GRPO towards rosetta REF2015 for protein stability☆65Updated last week
- Official release of the ProGen models☆648Updated last year
- Repository for mRNA Paper and CodonBERT publication.☆128Updated 10 months ago