metagene-ai / metagene-pretrain
Pretraining Code for METAGENE-1
☆64Updated last month
Alternatives and similar repositories for metagene-pretrain:
Users that are interested in metagene-pretrain are comparing it to the libraries listed below
- Your favourite classical machine learning algos on the GPU/TPU☆20Updated last month
- ☆93Updated this week
- Agent framework for constructing language model agents and training on constructive tasks.☆63Updated this week
- look how they massacred my boy☆63Updated 4 months ago
- ☆37Updated 6 months ago
- Gymnasium framework for training language model agents on constructive tasks☆142Updated this week
- Discovering Interpretable Features in Protein Language Models via Sparse Autoencoders☆151Updated 3 weeks ago
- Implementation of the Pairformer model used in AlphaFold 3☆12Updated this week
- Orthrus is a mature RNA model for RNA property prediction. It uses a mamba encoder backbone, a variant of state-space models specifical…☆52Updated 3 weeks ago
- ☆47Updated 2 months ago
- ☆14Updated last month
- A nano protein structure prediction model based on DeepMind's AlphaFold paper☆24Updated 8 months ago
- This is the repository for brain state prediction using fMRI data and transformer.☆73Updated 6 months ago
- ☆60Updated last year
- ☆32Updated last month
- An example implementation of RLHF (or, more accurately, RLAIF) built on MLX and HuggingFace.☆24Updated 7 months ago
- Efficient Dictionary Learning with Switch Sparse Autoencoders (SAEs)☆20Updated 2 months ago
- ☆28Updated 7 months ago
- ☆17Updated last week
- alternative way to calculating self attention☆18Updated 8 months ago
- In this repository I have a code and brief explanations of the attempts that I made at the ARC-AGI (2024) challenges :)☆23Updated 3 months ago
- ☆40Updated 7 months ago
- gzip Predicts Data-dependent Scaling Laws☆34Updated 8 months ago
- My own attempt at a long context genomics model, leveraging recent advances in long context attention modeling (Flash Attention + other h…☆52Updated last year
- ☆28Updated last week
- Testing paligemma2 finetuning on reasoning dataset☆18Updated last month
- A short course on proteins and protein design aimed at early career students☆149Updated 7 months ago