metagene-ai / metagene-pretrain
Pretraining Code for METAGENE-1
☆57Updated last week
Alternatives and similar repositories for metagene-pretrain:
Users that are interested in metagene-pretrain are comparing it to the libraries listed below
- Agent framework for constructing language model agents and training on constructive tasks.☆45Updated this week
- ☆69Updated this week
- ☆37Updated 5 months ago
- This repository contains a fork from "language-models-trajectory-generators", the goal is to test the same functionality with Mistrals LL…☆20Updated 3 months ago
- Your favourite classical machine learning algos on the GPU/TPU☆20Updated 2 weeks ago
- Implementation of the Pairformer model used in AlphaFold 3☆12Updated this week
- A general framework for inference-time scaling and steering of diffusion models with arbitrary rewards.☆40Updated this week
- look how they massacred my boy☆63Updated 3 months ago
- ☆17Updated 3 months ago
- Source code for the paper "Positional Attention: Out-of-Distribution Generalization and Expressivity for Neural Algorithmic Reasoning"☆14Updated this week
- ☆60Updated last year
- [EMNLP 2024] Tree of Problems: Improving structured problem solving with compositionality☆19Updated 3 months ago
- Efficient Dictionary Learning with Switch Sparse Autoencoders (SAEs)☆16Updated last month
- alternative way to calculating self attention☆18Updated 7 months ago
- ☆46Updated last month
- A nano protein structure prediction model based on DeepMind's AlphaFold paper☆24Updated 7 months ago
- ☆18Updated last month
- ☆11Updated last week
- This is the repository for brain state prediction using fMRI data and transformer.☆30Updated 5 months ago
- Official implementation of "BERTs are Generative In-Context Learners"☆23Updated 7 months ago
- Rust Implementation of micrograd☆51Updated 6 months ago
- ☆27Updated 6 months ago
- Discovering Interpretable Features in Protein Language Models via Sparse Autoencoders☆140Updated last month
- gzip Predicts Data-dependent Scaling Laws☆33Updated 7 months ago
- BH hackathon☆14Updated 9 months ago
- An example implementation of RLHF (or, more accurately, RLAIF) built on MLX and HuggingFace.☆22Updated 6 months ago
- Collection of autoregressive model implementation☆76Updated last week
- Gymnasium framework for training language model agents on constructive tasks☆88Updated this week
- AFusion: AlphaFold 3 GUI & Toolkit with Visualization☆89Updated last month