metagene-ai / metagene-pretrainLinks
Pretraining Code for METAGENE-1
☆68Updated 9 months ago
Alternatives and similar repositories for metagene-pretrain
Users that are interested in metagene-pretrain are comparing it to the libraries listed below
Sorting:
- Your favourite classical machine learning algos on the GPU/TPU☆20Updated 9 months ago
- Framework enabling modular interchange of language agents, environments, and optimizers☆107Updated last week
- ☆61Updated last year
- ☆30Updated this week
- ☆30Updated 8 months ago
- A language agent gym with challenging scientific tasks☆206Updated this week
- Implementation of the Pairformer model used in AlphaFold 3☆14Updated last week
- Pretraining infrastructure for multi-hybrid AI model architectures☆188Updated 2 months ago
- [EMNLP 2024] Tree of Problems: Improving structured problem solving with compositionality☆19Updated 7 months ago
- An aviary-based data science agent based on jupyter notebooks☆37Updated last week
- aesthetic tensor visualiser☆27Updated 5 months ago
- σ-GPT: A New Approach to Autoregressive Models☆68Updated last year
- Implementation of Mind Evolution, Evolving Deeper LLM Thinking, from Deepmind☆57Updated 4 months ago
- BioCoder: A Benchmark for Bioinformatics Code Generation with Large Language Models https://arxiv.org/abs/2308.16458☆51Updated 2 months ago
- reasoning model trained using GRPO towards rosetta REF2015 for protein stability☆92Updated 2 months ago
- Using multiple LLMs for ensemble Forecasting☆16Updated last year
- A nano protein structure prediction model based on DeepMind's AlphaFold paper☆30Updated last year
- Benchmark for LLM-based Agents in Computational Biology☆54Updated last week
- alternative way to calculating self attention☆18Updated last year
- an open source reproduction of NVIDIA's nGPT (Normalized Transformer with Representation Learning on the Hypersphere)☆105Updated 7 months ago
- An open source replication of the stawberry method that leverages Monte Carlo Search with PPO and or DPO☆29Updated this week
- My own attempt at a long context genomics model, leveraging recent advances in long context attention modeling (Flash Attention + other h…☆54Updated 2 years ago
- Discovering Interpretable Features in Protein Language Models via Sparse Autoencoders☆223Updated last week
- $100K or 100 Days: Trade-offs when Pre-Training with Academic Resources☆147Updated last week
- CLaMR: Contextualized Late-Interaction for Multimodal Content Retrieval☆20Updated 3 months ago
- Repository to create traveling waves integrate special information through time☆55Updated 2 months ago
- Automated Hypothesis Testing with Agentic Sequential Falsifications☆227Updated 4 months ago
- Simple GRPO scripts and configurations.☆59Updated 8 months ago
- Explorations into the proposal from the paper "Grokfast, Accelerated Grokking by Amplifying Slow Gradients"☆102Updated 9 months ago
- Official implementation of "BERTs are Generative In-Context Learners"☆32Updated 6 months ago