ogchen / nanofold
A nano protein structure prediction model based on DeepMind's AlphaFold paper
☆24Updated 7 months ago
Alternatives and similar repositories for nanofold:
Users that are interested in nanofold are comparing it to the libraries listed below
- Discovering Interpretable Features in Protein Language Models via Sparse Autoencoders☆140Updated last month
- ☆27Updated 6 months ago
- Pretraining Code for METAGENE-1☆57Updated last week
- Pytorch implementation of a simple way to enable (Stochastic) Frame Averaging for any network☆48Updated 5 months ago
- My own attempt at a long context genomics model, leveraging recent advances in long context attention modeling (Flash Attention + other h…☆52Updated last year
- Because it's there.☆14Updated 3 months ago
- Rust Implementation of micrograd☆51Updated 6 months ago
- An open source replication of the stawberry method that leverages Monte Carlo Search with PPO and or DPO☆26Updated this week
- alternative way to calculating self attention☆18Updated 7 months ago
- A general framework for inference-time scaling and steering of diffusion models with arbitrary rewards.☆40Updated this week
- Explorations into the proposal from the paper "Grokfast, Accelerated Grokking by Amplifying Slow Gradients"☆95Updated 3 weeks ago
- A single repo with all scripts and utils to train / fine-tune the Mamba model with or without FIM☆50Updated 9 months ago
- ☆60Updated last year
- Exploration into the Firefly algorithm in Pytorch☆33Updated 4 months ago
- This repository contains the data and scripts necessary to reproduce the results presented in the paper: **"Scalable molecular simulation…☆41Updated 7 months ago
- The code repository for the CURLoRA research paper. Stable LLM continual fine-tuning and catastrophic forgetting mitigation.☆41Updated 4 months ago
- ☆69Updated this week
- DeMo: Decoupled Momentum Optimization☆170Updated last month
- ☆53Updated last year
- ☆78Updated 9 months ago
- Tree Attention: Topology-aware Decoding for Long-Context Attention on GPU clusters☆111Updated last month
- look how they massacred my boy☆63Updated 3 months ago
- Collection of autoregressive model implementation☆76Updated last week
- Implementation of Infini-Transformer in Pytorch☆107Updated 2 weeks ago
- implementation of https://arxiv.org/pdf/2312.09299☆20Updated 6 months ago
- ☆46Updated last month
- The official repository for HyperZ⋅Z⋅W Operator Connects Slow-Fast Networks for Full Context Interaction.☆31Updated this week
- Muon optimizer for neural networks: >30% extra sample efficiency, <3% wallclock overhead☆210Updated 2 weeks ago
- Latent Diffusion Language Models☆68Updated last year
- ☆115Updated this week