ogchen / nanofold
A nano protein structure prediction model based on DeepMind's AlphaFold paper
☆24Updated 9 months ago
Alternatives and similar repositories for nanofold:
Users that are interested in nanofold are comparing it to the libraries listed below
- an open source reproduction of NVIDIA's nGPT (Normalized Transformer with Representation Learning on the Hypersphere)☆91Updated 3 weeks ago
- Discovering Interpretable Features in Protein Language Models via Sparse Autoencoders☆164Updated 2 months ago
- Because it's there.☆16Updated 6 months ago
- ☆60Updated last year
- A single repo with all scripts and utils to train / fine-tune the Mamba model with or without FIM☆54Updated 11 months ago
- σ-GPT: A New Approach to Autoregressive Models☆62Updated 7 months ago
- look how they massacred my boy☆63Updated 5 months ago
- Explorations into the proposal from the paper "Grokfast, Accelerated Grokking by Amplifying Slow Gradients"☆98Updated 3 months ago
- ☆27Updated 8 months ago
- Implementation of Mind Evolution, Evolving Deeper LLM Thinking, from Deepmind☆47Updated last month
- Tree Attention: Topology-aware Decoding for Long-Context Attention on GPU clusters☆125Updated 3 months ago
- Exploration into the Firefly algorithm in Pytorch☆35Updated last month
- The simplest, fastest repository for training/finetuning medium-sized xLSTMs.☆42Updated 10 months ago
- ☆47Updated 4 months ago
- An implementation of PSGD Kron second-order optimizer for PyTorch☆84Updated last week
- Exploring an idea where one forgets about efficiency and carries out attention across each edge of the nodes (tokens)☆47Updated this week
- ☆46Updated 4 months ago
- Lightweight package that tracks and summarizes code changes using LLMs (Large Language Models)☆32Updated last month
- alternative way to calculating self attention☆18Updated 10 months ago
- Just large language models. Hackable, with as little abstraction as possible. Done for my own purposes, feel free to rip.☆44Updated last year
- Minimal Implimentation of VCRec (2024) for collapse provention.☆16Updated 2 months ago
- [WIP] Transformer to embed Danbooru labelsets☆13Updated last year
- ☆33Updated 2 months ago
- A MAD laboratory to improve AI architecture designs 🧪☆108Updated 3 months ago
- Explorations into whether a transformer with RL can direct a genetic algorithm to converge faster☆63Updated last month
- Your favourite classical machine learning algos on the GPU/TPU☆20Updated 2 months ago
- Train your own SOTA deductive reasoning model☆81Updated 3 weeks ago
- Implementation of GotenNet, new SOTA 3d equivariant transformer, in Pytorch☆56Updated last week
- ☆53Updated last year
- Repository for StripedHyena, a state-of-the-art beyond Transformer architecture☆360Updated last year