cloneofsimo / insightful-nn-papersLinks
These papers will provide unique insightful concepts that will broaden your perspective on neural networks and deep learning
☆48Updated 2 years ago
Alternatives and similar repositories for insightful-nn-papers
Users that are interested in insightful-nn-papers are comparing it to the libraries listed below
Sorting:
- Simple implementation of muP, based on Spectral Condition for Feature Learning. The implementation is SGD only, dont use it for Adam☆85Updated last year
- ☆53Updated last year
- WIP☆93Updated last year
- Sparse Autoencoders for Stable Diffusion XL models.☆69Updated 2 months ago
- ☆89Updated last year
- Minimal (400 LOC) implementation Maximum (multi-node, FSDP) GPT training☆132Updated last year
- supporting pytorch FSDP for optimizers☆84Updated 9 months ago
- ☆34Updated last year
- Replicating and dissecting the git-re-basin project in one-click-replication Colabs☆36Updated 3 years ago
- Reproduction of DDPO paper (RLHF for diffusion)☆90Updated 2 years ago
- Automatically take good care of your preemptible TPUs☆36Updated 2 years ago
- ☆30Updated 10 months ago
- Flexibly track outputs and grad-outputs of torch.nn.Module.☆13Updated last year
- PyTorch implementation for "Parallel Sampling of Diffusion Models", NeurIPS 2023 Spotlight☆148Updated last year
- ☆23Updated last year
- 🦾 EvalGIM (pronounced as "EvalGym") is an evaluation library for generative image models. It enables easy-to-use, reproducible automatic…☆85Updated 9 months ago
- ☆51Updated last year
- Synthetic Alphabet Dataset☆19Updated 6 months ago
- Mixture of A Million Experts☆48Updated last year
- Language models scale reliably with over-training and on downstream tasks☆100Updated last year
- Tiny re-implementation of MDM in style of LLaDA and nano-gpt speedrun☆56Updated 6 months ago
- ☆27Updated last year
- [ICML 2023] Reflected Diffusion Models (https://arxiv.org/abs/2304.04740)☆158Updated last year
- Implementation of Discrete Key / Value Bottleneck, in Pytorch☆88Updated 2 years ago
- Focused on fast experimentation and simplicity☆75Updated 9 months ago
- Git Re-Basin: Merging Models modulo Permutation Symmetries in PyTorch☆77Updated 2 years ago
- ☆166Updated 2 years ago
- The simplest, fastest repository for training/finetuning medium-sized GPTs.☆164Updated 3 months ago
- ☆107Updated 2 years ago
- Supporting code for the blog post on modular manifolds.☆39Updated last week