cloneofsimo / insightful-nn-papersLinks
These papers will provide unique insightful concepts that will broaden your perspective on neural networks and deep learning
☆48Updated last year
Alternatives and similar repositories for insightful-nn-papers
Users that are interested in insightful-nn-papers are comparing it to the libraries listed below
Sorting:
- Simple implementation of muP, based on Spectral Condition for Feature Learning. The implementation is SGD only, dont use it for Adam☆83Updated 11 months ago
- ☆52Updated last year
- WIP☆93Updated 11 months ago
- Sparse Autoencoders for Stable Diffusion XL models.☆69Updated last month
- ☆81Updated last year
- Minimal (400 LOC) implementation Maximum (multi-node, FSDP) GPT training☆129Updated last year
- ☆34Updated 10 months ago
- supporting pytorch FSDP for optimizers☆85Updated 7 months ago
- ☆23Updated last year
- Replicating and dissecting the git-re-basin project in one-click-replication Colabs☆36Updated 2 years ago
- Flexibly track outputs and grad-outputs of torch.nn.Module.☆13Updated last year
- Tiny re-implementation of MDM in style of LLaDA and nano-gpt speedrun☆55Updated 4 months ago
- The simplest, fastest repository for training/finetuning medium-sized GPTs.☆149Updated 3 weeks ago
- ☆53Updated 8 months ago
- Language models scale reliably with over-training and on downstream tasks☆97Updated last year
- ☆27Updated last year
- Focused on fast experimentation and simplicity☆76Updated 7 months ago
- [ICML 2023] Reflected Diffusion Models (https://arxiv.org/abs/2304.04740)☆155Updated last year
- PyTorch implementation for "Parallel Sampling of Diffusion Models", NeurIPS 2023 Spotlight☆144Updated last year
- ☆51Updated last year
- Implementation of Discrete Key / Value Bottleneck, in Pytorch☆88Updated 2 years ago
- ☆90Updated 2 years ago
- Model Stock: All we need is just a few fine-tuned models☆118Updated 10 months ago
- [ICLR-2023] Rarity Score : A New Metric to Evaluate the Uncommonness of Synthesized Images☆65Updated 2 years ago
- Implementation of Retrieval-Augmented Denoising Diffusion Probabilistic Models in Pytorch☆65Updated 3 years ago
- Mixture of A Million Experts☆46Updated 11 months ago
- JAX implementation ViT-VQGAN☆83Updated 2 years ago
- ☆104Updated 2 years ago
- Just some miscellaneous utility functions / decorators / modules related to Pytorch and Accelerate to help speed up implementation of new…☆124Updated 11 months ago
- Consistency models trained on CIFAR-10, in JAX.☆148Updated last year