cloneofsimo / insightful-nn-papersLinks
These papers will provide unique insightful concepts that will broaden your perspective on neural networks and deep learning
☆48Updated 2 years ago
Alternatives and similar repositories for insightful-nn-papers
Users that are interested in insightful-nn-papers are comparing it to the libraries listed below
Sorting:
- Simple implementation of muP, based on Spectral Condition for Feature Learning. The implementation is SGD only, dont use it for Adam☆85Updated last year
- ☆53Updated last year
- WIP☆93Updated last year
- Minimal (400 LOC) implementation Maximum (multi-node, FSDP) GPT training☆132Updated last year
- Sparse Autoencoders for Stable Diffusion XL models.☆70Updated 3 months ago
- supporting pytorch FSDP for optimizers☆83Updated 10 months ago
- ☆34Updated last year
- ☆91Updated last year
- Replicating and dissecting the git-re-basin project in one-click-replication Colabs☆35Updated 3 years ago
- Flexibly track outputs and grad-outputs of torch.nn.Module.☆13Updated 2 years ago
- ☆23Updated last year
- ☆89Updated 3 years ago
- Mixture of A Million Experts☆48Updated last year
- Synthetic Alphabet Dataset☆19Updated 6 months ago
- JAX implementation ViT-VQGAN☆82Updated 3 years ago
- Language models scale reliably with over-training and on downstream tasks☆100Updated last year
- Focused on fast experimentation and simplicity☆75Updated 10 months ago
- Consistency models trained on CIFAR-10, in JAX.☆155Updated 2 years ago
- Automatically take good care of your preemptible TPUs☆37Updated 2 years ago
- Reproduction of DDPO paper (RLHF for diffusion)☆92Updated 2 years ago
- Supporting code for the blog post on modular manifolds.☆86Updated last month
- ☆56Updated 11 months ago
- ☆18Updated 11 months ago
- Tiny re-implementation of MDM in style of LLaDA and nano-gpt speedrun☆56Updated 7 months ago
- ☆107Updated 2 years ago
- Why Do We Need Weight Decay in Modern Deep Learning? [NeurIPS 2024]☆68Updated last year
- [ICML 2023] Reflected Diffusion Models (https://arxiv.org/abs/2304.04740)☆158Updated 2 years ago
- Implementation of Discrete Key / Value Bottleneck, in Pytorch☆88Updated 2 years ago
- Implementation of the Llama architecture with RLHF + Q-learning☆167Updated 8 months ago
- Pytorch implementation of the PEER block from the paper, Mixture of A Million Experts, by Xu Owen He at Deepmind☆129Updated last year