cloneofsimo / insightful-nn-papersLinks
These papers will provide unique insightful concepts that will broaden your perspective on neural networks and deep learning
☆48Updated 2 years ago
Alternatives and similar repositories for insightful-nn-papers
Users that are interested in insightful-nn-papers are comparing it to the libraries listed below
Sorting:
- Simple implementation of muP, based on Spectral Condition for Feature Learning. The implementation is SGD only, dont use it for Adam☆85Updated last year
- ☆53Updated 2 years ago
- WIP☆93Updated last year
- Minimal (400 LOC) implementation Maximum (multi-node, FSDP) GPT training☆132Updated last year
- ☆92Updated last year
- supporting pytorch FSDP for optimizers☆84Updated last year
- Sparse Autoencoders for Stable Diffusion XL models.☆79Updated 2 months ago
- ☆34Updated last year
- Replicating and dissecting the git-re-basin project in one-click-replication Colabs☆37Updated 3 years ago
- ☆23Updated last year
- Flexibly track outputs and grad-outputs of torch.nn.Module.☆13Updated 2 years ago
- ☆91Updated 3 years ago
- JAX implementation ViT-VQGAN☆82Updated 3 years ago
- Implementation of Discrete Key / Value Bottleneck, in Pytorch☆88Updated 2 years ago
- CLOOB training (JAX) and inference (JAX and PyTorch)☆74Updated 3 years ago
- Focused on fast experimentation and simplicity☆79Updated last year
- ☆30Updated last year
- Tiny re-implementation of MDM in style of LLaDA and nano-gpt speedrun☆56Updated 10 months ago
- Language models scale reliably with over-training and on downstream tasks☆100Updated last year
- ☆52Updated last year
- Contrastive Language-Image Pretraining☆144Updated 3 years ago
- [ICLR-2023] Rarity Score : A New Metric to Evaluate the Uncommonness of Synthesized Images☆67Updated 3 years ago
- Reproduction of DDPO paper (RLHF for diffusion)☆93Updated 2 years ago
- Model Stock: All we need is just a few fine-tuned models☆128Updated 5 months ago
- Automatically take good care of your preemptible TPUs☆37Updated 2 years ago
- ☆39Updated last year
- Consistency models trained on CIFAR-10, in JAX.☆150Updated 2 years ago
- [ICML 2023] Reflected Diffusion Models (https://arxiv.org/abs/2304.04740)☆158Updated 2 years ago
- ☆111Updated 2 years ago
- Implementation of the Llama architecture with RLHF + Q-learning☆170Updated 11 months ago