Alternatives and similar repositories for insightful-nn-papers

Users that are interested in insightful-nn-papers are comparing it to the libraries listed below

• cloneofsimo / ezmup
  Simple implementation of muP, based on Spectral Condition for Feature Learning. The implementation is SGD only, dont use it for Adam
  ☆85Updated last year
• cloneofsimo / karras-power-ema-tutorial
  ☆53Updated 2 years ago
• cloneofsimo / scaling-guide
  WIP
  ☆93Updated last year
• cloneofsimo / min-fsdp
  ☆92Updated last year
• cloneofsimo / min-max-gpt
  Minimal (400 LOC) implementation Maximum (multi-node, FSDP) GPT training
  ☆132Updated last year
• ethansmith2000 / fsdp_optimizers
  supporting pytorch FSDP for optimizers
  ☆84Updated last year
• surkovv / sdxl-unbox
  Sparse Autoencoders for Stable Diffusion XL models.
  ☆79Updated 3 months ago
• graphcore-research / pytorch-tensor-tracker
  Flexibly track outputs and grad-outputs of torch.nn.Module.
  ☆13Updated 2 years ago
• cloneofsimo / zeroshampoo
  ☆34Updated last year
• cloneofsimo / efae
  ☆23Updated last year
• patil-suraj / stable-diffusion-jax
  ☆91Updated 3 years ago
• EleutherAI / nanoGPT-mup
  The simplest, fastest repository for training/finetuning medium-sized GPTs.
  ☆186Updated last week
• fal-ai-community / nano-mdm
  Tiny re-implementation of MDM in style of LLaDA and nano-gpt speedrun
  ☆56Updated 10 months ago
• mlfoundations / scaling
  Language models scale reliably with over-training and on downstream tasks
  ☆99Updated last year
• patil-suraj / vit-vqgan
  JAX implementation ViT-VQGAN
  ☆82Updated 3 years ago
• naver-ai / model-stock
  Model Stock: All we need is just a few fine-tuned models
  ☆128Updated 5 months ago
• lucidrains / discrete-key-value-bottleneck-pytorch
  Implementation of Discrete Key / Value Bottleneck, in Pytorch
  ☆88Updated 2 years ago
• epfml / schedules-and-scaling
  Code for NeurIPS 2024 Spotlight: "Scaling Laws and Compute-Optimal Training Beyond Fixed Training Durations"
  ☆88Updated last year
• igul222 / plaid
  ☆111Updated 2 years ago
• gregorbachmann / scaling_mlps
  ☆52Updated last year
• fal-ai / diffusion-speedrun
  Focused on fast experimentation and simplicity
  ☆80Updated last year
• cloneofsimo / imagenet.int8
  ☆39Updated last year
• stanislavfort / dissect-git-re-basin
  Replicating and dissecting the git-re-basin project in one-click-replication Colabs
  ☆37Updated 3 years ago
• srush / do-we-need-attention
  ☆167Updated 2 years ago
• cloneofsimo / min-max-in-dit
  ☆27Updated last year
• louaaron / Reflected-Diffusion
  [ICML 2023] Reflected Diffusion Models (https://arxiv.org/abs/2304.04740)
  ☆159Updated 2 years ago
• ClashLuke / tpucare
  Automatically take good care of your preemptible TPUs
  ☆37Updated 2 years ago
• lucidrains / llama-qrlhf
  Implementation of the Llama architecture with RLHF + Q-learning
  ☆170Updated last year
• cloneofsimo / minSAE
  ☆30Updated last year
• srush / triton-autodiff
  Experiment of using Tangent to autodiff triton
  ☆82Updated 2 years ago