Alternatives and similar repositories for insightful-nn-papers

Users that are interested in insightful-nn-papers are comparing it to the libraries listed below

• cloneofsimo / ezmup
  Simple implementation of muP, based on Spectral Condition for Feature Learning. The implementation is SGD only, dont use it for Adam
  ☆85Updated last year
• cloneofsimo / karras-power-ema-tutorial
  ☆53Updated last year
• cloneofsimo / scaling-guide
  WIP
  ☆94Updated last year
• cloneofsimo / min-max-gpt
  Minimal (400 LOC) implementation Maximum (multi-node, FSDP) GPT training
  ☆132Updated last year
• cloneofsimo / min-fsdp
  ☆87Updated last year
• ethansmith2000 / fsdp_optimizers
  supporting pytorch FSDP for optimizers
  ☆84Updated 9 months ago
• graphcore-research / pytorch-tensor-tracker
  Flexibly track outputs and grad-outputs of torch.nn.Module.
  ☆13Updated last year
• surkovv / sdxl-unbox
  Sparse Autoencoders for Stable Diffusion XL models.
  ☆70Updated last month
• cloneofsimo / zeroshampoo
  ☆34Updated last year
• stanislavfort / dissect-git-re-basin
  Replicating and dissecting the git-re-basin project in one-click-replication Colabs
  ☆36Updated 2 years ago
• lucidrains / discrete-key-value-bottleneck-pytorch
  Implementation of Discrete Key / Value Bottleneck, in Pytorch
  ☆88Updated 2 years ago
• cloneofsimo / efae
  ☆23Updated last year
• cloneofsimo / minSAE
  ☆30Updated 9 months ago
• mlfoundations / scaling
  Language models scale reliably with over-training and on downstream tasks
  ☆98Updated last year
• huyphan168 / PEER
  Mixture of A Million Experts
  ☆47Updated last year
• patil-suraj / stable-diffusion-jax
  ☆91Updated 2 years ago
• tmabraham / ddpo-pytorch
  Reproduction of DDPO paper (RLHF for diffusion)
  ☆90Updated last year
• ryanwebster90 / snip-dedup
  ☆104Updated last year
• EleutherAI / nanoGPT-mup
  The simplest, fastest repository for training/finetuning medium-sized GPTs.
  ☆157Updated 2 months ago
• apple / ml-act
  ☆53Updated 9 months ago
• igul222 / plaid
  ☆106Updated 2 years ago
• davisyoshida / lorax
  LoRA for arbitrary JAX models and functions
  ☆142Updated last year
• openai / consistency_models_cifar10
  Consistency models trained on CIFAR-10, in JAX.
  ☆150Updated 2 years ago
• srush / do-we-need-attention
  ☆166Updated 2 years ago
• fal-ai-community / nano-mdm
  Tiny re-implementation of MDM in style of LLaDA and nano-gpt speedrun
  ☆56Updated 6 months ago
• naver-ai / model-stock
  Model Stock: All we need is just a few fine-tuned models
  ☆122Updated last month
• fal-ai / diffusion-speedrun
  Focused on fast experimentation and simplicity
  ☆75Updated 8 months ago
• cloneofsimo / imagenet.int8
  ☆39Updated last year
• ClashLuke / tpucare
  Automatically take good care of your preemptible TPUs
  ☆36Updated 2 years ago
• epfml / schedules-and-scaling
  Code for NeurIPS 2024 Spotlight: "Scaling Laws and Compute-Optimal Training Beyond Fixed Training Durations"
  ☆82Updated 10 months ago