Alternatives and similar repositories for dadaptation

Users that are interested in dadaptation are comparing it to the libraries listed below

• konstmish / prodigy
  The Prodigy optimizer and its variants for training neural networks.
  ☆392Updated 4 months ago
• kozistr / pytorch_optimizer
  optimizer & lr scheduler & loss function collections in PyTorch
  ☆297Updated this week
• lucidrains / ema-pytorch
  A simple way to keep track of an Exponential Moving Average (EMA) version of your Pytorch model
  ☆587Updated 5 months ago
• kach / gradient-descent-the-ultimate-optimizer
  Code for our NeurIPS 2022 paper
  ☆368Updated 2 years ago
• lucidrains / Adan-pytorch
  Implementation of the Adan (ADAptive Nesterov momentum algorithm) Optimizer in Pytorch
  ☆252Updated 2 years ago
• samuela / git-re-basin
  Code release for "Git Re-Basin: Merging Models modulo Permutation Symmetries"
  ☆479Updated 2 years ago
• lucidrains / memory-efficient-attention-pytorch
  Implementation of a memory efficient multi-head attention as proposed in the paper, "Self-attention Does Not Need O(n²) Memory"
  ☆378Updated last year
• facebookresearch / torchdim
  Named tensors with first-class dimensions for PyTorch
  ☆329Updated last year
• lucidrains / lion-pytorch
  🦁 Lion, new optimizer discovered by Google Brain using genetic algorithms that is purportedly better than Adam(w), in Pytorch
  ☆2,132Updated 6 months ago
• cloneofsimo / consistency_models
  Unofficial Implementation of Consistency Models in pytorch
  ☆256Updated 2 years ago
• kyegomez / Sophia
  Effortless plugin and play Optimizer to cut model training costs by 50%. New optimizer that is 2x faster than Adam on LLMs.
  ☆380Updated 11 months ago
• pytorch / tensordict
  TensorDict is a pytorch dedicated tensor container.
  ☆925Updated this week
• iShohei220 / adopt
  Official Implementation of "ADOPT: Modified Adam Can Converge with Any β2 with the Optimal Rate"
  ☆424Updated 5 months ago
• lucidrains / recurrent-interface-network-pytorch
  Implementation of Recurrent Interface Network (RIN), for highly efficient generation of images and video without cascading networks, in P…
  ☆203Updated last year
• apple / ml-sigma-reparam
  ☆301Updated 11 months ago
• cloneofsimo / minSDXL
  Huggingface-compatible SDXL Unet implementation that is readily hackable
  ☆423Updated last year
• cccntu / minLoRA
  minLoRA: a minimal PyTorch library that allows you to apply LoRA to any PyTorch model.
  ☆460Updated last year
• pytorch / torcheval
  A library that contains a rich collection of performant PyTorch model metrics, a simple interface to create new metrics, a toolkit to fac…
  ☆233Updated 4 months ago
• facebookresearch / optimizers
  For optimization algorithm research and development.
  ☆518Updated this week
• AminRezaei0x443 / memory-efficient-attention
  Memory Efficient Attention (O(sqrt(n)) for Jax and PyTorch
  ☆183Updated 2 years ago
• facebookresearch / dropout
  Code release for "Dropout Reduces Underfitting"
  ☆313Updated 2 years ago
• google-research / vdm
  ☆315Updated 2 years ago
• junhsss / consistency-models
  A Toolkit for OpenAI's Consistency Models.
  ☆205Updated 2 years ago
• facebookresearch / schedule_free
  Schedule-Free Optimization in PyTorch
  ☆2,162Updated last week
• pytorch / functorch
  functorch is JAX-like composable function transforms for PyTorch.
  ☆1,429Updated this week
• sail-sg / Adan
  Adan: Adaptive Nesterov Momentum Algorithm for Faster Optimizing Deep Models
  ☆791Updated 11 months ago
• mlcommons / algorithmic-efficiency
  MLCommons Algorithmic Efficiency is a benchmark and competition measuring neural network training speedups due to algorithmic improvement…
  ☆381Updated this week
• wpeebles / G.pt
  Official PyTorch Implementation of "Learning to Learn with Generative Models of Neural Network Checkpoints"
  ☆340Updated 2 years ago
• microsoft / mup
  maximal update parametrization (µP)
  ☆1,526Updated 10 months ago
• NVlabs / edm2
  EDM2 and Autoguidance -- Official PyTorch implementation
  ☆714Updated 5 months ago