Alternatives and similar repositories for dadaptation:

Users that are interested in dadaptation are comparing it to the libraries listed below

• konstmish / prodigy
  The Prodigy optimizer and its variants for training neural networks.
  ☆379Updated 2 months ago
• lucidrains / lion-pytorch
  🦁 Lion, new optimizer discovered by Google Brain using genetic algorithms that is purportedly better than Adam(w), in Pytorch
  ☆2,106Updated 3 months ago
• kach / gradient-descent-the-ultimate-optimizer
  Code for our NeurIPS 2022 paper
  ☆365Updated 2 years ago
• lucidrains / Adan-pytorch
  Implementation of the Adan (ADAptive Nesterov momentum algorithm) Optimizer in Pytorch
  ☆251Updated 2 years ago
• samuela / git-re-basin
  Code release for "Git Re-Basin: Merging Models modulo Permutation Symmetries"
  ☆476Updated 2 years ago
• lucidrains / ema-pytorch
  A simple way to keep track of an Exponential Moving Average (EMA) version of your Pytorch model
  ☆565Updated 3 months ago
• lucidrains / memory-efficient-attention-pytorch
  Implementation of a memory efficient multi-head attention as proposed in the paper, "Self-attention Does Not Need O(n²) Memory"
  ☆372Updated last year
• kyegomez / Sophia
  Effortless plugin and play Optimizer to cut model training costs by 50%. New optimizer that is 2x faster than Adam on LLMs.
  ☆381Updated 9 months ago
• kozistr / pytorch_optimizer
  optimizer & lr scheduler & loss function collections in PyTorch
  ☆278Updated last week
• mlcommons / algorithmic-efficiency
  MLCommons Algorithmic Efficiency is a benchmark and competition measuring neural network training speedups due to algorithmic improvement…
  ☆370Updated this week
• Liuhong99 / Sophia
  The official implementation of “Sophia: A Scalable Stochastic Second-order Optimizer for Language Model Pre-training”
  ☆955Updated last year
• cccntu / minLoRA
  minLoRA: a minimal PyTorch library that allows you to apply LoRA to any PyTorch model.
  ☆454Updated last year
• lucidrains / rotary-embedding-torch
  Implementation of Rotary Embeddings, from the Roformer paper, in Pytorch
  ☆651Updated 3 months ago
• archinetai / surgeon-pytorch
  A library to inspect and extract intermediate layers of PyTorch models.
  ☆472Updated 2 years ago
• pytorch / functorch
  functorch is JAX-like composable function transforms for PyTorch.
  ☆1,416Updated this week
• facebookresearch / torchdim
  Named tensors with first-class dimensions for PyTorch
  ☆321Updated last year
• facebookresearch / dropout
  Code release for "Dropout Reduces Underfitting"
  ☆312Updated last year
• google / learned_optimization
  ☆771Updated 2 months ago
• fferflo / einx
  Universal Tensor Operations in Einstein-Inspired Notation for Python.
  ☆361Updated last month
• AminRezaei0x443 / memory-efficient-attention
  Memory Efficient Attention (O(sqrt(n)) for Jax and PyTorch
  ☆182Updated 2 years ago
• cloneofsimo / consistency_models
  Unofficial Implementation of Consistency Models in pytorch
  ☆254Updated 2 years ago
• google-research / vdm
  ☆310Updated 2 years ago
• metaopt / torchopt
  TorchOpt is an efficient library for differentiable optimization built upon PyTorch.
  ☆574Updated 3 weeks ago
• lucidrains / Mega-pytorch
  Implementation of Mega, the Single-head Attention with Multi-headed EMA architecture that currently holds SOTA on Long Range Arena
  ☆204Updated last year
• yiyixuxu / denoising-diffusion-flax
  Implementing the Denoising Diffusion Probabilistic Model in Flax
  ☆147Updated 2 years ago
• lucidrains / CoLT5-attention
  Implementation of the conditionally routed attention in the CoLT5 architecture, in Pytorch
  ☆226Updated 6 months ago
• wpeebles / G.pt
  Official PyTorch Implementation of "Learning to Learn with Generative Models of Neural Network Checkpoints"
  ☆338Updated 2 years ago
• hristo-vrigazov / mmap.ninja
  Memory mapped numpy arrays of varying shapes
  ☆295Updated 9 months ago
• lucidrains / recurrent-interface-network-pytorch
  Implementation of Recurrent Interface Network (RIN), for highly efficient generation of images and video without cascading networks, in P…
  ☆201Updated last year
• matthias-wright / flaxmodels
  Pretrained deep learning models for Jax/Flax: StyleGAN2, GPT2, VGG, ResNet, etc.
  ☆249Updated this week