juntang-zhuang / Adabelief-Optimizer

Related projects ⓘ

Alternatives and complementary repositories for Adabelief-Optimizer

• lucidrains / lambda-networks
  Implementation of LambdaNetworks, a new approach to image recognition that reaches SOTA with less compute
  ☆1,532Updated 4 years ago
• lessw2020 / Ranger-Deep-Learning-Optimizer
  Ranger - a synergistic optimizer using RAdam (Rectified Adam), Gradient Centralization and LookAhead in one codebase
  ☆1,194Updated 10 months ago
• facebookresearch / higher
  higher is a pytorch library allowing users to obtain higher order gradients over losses spanning training loops rather than individual tr…
  ☆1,593Updated 2 years ago
• jettify / pytorch-optimizer
  torch-optimizer -- collection of optimizers for Pytorch
  ☆3,043Updated 7 months ago
• google-research / sam
  ☆566Updated 3 weeks ago
• google-research / augmix
  AugMix: A Simple Data Processing Method to Improve Robustness and Uncertainty
  ☆980Updated 3 months ago
• LiyuanLucasLiu / RAdam
  On the Variance of the Adaptive Learning Rate and Beyond
  ☆2,535Updated 3 years ago
• epfml / attention-cnn
  Source code for "On the Relationship between Self-Attention and Convolutional Layers"
  ☆1,085Updated last year
• ildoonet / pytorch-gradual-warmup-lr
  Gradually-Warmup Learning Rate Scheduler for PyTorch
  ☆977Updated last month
• Yonghongwei / Gradient-Centralization
  A New Optimization Technique for Deep Neural Networks
  ☆533Updated 2 years ago
• google-research / noisystudent
  Code for Noisy Student Training. https://arxiv.org/abs/1911.04252
  ☆753Updated 3 years ago
• google-research / big_transfer
  Official repository for the "Big Transfer (BiT): General Visual Representation Learning" paper.
  ☆1,513Updated 3 months ago
• lucidrains / byol-pytorch
  Usable Implementation of "Bootstrap Your Own Latent" self-supervised learning, from Deepmind, in Pytorch
  ☆1,764Updated 4 months ago
• mgrankin / over9000
  Over9000 optimizer
  ☆425Updated last year
• majumderb / rezero
  Official PyTorch Repo for "ReZero is All You Need: Fast Convergence at Large Depth"
  ☆407Updated 3 months ago
• NVIDIA / runx
  Deep Learning Experiment Management
  ☆639Updated last year
• lucidrains / performer-pytorch
  An implementation of Performer, a linear attention-based transformer, in Pytorch
  ☆1,098Updated 2 years ago
• facebookresearch / swav
  PyTorch implementation of SwAV https//arxiv.org/abs/2006.09882
  ☆2,005Updated last year
• davda54 / sam
  SAM: Sharpness-Aware Minimization (PyTorch)
  ☆1,770Updated 9 months ago
• vballoli / nfnets-pytorch
  NFNets and Adaptive Gradient Clipping for SGD implemented in PyTorch. Find explanation at tourdeml.github.io/blog/
  ☆345Updated 10 months ago
• tristandeleu / pytorch-meta
  A collection of extensions and data-loaders for few-shot learning & meta-learning in PyTorch
  ☆1,989Updated last year
• jonbarron / robust_loss_pytorch
  A pytorch port of google-research/google-research/robust_loss/
  ☆664Updated 3 years ago
• Stonesjtu / pytorch_memlab
  Profiling and inspecting memory in pytorch
  ☆1,020Updated 3 months ago
• facebookresearch / barlowtwins
  PyTorch implementation of Barlow Twins.
  ☆968Updated 2 years ago
• facebookresearch / madgrad
  MADGRAD Optimization Method
  ☆803Updated last year
• Lightning-Universe / lightning-bolts
  Toolbox of models, callbacks, and datasets for AI/ML researchers.
  ☆1,695Updated 2 weeks ago
• facebookresearch / pycls
  Codebase for Image Classification Research, written in PyTorch.
  ☆2,139Updated 8 months ago
• zasdfgbnm / TorchSnooper
  Debug PyTorch code using PySnooper
  ☆802Updated 3 years ago
• davidtvs / pytorch-lr-finder
  A learning rate range test implementation in PyTorch
  ☆924Updated last month
• adobe / antialiased-cnns
  pip install antialiased-cnns to improve stability and accuracy
  ☆1,661Updated 7 months ago