Alternatives and similar repositories for Adabelief-Optimizer

Users that are interested in Adabelief-Optimizer are comparing it to the libraries listed below

• lucidrains / lambda-networks
  Implementation of LambdaNetworks, a new approach to image recognition that reaches SOTA with less compute
  ☆1,532Updated 4 years ago
• lessw2020 / Ranger-Deep-Learning-Optimizer
  Ranger - a synergistic optimizer using RAdam (Rectified Adam), Gradient Centralization and LookAhead in one codebase
  ☆1,203Updated last year
• jettify / pytorch-optimizer
  torch-optimizer -- collection of optimizers for Pytorch
  ☆3,136Updated last year
• epfml / attention-cnn
  Source code for "On the Relationship between Self-Attention and Convolutional Layers"
  ☆1,109Updated 2 years ago
• Yonghongwei / Gradient-Centralization
  A New Optimization Technique for Deep Neural Networks
  ☆538Updated 3 years ago
• LiyuanLucasLiu / RAdam
  On the Variance of the Adaptive Learning Rate and Beyond
  ☆2,554Updated 4 years ago
• kwotsin / mimicry
  [CVPR 2020 Workshop] A PyTorch GAN library that reproduces research results for popular GANs.
  ☆608Updated 3 years ago
• google-research / noisystudent
  Code for Noisy Student Training. https://arxiv.org/abs/1911.04252
  ☆763Updated 4 years ago
• vballoli / nfnets-pytorch
  NFNets and Adaptive Gradient Clipping for SGD implemented in PyTorch. Find explanation at tourdeml.github.io/blog/
  ☆348Updated last year
• davidtvs / pytorch-lr-finder
  A learning rate range test implementation in PyTorch
  ☆981Updated 2 months ago
• teddykoker / torchsort
  Fast, differentiable sorting and ranking in PyTorch
  ☆832Updated 3 months ago
• google-research / sam
  ☆605Updated 3 weeks ago
• lessw2020 / Ranger21
  Ranger deep learning optimizer rewrite to use newest components
  ☆334Updated last year
• google-research / augmix
  AugMix: A Simple Data Processing Method to Improve Robustness and Uncertainty
  ☆988Updated 3 months ago
• Lightning-Universe / lightning-bolts
  Toolbox of models, callbacks, and datasets for AI/ML researchers.
  ☆1,738Updated last week
• szymonmaszke / torchlayers
  Shape and dimension inference (Keras-like) for PyTorch layers and neural networks
  ☆572Updated 3 years ago
• vahidk / tfrecord
  Standalone TFRecord reader/writer with PyTorch data loaders
  ☆891Updated 3 months ago
• facebookresearch / barlowtwins
  PyTorch implementation of Barlow Twins.
  ☆990Updated 3 years ago
• lucidrains / performer-pytorch
  An implementation of Performer, a linear attention-based transformer, in Pytorch
  ☆1,148Updated 3 years ago
• mgrankin / over9000
  Over9000 optimizer
  ☆425Updated 2 years ago
• google-research / big_transfer
  Official repository for the "Big Transfer (BiT): General Visual Representation Learning" paper.
  ☆1,535Updated last year
• idiap / fast-transformers
  Pytorch library for fast transformer implementations
  ☆1,727Updated 2 years ago
• facebookresearch / higher
  higher is a pytorch library allowing users to obtain higher order gradients over losses spanning training loops rather than individual tr…
  ☆1,623Updated 3 years ago
• facebookresearch / madgrad
  MADGRAD Optimization Method
  ☆803Updated 7 months ago
• NVlabs / NVAE
  The Official PyTorch Implementation of "NVAE: A Deep Hierarchical Variational Autoencoder" (NeurIPS 2020 spotlight paper)
  ☆1,064Updated 2 years ago
• majumderb / rezero
  Official PyTorch Repo for "ReZero is All You Need: Fast Convergence at Large Depth"
  ☆414Updated last year
• locuslab / convmixer
  Implementation of ConvMixer for "Patches Are All You Need? 🤷"
  ☆1,077Updated 2 years ago
• ildoonet / pytorch-gradual-warmup-lr
  Gradually-Warmup Learning Rate Scheduler for PyTorch
  ☆992Updated 11 months ago
• lucidrains / reformer-pytorch
  Reformer, the efficient Transformer, in Pytorch
  ☆2,180Updated 2 years ago
• lukemelas / do-you-even-need-attention
  Is the attention layer even necessary? (https://arxiv.org/abs/2105.02723)
  ☆485Updated 4 years ago