Alternatives and similar repositories for Adabelief-Optimizer:

Users that are interested in Adabelief-Optimizer are comparing it to the libraries listed below

• lessw2020 / Ranger-Deep-Learning-Optimizer
  Ranger - a synergistic optimizer using RAdam (Rectified Adam), Gradient Centralization and LookAhead in one codebase
  ☆1,196Updated last year
• lucidrains / lambda-networks
  Implementation of LambdaNetworks, a new approach to image recognition that reaches SOTA with less compute
  ☆1,534Updated 4 years ago
• jettify / pytorch-optimizer
  torch-optimizer -- collection of optimizers for Pytorch
  ☆3,082Updated 10 months ago
• LiyuanLucasLiu / RAdam
  On the Variance of the Adaptive Learning Rate and Beyond
  ☆2,542Updated 3 years ago
• epfml / attention-cnn
  Source code for "On the Relationship between Self-Attention and Convolutional Layers"
  ☆1,096Updated 2 years ago
• Yonghongwei / Gradient-Centralization
  A New Optimization Technique for Deep Neural Networks
  ☆535Updated 3 years ago
• lucidrains / reformer-pytorch
  Reformer, the efficient Transformer, in Pytorch
  ☆2,152Updated last year
• davda54 / sam
  SAM: Sharpness-Aware Minimization (PyTorch)
  ☆1,830Updated last year
• lessw2020 / Ranger21
  Ranger deep learning optimizer rewrite to use newest components
  ☆327Updated last year
• VITA-Group / TransGAN
  [NeurIPS‘2021] "TransGAN: Two Pure Transformers Can Make One Strong GAN, and That Can Scale Up", Yifan Jiang, Shiyu Chang, Zhangyang Wang
  ☆1,661Updated 2 years ago
• mgrankin / over9000
  Over9000 optimizer
  ☆426Updated 2 years ago
• google-research / noisystudent
  Code for Noisy Student Training. https://arxiv.org/abs/1911.04252
  ☆756Updated 3 years ago
• Lightning-Universe / lightning-bolts
  Toolbox of models, callbacks, and datasets for AI/ML researchers.
  ☆1,715Updated 2 weeks ago
• lucidrains / performer-pytorch
  An implementation of Performer, a linear attention-based transformer, in Pytorch
  ☆1,115Updated 3 years ago
• Tony-Y / pytorch_warmup
  Learning Rate Warmup in PyTorch
  ☆403Updated 2 weeks ago
• huggingface / pytorch_block_sparse
  Fast Block Sparse Matrices for Pytorch
  ☆546Updated 4 years ago
• NVIDIA / runx
  Deep Learning Experiment Management
  ☆639Updated 2 years ago
• jonbarron / robust_loss_pytorch
  A pytorch port of google-research/google-research/robust_loss/
  ☆672Updated 3 years ago
• vballoli / nfnets-pytorch
  NFNets and Adaptive Gradient Clipping for SGD implemented in PyTorch. Find explanation at tourdeml.github.io/blog/
  ☆345Updated last year
• szymonmaszke / torchlayers
  Shape and dimension inference (Keras-like) for PyTorch layers and neural networks
  ☆570Updated 2 years ago
• ildoonet / pytorch-gradual-warmup-lr
  Gradually-Warmup Learning Rate Scheduler for PyTorch
  ☆986Updated 4 months ago
• f-dangel / cockpit
  Cockpit: A Practical Debugging Tool for Training Deep Neural Networks
  ☆474Updated 2 years ago
• Santosh-Gupta / SpeedTorch
  Library for faster pinned CPU <-> GPU transfer in Pytorch
  ☆685Updated 4 years ago
• achaiah / pywick
  High-level batteries-included neural network training library for Pytorch
  ☆398Updated 3 years ago
• facebookresearch / higher
  higher is a pytorch library allowing users to obtain higher order gradients over losses spanning training loops rather than individual tr…
  ☆1,607Updated 2 years ago
• cybertronai / pytorch-lamb
  Implementation of https://arxiv.org/abs/1904.00962
  ☆371Updated 4 years ago
• rwightman / gen-efficientnet-pytorch
  Pretrained EfficientNet, EfficientNet-Lite, MixNet, MobileNetV3 / V2, MNASNet A1 and B1, FBNet, Single-Path NAS
  ☆1,568Updated 8 months ago
• vahidk / tfrecord
  Standalone TFRecord reader/writer with PyTorch data loaders
  ☆874Updated 6 months ago
• adobe / antialiased-cnns
  pip install antialiased-cnns to improve stability and accuracy
  ☆1,661Updated 10 months ago
• majumderb / rezero
  Official PyTorch Repo for "ReZero is All You Need: Fast Convergence at Large Depth"
  ☆408Updated 6 months ago