Alternatives and similar repositories for optimizers

Users that are interested in optimizers are comparing it to the libraries listed below

• sayakpaul / NALU
  Neural Arithmetic Logic Units by Trask et al.
  ☆12Updated 6 years ago
• qithink / NeurIPS2021_Vision_Transformer_Paper_Collection
  NeurIPS2021: Vision Transformer Paper Collection
  ☆8Updated 3 years ago
• soumik12345 / Enet
  Pytorch Implementation of ENet: A Deep Neural Network Architecture for Real-Time Semantic Segmentation (https://arxiv.org/abs/1606.02147)
  ☆11Updated 5 years ago
• parmarsuraj99 / keras-transformer-flex
  Transformer block in tf.keras similar to PyTorch's nn.Transformer block.
  ☆9Updated 4 years ago
• sayakpaul / Training-BatchNorm-and-Only-BatchNorm
  Experiments with the ideas presented in https://arxiv.org/abs/2003.00152 by Frankle et al.
  ☆29Updated 4 years ago
• dmbernaal / Daedalus
  Deep Learning Research
  ☆16Updated 5 years ago
• shabbeersh / Impact-of-FC-layers
  This research is carried out to find the necessity of fully connected (FC) layers in CNN for image classification.
  ☆14Updated 5 years ago
• sayakpaul / Denoised-Smoothing-TF
  Minimal implementation of Denoised Smoothing (https://arxiv.org/abs/2003.01908) in TensorFlow.
  ☆20Updated 3 years ago
• gbup-group / EAN-efficient-attention-network
  The implementation of paper ''Efficient Attention Network: Accelerate Attention by Searching Where to Plug''.
  ☆20Updated 2 years ago
• doerlbh / UnsupervisedAttentionMechanism
  Code for our paper: "Regularity Normalization: Neuroscience-Inspired Unsupervised Attention across Neural Network Layers".
  ☆21Updated 3 years ago
• Holmeswww / PPOGAN
  ☆24Updated last year
• EsterHlav / Dynamical-Isometry-from-Orthogonality-Neural-Nets
  Mathematical consequences of orthogonal weights initialization and regularization in deep learning. Experiments with gain-adjusted orthog…
  ☆17Updated 5 years ago
• ariG23498 / G-SimCLR
  This is the code base for paper "G-SimCLR : Self-Supervised Contrastive Learning with Guided Projection via Pseudo Labelling" by Souradip…
  ☆77Updated 3 years ago
• ayulockin / DataAugmentationTF
  Implementation of modern data augmentation techniques in TensorFlow 2.x to be used in your training pipeline.
  ☆34Updated 4 years ago
• lucidrains / kronecker-attention-pytorch
  Implementation of Kronecker Attention in Pytorch
  ☆19Updated 4 years ago
• landskape-ai / imagenet
  ImageNet training code that implements academic defaults
  ☆12Updated 3 years ago
• yk / PyTorch_CIFAR10
  Pretrained TorchVision models on CIFAR10 dataset (with weights)
  ☆24Updated 4 years ago
• sayakpaul / AdaMatch-TF
  Includes additional materials for the following keras.io blog post.
  ☆12Updated 4 years ago
• BayesWatch / deficient-efficient
  Successfully training approximations to full-rank matrices for efficiency in deep learning.
  ☆17Updated 4 years ago
• byeongjokim / VIPriors-Image-Classification-Challenge
  ☆17Updated 4 years ago
• ananyahjha93 / libself
  PyTorch Lightning based framework to run experiments for self-supervised learning tasks.
  ☆10Updated 5 years ago
• asvcode / 1_cycle
  A disciplined approach to neural network parameters - Reviewing the approach for setting Hyper parameters by Leslie Smith
  ☆12Updated 6 years ago
• kumar-shridhar / ProbAct-Probabilistic-Activation-Function
  Official PyTorch implementation of the paper : ProbAct: A Probabilistic Activation Function for Deep Neural Networks.
  ☆13Updated 6 years ago
• ducha-aiki / hardnet-in-fastai2-and-kornia
  Re-implementation of local descriptor HardNet training in fasta2+kornia
  ☆21Updated 5 years ago
• noahgolmant / pytorch-lr-dropout
  "Learning Rate Dropout" in PyTorch
  ☆34Updated 5 years ago
• titu1994 / tf_GON
  Tensorflow 2.x implementation of Gradient Origin Networks
  ☆12Updated 4 years ago
• teddykoker / u-noise
  Official PyTorch code for U-Noise: Learnable Noise Masks for Interpretable Image Segmentation (ICIP 2021)
  ☆41Updated 3 years ago
• dot-delta / Meta-SGD
  Meta-SGD Algorithms Implementation
  ☆22Updated 11 months ago
• sbelharbi / learning-class-invariant-features
  Repository for the code of the paper "Neural Networks Regularization Through Class-wise Invariant Representation Learning".
  ☆12Updated 7 years ago
• juntang-zhuang / ACProp-Optimizer
  Implementation for ACProp ( Momentum centering and asynchronous update for adaptive gradient methdos, NeurIPS 2021)
  ☆15Updated 3 years ago