Alternatives and similar repositories for EAdam-optimizer:

Users that are interested in EAdam-optimizer are comparing it to the libraries listed below

• juntang-zhuang / fairseq-adabelief
  ☆9Updated 4 years ago
• DeadAt0m / adafactor-pytorch
  A pytorch realization of adafactor (https://arxiv.org/pdf/1804.04235.pdf )
  ☆23Updated 5 years ago
• jaketae / fnet
  PyTorch implementation of FNet: Mixing Tokens with Fourier transforms
  ☆25Updated 3 years ago
• LeungSamWai / Drop-Activation
  The official implementation of paper "Drop-Activation: Implicit Parameter Reduction and Harmonious Regularization".
  ☆10Updated 5 years ago
• gbup-group / EAN-efficient-attention-network
  The implementation of paper ''Efficient Attention Network: Accelerate Attention by Searching Where to Plug''.
  ☆20Updated last year
• minicheshire / InResNet
  Interpolation between Residual and Non-Residual Networks, ICML 2020. https://arxiv.org/abs/2006.05749
  ☆26Updated 4 years ago
• mlpc-ucsd / BERT_Convolutions
  (ACL-IJCNLP 2021) Convolutions and Self-Attention: Re-interpreting Relative Positions in Pre-trained Language Models.
  ☆21Updated 2 years ago
• YuGuangWang / HaarPool
  PyTorch Codes for Haar Graph Pooling
  ☆11Updated 2 years ago
• izmailovpavel / torch_swa_examples
  ☆47Updated 4 years ago
• vfdev-5 / BootstrappingLoss
  Bootstrapping loss function implementation in pytorch
  ☆36Updated 4 years ago
• Noahs-ARK / RFA
  ☆33Updated 3 years ago
• chaitjo / gated-graph-transformers
  Transformers are Graph Neural Networks!
  ☆51Updated 4 years ago
• tbachlechner / ReZero-examples
  PyTorch Examples repo for "ReZero is All You Need: Fast Convergence at Large Depth"
  ☆62Updated 6 months ago
• yaohungt / TransformerDissection
  [EMNLP'19] Summary for Transformer Understanding
  ☆53Updated 5 years ago
• HazyResearch / augmentation_code
  Reproducible code for Augmentation paper
  ☆17Updated 6 years ago
• lucidrains / axial-positional-embedding
  Axial Positional Embedding for Pytorch
  ☆70Updated 2 weeks ago
• lucidrains / learning-to-expire-pytorch
  An implementation of Transformer with Expire-Span, a circuit for learning which memories to retain
  ☆33Updated 4 years ago
• shivram1987 / diffGrad
  diffGrad: An Optimization Method for Convolutional Neural Networks
  ☆55Updated 2 years ago
• lucidrains / remixer-pytorch
  Implementation of the Remixer Block from the Remixer paper, in Pytorch
  ☆35Updated 3 years ago
• QData / LaMP
  ECML 2019: Graph Neural Networks for Multi-Label Classification
  ☆90Updated 7 months ago
• switchablenorms / AdaX
  AdaX: Adaptive Gradient Descent with Exponential Long Term Momery
  ☆34Updated 4 years ago
• keivanalizadeh / ButterflyTransform
  ☆41Updated 3 years ago
• hunto / ReLoss
  Official implementation for paper "Relational Surrogate Loss Learning", ICLR 2022
  ☆36Updated 2 years ago
• lucidrains / rela-transformer
  Implementation of a Transformer using ReLA (Rectified Linear Attention) from https://arxiv.org/abs/2104.07012
  ☆49Updated 2 years ago
• minhtannguyen / SRSGD
  Code base for SRSGD.
  ☆28Updated 4 years ago
• lonePatient / EvoNorms_PyTorch
  Evolving Normalization-Activation Layers
  ☆19Updated 4 years ago
• KyleGoyette / nnRNN
  ☆24Updated 5 years ago
• KentonMurray / ProxGradPytorch
  PyTorch implementation of Proximal Gradient Algorithms a la Parikh and Boyd (2014). Useful for Auto-Sizing (Murray and Chiang 2015, Murra…
  ☆41Updated 4 years ago
• juntang-zhuang / ACProp-Optimizer
  Implementation for ACProp ( Momentum centering and asynchronous update for adaptive gradient methdos, NeurIPS 2021)
  ☆15Updated 3 years ago
• cheneydon / efficient-bert
  This repository contains the code for the paper in Findings of EMNLP 2021: "EfficientBERT: Progressively Searching Multilayer Perceptron …
  ☆32Updated last year