Alternatives and similar repositories for EAdam-optimizer

Users that are interested in EAdam-optimizer are comparing it to the libraries listed below

• juntang-zhuang / fairseq-adabelief
  ☆9Updated 4 years ago
• DeadAt0m / adafactor-pytorch
  A pytorch realization of adafactor (https://arxiv.org/pdf/1804.04235.pdf )
  ☆24Updated 5 years ago
• Noahs-ARK / RFA
  ☆33Updated 4 years ago
• LeungSamWai / Drop-Activation
  The official implementation of paper "Drop-Activation: Implicit Parameter Reduction and Harmonious Regularization".
  ☆10Updated 5 years ago
• minhtannguyen / SRSGD
  Code base for SRSGD.
  ☆28Updated 5 years ago
• minicheshire / InResNet
  Interpolation between Residual and Non-Residual Networks, ICML 2020. https://arxiv.org/abs/2006.05749
  ☆26Updated 4 years ago
• vfdev-5 / BootstrappingLoss
  Bootstrapping loss function implementation in pytorch
  ☆36Updated 4 years ago
• mlpc-ucsd / BERT_Convolutions
  (ACL-IJCNLP 2021) Convolutions and Self-Attention: Re-interpreting Relative Positions in Pre-trained Language Models.
  ☆21Updated 2 years ago
• tbachlechner / ReZero-examples
  PyTorch Examples repo for "ReZero is All You Need: Fast Convergence at Large Depth"
  ☆62Updated 9 months ago
• cheneydon / efficient-bert
  This repository contains the code for the paper in Findings of EMNLP 2021: "EfficientBERT: Progressively Searching Multilayer Perceptron …
  ☆32Updated last year
• YuGuangWang / HaarPool
  PyTorch Codes for Haar Graph Pooling
  ☆11Updated 2 years ago
• xuanqing94 / FLOATER
  Learning to Encode Position for Transformer with Continuous Dynamical Model
  ☆60Updated 4 years ago
• chaitjo / gated-graph-transformers
  Transformers are Graph Neural Networks!
  ☆54Updated 4 years ago
• pkuzengqi / Skyformer
  Skyformer: Remodel Self-Attention with Gaussian Kernel and Nystr\"om Method (NeurIPS 2021)
  ☆61Updated 3 years ago
• lonePatient / EvoNorms_PyTorch
  Evolving Normalization-Activation Layers
  ☆19Updated 5 years ago
• gbup-group / EAN-efficient-attention-network
  The implementation of paper ''Efficient Attention Network: Accelerate Attention by Searching Where to Plug''.
  ☆20Updated last year
• schwartz-lab-NLP / papa
  Code for the PAPA paper
  ☆27Updated 2 years ago
• KhrulkovV / tt-pytorch
  ☆60Updated 4 years ago
• d-li14 / mlp-mixer.pytorch
  PyTorch implementation of MLP-Mixer
  ☆37Updated 4 years ago
• szhangtju / The-compression-of-Transformer
  ☆64Updated 4 years ago
• biswajitsc / sparse-embed
  Code for paper 'Minimizing FLOPs to Learn Efficient Sparse Representations' published at ICLR 2020
  ☆20Updated 5 years ago
• fawazsammani / mogrifier-lstm-pytorch
  Implementation of Mogrifier LSTM in PyTorch
  ☆35Updated 5 years ago
• yaohungt / Self_Supervised_Learning_Multiview
  ☆42Updated 4 years ago
• 201419 / Optimizer-PyTorch
  Package of Optimizer implemented with PyTorch .
  ☆65Updated 5 years ago
• JingzhaoZhang / why-clipping-accelerates
  A pytorch implementation for the LSTM experiments in the paper: Why Gradient Clipping Accelerates Training: A Theoretical Justification f…
  ☆46Updated 5 years ago
• juntang-zhuang / ACProp-Optimizer
  Implementation for ACProp ( Momentum centering and asynchronous update for adaptive gradient methdos, NeurIPS 2021)
  ☆15Updated 3 years ago
• lancopku / AdaNorm
  Code for "Understanding and Improving Layer Normalization"
  ☆46Updated 5 years ago
• lucidrains / learning-to-expire-pytorch
  An implementation of Transformer with Expire-Span, a circuit for learning which memories to retain
  ☆34Updated 4 years ago
• bojone / univae
  基于Transformer的单模型、多尺度的VAE模型
  ☆55Updated 3 years ago
• ermongroup / subsets
  Code for Reparameterizable Subset Sampling via Continuous Relaxations, IJCAI 2019.
  ☆56Updated last year