yuanwei2019 / EAdam-optimizer

Related projects ⓘ

Alternatives and complementary repositories for EAdam-optimizer

• juntang-zhuang / fairseq-adabelief
  ☆9Updated 4 years ago
• DeadAt0m / adafactor-pytorch
  A pytorch realization of adafactor (https://arxiv.org/pdf/1804.04235.pdf )
  ☆24Updated 5 years ago
• switchablenorms / AdaX
  AdaX: Adaptive Gradient Descent with Exponential Long Term Momery
  ☆34Updated 4 years ago
• mlpc-ucsd / BERT_Convolutions
  (ACL-IJCNLP 2021) Convolutions and Self-Attention: Re-interpreting Relative Positions in Pre-trained Language Models.
  ☆21Updated 2 years ago
• YuGuangWang / HaarPool
  PyTorch Codes for Haar Graph Pooling
  ☆11Updated last year
• yaohungt / Self_Supervised_Learning_Multiview
  ☆40Updated 4 years ago
• gbup-group / EAN-efficient-attention-network
  The implementation of paper ''Efficient Attention Network: Accelerate Attention by Searching Where to Plug''.
  ☆20Updated last year
• vfdev-5 / BootstrappingLoss
  Bootstrapping loss function implementation in pytorch
  ☆36Updated 3 years ago
• LeungSamWai / Drop-Activation
  The official implementation of paper "Drop-Activation: Implicit Parameter Reduction and Harmonious Regularization".
  ☆10Updated 5 years ago
• lonePatient / EvoNorms_PyTorch
  Evolving Normalization-Activation Layers
  ☆19Updated 4 years ago
• minhtannguyen / SRSGD
  Code base for SRSGD.
  ☆28Updated 4 years ago
• hunto / ReLoss
  Official implementation for paper "Relational Surrogate Loss Learning", ICLR 2022
  ☆37Updated 2 years ago
• fawazsammani / mogrifier-lstm-pytorch
  Implementation of Mogrifier LSTM in PyTorch
  ☆35Updated 4 years ago
• jaketae / fnet
  PyTorch implementation of FNet: Mixing Tokens with Fourier transforms
  ☆25Updated 3 years ago
• shivram1987 / diffGrad
  diffGrad: An Optimization Method for Convolutional Neural Networks
  ☆54Updated 2 years ago
• ZichenMiao / L3Net
  ICLR 2021 (spotlight): Graph Convolution with Low-rank Learnable Local Filters
  ☆15Updated 3 years ago
• ankandrew / online-label-smoothing-pt
  Implementation of Online Label Smoothing in PyTorch
  ☆94Updated 2 years ago
• VITA-Group / Linearity-Grafting
  [ICML 2022] "Linearity Grafting: Relaxed Neuron Pruning Helps Certifiable Robustness" by Tianlong Chen*, Huan Zhang*, Zhenyu Zhang, Shiyu…
  ☆16Updated 2 years ago
• vfdev-5 / UDA-pytorch
  Unsupervised Data Augmentation experiments in PyTorch
  ☆59Updated 5 years ago
• lucidrains / learning-to-expire-pytorch
  An implementation of Transformer with Expire-Span, a circuit for learning which memories to retain
  ☆33Updated 4 years ago
• ItzikMalkiel / MTAdam
  MTAdam: Automatic Balancing of Multiple Training Loss Terms
  ☆36Updated 4 years ago
• izmailovpavel / torch_swa_examples
  ☆47Updated 3 years ago
• takashiishida / flooding
  [ICML 2020] code for the flooding regularizer proposed in "Do We Need Zero Training Loss After Achieving Zero Training Error?"
  ☆92Updated last year
• juntang-zhuang / ACProp-Optimizer
  Implementation for ACProp ( Momentum centering and asynchronous update for adaptive gradient methdos, NeurIPS 2021)
  ☆15Updated 3 years ago
• lucidrains / deep-linear-network
  A simple implementation of a deep linear Pytorch module
  ☆18Updated 4 years ago
• jaketae / g-mlp
  PyTorch implementation of Pay Attention to MLPs
  ☆39Updated 3 years ago
• minicheshire / InResNet
  Interpolation between Residual and Non-Residual Networks, ICML 2020. https://arxiv.org/abs/2006.05749
  ☆26Updated 4 years ago
• tbachlechner / ReZero-examples
  PyTorch Examples repo for "ReZero is All You Need: Fast Convergence at Large Depth"
  ☆62Updated 4 months ago
• lucidrains / remixer-pytorch
  Implementation of the Remixer Block from the Remixer paper, in Pytorch
  ☆35Updated 3 years ago
• lucidrains / axial-positional-embedding
  Axial Positional Embedding for Pytorch
  ☆60Updated 3 years ago