titu1994 / keras-LAMB-OptimizerLinks
Implementation of the LAMB optimizer for Keras from the paper "Reducing BERT Pre-Training Time from 3 Days to 76 Minutes"
☆75Updated 6 years ago
Alternatives and similar repositories for keras-LAMB-Optimizer
Users that are interested in keras-LAMB-Optimizer are comparing it to the libraries listed below
Sorting:
- Adaptive embedding and softmax☆17Updated 3 years ago
- ☆58Updated 6 years ago
- Code for the Eager Translation Model from the paper You May Not Need Attention☆295Updated 6 years ago
- Scripts to train a bidirectional LSTM with knowledge distillation from BERT☆159Updated 6 years ago
- RNN benchmarks of pytorch, tensorflow and theano☆89Updated 7 years ago
- AdaBound optimizer in Keras☆56Updated 5 years ago
- Implementation of ULMFit algorithm for text classification via transfer learning☆94Updated 6 years ago
- LAMB Optimizer for Large Batch Training (TensorFlow version)☆121Updated 5 years ago
- Corrupted labels and label smoothing☆129Updated 8 years ago
- Simple Tensorflow implementation of "On The Variance Of The Adaptive Learning Rate And Beyond"☆97Updated 5 years ago
- Lookahead mechanism for optimizers in Keras.☆50Updated 4 years ago
- Efficient Transformers for research, PyTorch and Tensorflow using Locality Sensitive Hashing☆95Updated 5 years ago
- Training Transformer-XL on 128 GPUs☆141Updated 5 years ago
- AdamW optimizer for Keras☆115Updated 6 years ago
- Transformer-XL with checkpoint loader☆68Updated 3 years ago
- Provides a systematic and extensible way to build, train, evaluate, and tune deep learning models using PyTorch.☆95Updated last year
- PyTorch implementation of StarSpace as described in "StarSpace: Embed All The Things!" by Ledell Wu, Adam Fisch, Sumit Chopra, Keith Adam…☆52Updated 7 years ago
- The notes for Math, Machine Learning, Deep Learning and Research papers.☆51Updated 6 years ago
- Adaptive Softmax implementation for PyTorch☆81Updated 6 years ago
- Some frequently used NLP blocks I implemented☆226Updated 6 years ago
- Sentiment analysis with variable length sequences in pytorch☆34Updated 6 years ago
- Collection of TensorFlow Examples☆37Updated 7 years ago
- Machine-generated summaries and highlights of the every accepted paper at Thirty-second Conference on Neural Information Processing Syste…☆71Updated 6 years ago
- Load GPT-2 checkpoint and generate texts☆127Updated 3 years ago
- Python package for understanding the difficulty of text classification datasets. (in CoNNL 2018)☆64Updated 4 years ago
- a simple message reply suggestion system☆78Updated 6 years ago
- LM, ULMFit et al.☆46Updated 5 years ago
- Reproducing Character-Level-Language-Modeling with Deeper Self-Attention in PyTorch☆62Updated 6 years ago
- ☆27Updated 7 years ago
- A Tensorflow implementation of Yin Wenpeng's recent paper on TACL "Attentive Convolution"☆33Updated 7 years ago