titu1994 / keras-LAMB-Optimizer
Implementation of the LAMB optimizer for Keras from the paper "Reducing BERT Pre-Training Time from 3 Days to 76 Minutes"
☆75Updated 6 years ago
Alternatives and similar repositories for keras-LAMB-Optimizer:
Users that are interested in keras-LAMB-Optimizer are comparing it to the libraries listed below
- Adaptive embedding and softmax☆17Updated 3 years ago
- Scripts to train a bidirectional LSTM with knowledge distillation from BERT☆158Updated 5 years ago
- Implementation of ULMFit algorithm for text classification via transfer learning☆94Updated 6 years ago
- Transformer-XL with checkpoint loader☆68Updated 3 years ago
- LAMB Optimizer for Large Batch Training (TensorFlow version)☆120Updated 5 years ago
- ☆58Updated 5 years ago
- ULMFiT + Siamese Network for Sentence Vectors☆34Updated 6 years ago
- Inference with state-of-the-art models (pre-trained by LD-Net / AutoNER / VanillaNER / ...)☆115Updated 6 years ago
- Interpretable Models for NLP using PyTorch☆105Updated 7 years ago
- Simple Tensorflow Implementation of "A Structured Self-attentive Sentence Embedding" (ICLR 2017)☆91Updated 6 years ago
- PyTorch Language Model for 1-Billion Word (LM1B / GBW) Dataset☆123Updated 5 years ago
- ☆42Updated 6 years ago
- Pytorch and Torchtext implementation of Sequence to sequence☆59Updated 7 years ago
- Quasi-RNN for language modeling☆57Updated 8 years ago
- Code for my blog post☆49Updated 6 years ago
- Code for the Eager Translation Model from the paper You May Not Need Attention☆294Updated 6 years ago
- Fork of huggingface/pytorch-pretrained-BERT for BERT on STILTs☆107Updated 2 years ago
- Multilingual hierarchical attention networks toolkit☆77Updated 5 years ago
- The notes for Math, Machine Learning, Deep Learning and Research papers.☆52Updated 5 years ago
- Python way to Read/Write TFRecords☆64Updated 6 years ago
- Some frequently used NLP blocks I implemented☆226Updated 6 years ago
- Tensorflow implementation of Semi-supervised Sequence Learning (https://arxiv.org/abs/1511.01432)☆81Updated 2 years ago
- The experiment result of LSTM language models on PTB (Penn Treebank) and GBW (Google Billion Word) using AdaptiveSoftmax on TensorFlow.☆100Updated 6 years ago
- Adaptive Softmax implementation for PyTorch☆80Updated 5 years ago
- A set of simple examples ported from PyTorch for Tensorflow Eager Execution☆73Updated 6 years ago
- Python package for understanding the difficulty of text classification datasets. (in CoNNL 2018)☆63Updated 4 years ago
- Intent parsing and slot filling in PyTorch with seq2seq + attention☆159Updated 7 years ago
- ☆24Updated 7 years ago
- XLNet: fine tuning on RTX 2080 GPU - 8 GB☆154Updated 5 years ago
- RNN benchmarks of pytorch, tensorflow and theano☆89Updated 6 years ago