CyberZHG / keras-adaptive-softmaxLinks
Adaptive embedding and softmax
☆17Updated 4 years ago
Alternatives and similar repositories for keras-adaptive-softmax
Users that are interested in keras-adaptive-softmax are comparing it to the libraries listed below
Sorting:
- Implementation of the LAMB optimizer for Keras from the paper "Reducing BERT Pre-Training Time from 3 Days to 76 Minutes"☆75Updated 6 years ago
- Implementation in pytorch of SR-NMT https://arxiv.org/abs/1805.04185v1☆26Updated 7 years ago
- Reproducing Character-Level-Language-Modeling with Deeper Self-Attention in PyTorch☆62Updated 7 years ago
- Transformer-XL with checkpoint loader☆68Updated 4 years ago
- Quasi-RNN for language modeling☆57Updated 8 years ago
- ☆27Updated 7 years ago
- a Pytorch implementation of the Reformer Network (https://openreview.net/pdf?id=rkgNKkHtvB)☆53Updated 3 years ago
- Source code for "Training Generative Adversarial Networks Via Turing Test".☆13Updated 5 years ago
- MT Tutorial for the JSALT 2019 Summer School☆48Updated 6 years ago
- Machine-generated summaries and highlights of the every accepted paper at Thirty-second Conference on Neural Information Processing Syste…☆71Updated 7 years ago
- Knowledge Distillation For Transformer Language Models☆54Updated 2 years ago
- CapsNet for NLP☆66Updated 7 years ago
- ☆47Updated 6 years ago
- Language Model Fine-tuning for Moby Dick☆42Updated 6 years ago
- Adaptive Softmax implementation for PyTorch☆81Updated 6 years ago
- RAdam optimizer for keras☆71Updated 6 years ago
- Scripts to train a bidirectional LSTM with knowledge distillation from BERT☆159Updated 6 years ago
- Keras implementation of “Gated Linear Unit ”☆23Updated last year
- ☆42Updated 7 years ago
- PyTorch implementation of Transformer-based Neural Machine Translation☆78Updated 3 years ago
- Linear chain conditional random fields are implemented using Numpy and Mxnet/Gluon, and batch training is supported, not limited to train…☆22Updated 6 years ago
- Ordered Neurons LSTM☆30Updated 4 years ago
- Universal segmenter based on the Universal Dependency framework, written by Y. Shao, Uppsala University☆34Updated 6 years ago
- Uncovering divergent linguistic information in word embeddings with lessons for intrinsic and extrinsic evaluation☆63Updated 7 years ago
- LAMB Optimizer for Large Batch Training (TensorFlow version)☆121Updated 6 years ago
- LM, ULMFit et al.☆46Updated 6 years ago
- ☆31Updated 6 years ago
- Multilingual hierarchical attention networks toolkit☆78Updated 6 years ago
- souce code for "Accelerating Neural Transformer via an Average Attention Network"☆78Updated 6 years ago
- Efficient Transformers for research, PyTorch and Tensorflow using Locality Sensitive Hashing☆96Updated 6 years ago