CyberZHG / keras-adaptive-softmaxLinks
Adaptive embedding and softmax
☆17Updated 3 years ago
Alternatives and similar repositories for keras-adaptive-softmax
Users that are interested in keras-adaptive-softmax are comparing it to the libraries listed below
Sorting:
- Transformer-XL with checkpoint loader☆68Updated 3 years ago
- Reproducing Character-Level-Language-Modeling with Deeper Self-Attention in PyTorch☆61Updated 6 years ago
- Quasi-RNN for language modeling☆57Updated 8 years ago
- Keras implementation of “Gated Linear Unit ”☆23Updated last year
- Implementation of the LAMB optimizer for Keras from the paper "Reducing BERT Pre-Training Time from 3 Days to 76 Minutes"☆75Updated 6 years ago
- ☆27Updated 6 years ago
- Efficient Transformers for research, PyTorch and Tensorflow using Locality Sensitive Hashing☆95Updated 5 years ago
- RAdam optimizer for keras☆71Updated 5 years ago
- a Pytorch implementation of the Reformer Network (https://openreview.net/pdf?id=rkgNKkHtvB)☆53Updated 2 years ago
- Position embedding layers in Keras☆58Updated 3 years ago
- Ordered Neurons LSTM☆30Updated 3 years ago
- Implementation in pytorch of SR-NMT https://arxiv.org/abs/1805.04185v1☆26Updated 7 years ago
- CapsNet for NLP☆67Updated 6 years ago
- ☆47Updated 6 years ago
- Knowledge Distillation For Transformer Language Models☆52Updated last year
- Source code for "Training Generative Adversarial Networks Via Turing Test".☆13Updated 5 years ago
- BERT Extension in TensorFlow☆30Updated 5 years ago
- A Tensorflow implementation of Yin Wenpeng's recent paper on TACL "Attentive Convolution"☆33Updated 7 years ago
- ☆42Updated 6 years ago
- The experiment result of LSTM language models on PTB (Penn Treebank) and GBW (Google Billion Word) using AdaptiveSoftmax on TensorFlow.☆100Updated 6 years ago
- Multilingual hierarchical attention networks toolkit☆77Updated 5 years ago
- Scripts to train a bidirectional LSTM with knowledge distillation from BERT☆158Updated 5 years ago
- Language Model Fine-tuning for Moby Dick☆42Updated 6 years ago
- Machine-generated summaries and highlights of the every accepted paper at Thirty-second Conference on Neural Information Processing Syste…☆71Updated 6 years ago
- LAMB Optimizer for Large Batch Training (TensorFlow version)☆120Updated 5 years ago
- fairseq: Convolutional Sequence to Sequence Learning (Gehring et al. 2017) by Chainer☆67Updated 8 years ago
- An Open-source Neural Hierarchical Multi-label Text Classification Toolkit☆78Updated 6 years ago
- MT Tutorial for the JSALT 2019 Summer School☆48Updated 6 years ago
- souce code for "Accelerating Neural Transformer via an Average Attention Network"☆78Updated 6 years ago
- Universal segmenter based on the Universal Dependency framework, written by Y. Shao, Uppsala University☆34Updated 6 years ago