soaxelbrooke / python-bpeLinks
Byte Pair Encoding for Python!
☆231Updated 2 years ago
Alternatives and similar repositories for python-bpe
Users that are interested in python-bpe are comparing it to the libraries listed below
Sorting:
- ☆324Updated 2 years ago
- Neural Text Generation with Unlikelihood Training☆309Updated 4 years ago
- Fast BPE☆675Updated last year
- New dataset☆306Updated 4 years ago
- Unsupervised Statistical Machine Translation☆229Updated 5 years ago
- Easily fine tune GPT-2 to fill in missing text☆201Updated 2 years ago
- Large corpus of uncompressed and compressed sentences from news articles.☆124Updated 8 years ago
- Implementation of a linear-chain CRF in PyTorch☆97Updated 4 years ago
- Python library & examples for Masked Language Model Scoring (ACL 2020)☆346Updated 2 years ago
- Supplementary material for "When and Why Are Pre-trained Word Embeddings Useful for Neural Machine Translation?" at NAACL 2018☆124Updated 5 years ago
- Neat (Neural Attention) Vision, is a visualization tool for the attention mechanisms of deep-learning models for Natural Language Process…☆251Updated 7 years ago
- A tool for holistic analysis of language generations systems☆471Updated 3 years ago
- Python port of Moses tokenizer, truecaser and normalizer☆496Updated last year
- Neural models and instructions on how to reproduce our results for our neural grammatical error correction systems from M. Junczys-Dowmun…☆88Updated 6 years ago
- Builds wordpiece(subword) vocabulary compatible for Google Research's BERT☆230Updated 4 years ago
- Neural macine translation soft alignment visualisations for web and command line☆72Updated 4 years ago
- On the Stability of Fine-tuning BERT: Misconceptions, Explanations, and Strong Baselines☆137Updated 2 years ago
- Scripts to train a bidirectional LSTM with knowledge distillation from BERT☆158Updated 5 years ago
- A Corpus for Multilingual Document Classification in Eight Languages.☆151Updated 3 years ago
- Fast + Non-Autoregressive Grammatical Error Correction using BERT. Code and Pre-trained models for paper "Parallel Iterative Edit Models …☆230Updated 2 years ago
- Implementation of NeurIPS 19 paper: Paraphrase Generation with Latent Bag of Words☆122Updated 3 years ago
- Automatic extraction of edited sentences from text edition histories.☆83Updated 3 years ago
- LM Pretraining with PyTorch/TPU☆136Updated 5 years ago
- Python code for various NLP metrics☆168Updated 5 years ago
- PyTorch source code of NAACL 2019 paper "An Embarrassingly Simple Approach for Transfer Learning from Pretrained Language Models"☆96Updated last year
- 📃Language Model based sentences scoring library☆309Updated 3 years ago
- Code to reproduce the experiments from the paper.☆101Updated last year
- Character-aware Neural Language Model implemented by PyTorch☆35Updated 7 years ago
- xfspell — the Transformer Spell Checker☆190Updated 5 years ago
- Unsupervised Question answering via Cloze Translation☆219Updated 3 years ago