soaxelbrooke / python-bpeLinks
Byte Pair Encoding for Python!
☆229Updated 2 years ago
Alternatives and similar repositories for python-bpe
Users that are interested in python-bpe are comparing it to the libraries listed below
Sorting:
- Neural Text Generation with Unlikelihood Training☆309Updated 3 years ago
- ☆323Updated 2 years ago
- A tool for holistic analysis of language generations systems☆468Updated 3 years ago
- Unsupervised Statistical Machine Translation☆229Updated 4 years ago
- Fast BPE☆670Updated last year
- New dataset☆305Updated 3 years ago
- Neat (Neural Attention) Vision, is a visualization tool for the attention mechanisms of deep-learning models for Natural Language Process…☆251Updated 7 years ago
- Python code for various NLP metrics☆167Updated 5 years ago
- A Corpus for Multilingual Document Classification in Eight Languages.☆151Updated 3 years ago
- Pretrain and finetune ELECTRA with fastai and huggingface. (Results of the paper replicated !)☆330Updated last year
- Python library & examples for Masked Language Model Scoring (ACL 2020)☆343Updated 2 years ago
- Easily fine tune GPT-2 to fill in missing text☆200Updated 2 years ago
- Builds wordpiece(subword) vocabulary compatible for Google Research's BERT☆229Updated 4 years ago
- GeDi: Generative Discriminator Guided Sequence Generation☆211Updated 3 weeks ago
- Implementation of a linear-chain CRF in PyTorch☆97Updated 4 years ago
- SentAugment is a data augmentation technique for NLP that retrieves similar sentences from a large bank of sentences. It can be used in c…☆361Updated 3 years ago
- Open-Source Machine Translation Quality Estimation in PyTorch☆231Updated 3 years ago
- Python port of Moses tokenizer, truecaser and normalizer☆495Updated last year
- Unsupervised Question answering via Cloze Translation☆219Updated 3 years ago
- Implementation of NeurIPS 19 paper: Paraphrase Generation with Latent Bag of Words☆122Updated 3 years ago
- ☆208Updated last year
- 📃Language Model based sentences scoring library☆308Updated 3 years ago
- LASER multilingual sentence embeddings as a pip package☆224Updated last year
- This is a repository with the data and code for the ACL 2019 paper "When a Good Translation is Wrong in Context: ..." and the EMNLP 2019 …☆97Updated 5 years ago
- A framework to learn cross-lingual word embedding mappings☆647Updated 2 years ago
- Large corpus of uncompressed and compressed sentences from news articles.☆123Updated 8 years ago
- Variational Methods for Pretraining in Resource-limited Environments☆174Updated 4 years ago
- Full Python implementation of the ROUGE metric, producing same results as in the official perl implementation.☆159Updated 6 years ago
- LM Pretraining with PyTorch/TPU☆134Updated 5 years ago
- DRESS simplification model (EMNLP 2017) described in http://aclweb.org/anthology/D/D17/D17-1062.pdf☆155Updated 3 years ago