soaxelbrooke / python-bpeLinks
Byte Pair Encoding for Python!
☆230Updated 2 years ago
Alternatives and similar repositories for python-bpe
Users that are interested in python-bpe are comparing it to the libraries listed below
Sorting:
- ☆323Updated 2 years ago
- Neural Text Generation with Unlikelihood Training☆309Updated 3 years ago
- Fast BPE☆670Updated last year
- Unsupervised Statistical Machine Translation☆229Updated 4 years ago
- New dataset☆306Updated 3 years ago
- Python library & examples for Masked Language Model Scoring (ACL 2020)☆344Updated 2 years ago
- A tool for holistic analysis of language generations systems☆471Updated 3 years ago
- Implementation of a linear-chain CRF in PyTorch☆97Updated 4 years ago
- Python code for various NLP metrics☆168Updated 5 years ago
- Neat (Neural Attention) Vision, is a visualization tool for the attention mechanisms of deep-learning models for Natural Language Process…☆251Updated 7 years ago
- Python port of Moses tokenizer, truecaser and normalizer☆495Updated last year
- Easily fine tune GPT-2 to fill in missing text☆201Updated 2 years ago
- Large corpus of uncompressed and compressed sentences from news articles.☆123Updated 8 years ago
- A Corpus for Multilingual Document Classification in Eight Languages.☆151Updated 3 years ago
- Easy to use NLP library built on PyTorch and TorchText☆255Updated 5 years ago
- Implementation of NeurIPS 19 paper: Paraphrase Generation with Latent Bag of Words☆122Updated 3 years ago
- Fully batched seq2seq example based on practical-pytorch, and more extra features.☆76Updated 7 years ago
- A Python wrapper for the ROUGE summarization evaluation package☆249Updated 4 years ago
- Unsupervised Question answering via Cloze Translation☆219Updated 3 years ago
- A framework to learn cross-lingual word embedding mappings☆648Updated 2 years ago
- Supplementary material for "When and Why Are Pre-trained Word Embeddings Useful for Neural Machine Translation?" at NAACL 2018☆124Updated 5 years ago
- LASER multilingual sentence embeddings as a pip package☆224Updated last year
- Neural models and instructions on how to reproduce our results for our neural grammatical error correction systems from M. Junczys-Dowmun…☆88Updated 6 years ago
- eXtensible Neural Machine Translation☆187Updated 5 years ago
- On the Stability of Fine-tuning BERT: Misconceptions, Explanations, and Strong Baselines☆136Updated last year
- A masked language modeling objective to train a model to predict any subset of the target words, conditioned on both the input text and a…☆244Updated 3 years ago
- Code to reproduce the experiments from the paper.☆101Updated last year
- Full Python implementation of the ROUGE metric, producing same results as in the official perl implementation.☆159Updated 6 years ago
- GeDi: Generative Discriminator Guided Sequence Generation☆211Updated last month
- ☆467Updated 4 years ago