soaxelbrooke / python-bpe
Byte Pair Encoding for Python!
☆228Updated 2 years ago
Alternatives and similar repositories for python-bpe
Users that are interested in python-bpe are comparing it to the libraries listed below
Sorting:
- Fast BPE☆671Updated 10 months ago
- Neural Text Generation with Unlikelihood Training☆309Updated 3 years ago
- Easily fine tune GPT-2 to fill in missing text☆199Updated 2 years ago
- ☆322Updated 2 years ago
- Builds wordpiece(subword) vocabulary compatible for Google Research's BERT☆229Updated 4 years ago
- Unsupervised Statistical Machine Translation☆229Updated 4 years ago
- Python library & examples for Masked Language Model Scoring (ACL 2020)☆342Updated 2 years ago
- A tool for holistic analysis of language generations systems☆468Updated 3 years ago
- A masked language modeling objective to train a model to predict any subset of the target words, conditioned on both the input text and a…☆242Updated 3 years ago
- GeDi: Generative Discriminator Guided Sequence Generation☆209Updated 2 years ago
- Neat (Neural Attention) Vision, is a visualization tool for the attention mechanisms of deep-learning models for Natural Language Process…☆250Updated 7 years ago
- Pytorch implementation of "A Probabilistic Formulation of Unsupervised Text Style Transfer" by He. et. al. at ICLR 2020☆163Updated 2 years ago
- Easy to use NLP library built on PyTorch and TorchText☆255Updated 5 years ago
- Fully batched seq2seq example based on practical-pytorch, and more extra features.☆76Updated 7 years ago
- Pretrain and finetune ELECTRA with fastai and huggingface. (Results of the paper replicated !)☆328Updated last year
- On the Stability of Fine-tuning BERT: Misconceptions, Explanations, and Strong Baselines☆136Updated last year
- Full Python implementation of the ROUGE metric, producing same results as in the official perl implementation.☆158Updated 5 years ago
- Python port of Moses tokenizer, truecaser and normalizer☆495Updated 11 months ago
- Implementation of a linear-chain CRF in PyTorch☆96Updated 4 years ago
- Pytorch Implementation of ALBERT(A Lite BERT for Self-supervised Learning of Language Representations)☆226Updated 4 years ago
- Implementation of NeurIPS 19 paper: Paraphrase Generation with Latent Bag of Words☆122Updated 3 years ago
- This is a repository with the data and code for the ACL 2019 paper "When a Good Translation is Wrong in Context: ..." and the EMNLP 2019 …☆97Updated 5 years ago
- ☆218Updated 4 years ago
- New dataset☆304Updated 3 years ago
- Calculating ROUGE score between two files (line-by-line)☆192Updated 3 years ago
- PyTorch Implementation of "Non-Autoregressive Neural Machine Translation"☆269Updated 3 years ago
- An efficient implementation of the popular sequence models for text generation, summarization, and translation tasks. https://arxiv.org/p…☆433Updated 2 years ago
- eXtensible Neural Machine Translation☆186Updated 5 years ago
- Codebase for testing whether hidden states of neural networks encode discrete structures.☆391Updated last year
- Fast + Non-Autoregressive Grammatical Error Correction using BERT. Code and Pre-trained models for paper "Parallel Iterative Edit Models …☆230Updated 2 years ago