Alternatives and similar repositories for python-bpe

Users that are interested in python-bpe are comparing it to the libraries listed below

• nyu-dl / bert-gen
  ☆324Updated 2 years ago
• glample / fastBPE
  Fast BPE
  ☆678Updated last year
• facebookresearch / unlikelihood_training
  Neural Text Generation with Unlikelihood Training
  ☆310Updated 4 years ago
• artetxem / monoses
  Unsupervised Statistical Machine Translation
  ☆230Updated 5 years ago
• neulab / compare-mt
  A tool for holistic analysis of language generations systems
  ☆471Updated 2 months ago
• mtreviso / linear-chain-crf
  Implementation of a linear-chain CRF in PyTorch
  ☆98Updated 4 years ago
• facebookresearch / MLQA
  New dataset
  ☆310Updated 4 years ago
• cbaziotis / neat-vision
  Neat (Neural Attention) Vision, is a visualization tool for the attention mechanisms of deep-learning models for Natural Language Process…
  ☆250Updated 7 years ago
• awslabs / mlm-scoring
  Python library & examples for Masked Language Model Scoring (ACL 2020)
  ☆347Updated 2 years ago
• google-research-datasets / sentence-compression
  Large corpus of uncompressed and compressed sentences from news articles.
  ☆125Updated 8 years ago
• kwonmha / bert-vocab-builder
  Builds wordpiece(subword) vocabulary compatible for Google Research's BERT
  ☆231Updated 5 years ago
• gcunhase / NLPMetrics
  Python code for various NLP metrics
  ☆169Updated 6 years ago
• chrisdonahue / ilm
  Easily fine tune GPT-2 to fill in missing text
  ☆201Updated 2 years ago
• hplt-project / sacremoses
  Python port of Moses tokenizer, truecaser and normalizer
  ☆495Updated last year
• facebookresearch / XNLI
  Evaluating Cross-lingual Sentence Representations
  ☆460Updated 4 years ago
• facebookresearch / UnsupervisedQA
  Unsupervised Question answering via Cloze Translation
  ☆218Updated 3 years ago
• facebookresearch / MLDoc
  A Corpus for Multilingual Document Classification in Eight Languages.
  ☆152Updated 3 years ago
• neulab / word-embeddings-for-nmt
  Supplementary material for "When and Why Are Pre-trained Word Embeddings Useful for Neural Machine Translation?" at NAACL 2018
  ☆123Updated 2 months ago
• simonepri / lm-scorer
  📃Language Model based sentences scoring library
  ☆308Updated 3 years ago
• salesforce / GeDi
  GeDi: Generative Discriminator Guided Sequence Generation
  ☆210Updated 5 months ago
• bheinzerling / pyrouge
  A Python wrapper for the ROUGE summarization evaluation package
  ☆249Updated 4 years ago
• richarddwang / electra_pytorch
  Pretrain and finetune ELECTRA with fastai and huggingface. (Results of the paper replicated !)
  ☆330Updated last year
• google-research-datasets / paws
  This dataset contains 108,463 human-labeled and 656k noisily labeled pairs that feature the importance of modeling structure, context, an…
  ☆561Updated 3 years ago
• FranxYao / dgm_latent_bow
  Implementation of NeurIPS 19 paper: Paraphrase Generation with Latent Bag of Words
  ☆122Updated 4 years ago
• artetxem / vecmap
  A framework to learn cross-lingual word embedding mappings
  ☆651Updated 2 years ago
• Diego999 / py-rouge
  Full Python implementation of the ROUGE metric, producing same results as in the official perl implementation.
  ☆160Updated 6 years ago
• alexandra-chron / siatl
  PyTorch source code of NAACL 2019 paper "An Embarrassingly Simple Approach for Transfer Learning from Pretrained Language Models"
  ☆96Updated 2 years ago
• shentianxiao / text-autoencoders
  ☆210Updated last year
• allenai / tpu_pretrain
  LM Pretraining with PyTorch/TPU
  ☆136Updated 6 years ago
• neulab / xnmt
  eXtensible Neural Machine Translation
  ☆185Updated 2 months ago