hplt-project / sacremoses

Related projects ⓘ

Alternatives and complementary repositories for sacremoses

• neulab / compare-mt
  A tool for holistic analysis of language generations systems
  ☆467Updated 2 years ago
• glample / fastBPE
  Fast BPE
  ☆656Updated 5 months ago
• clab / fast_align
  Simple, fast unsupervised word aligner
  ☆738Updated 2 years ago
• cisnlp / simalign
  Obtain Word Alignments using Pretrained Language Models (e.g., mBERT)
  ☆351Updated last year
• artetxem / monoses
  Unsupervised Statistical Machine Translation
  ☆228Updated 4 years ago
• neulab / awesome-align
  A neural word aligner based on multilingual BERT
  ☆328Updated 2 years ago
• artetxem / vecmap
  A framework to learn cross-lingual word embedding mappings
  ☆645Updated last year
• Unbabel / OpenKiwi
  Open-Source Machine Translation Quality Estimation in PyTorch
  ☆228Updated 2 years ago
• mjpost / sacrebleu
  Reference BLEU implementation that auto-downloads test sets and reports a version string to facilitate cross-lab comparisons
  ☆1,068Updated 3 months ago
• yannvgn / laserembeddings
  LASER multilingual sentence embeddings as a pip package
  ☆225Updated last year
• EmilStenstrom / conllu
  A CoNLL-U parser that takes a CoNLL-U formatted string and turns it into a nested python dictionary.
  ☆312Updated last month
• facebookresearch / XNLI
  Evaluating Cross-lingual Sentence Representations
  ☆442Updated 3 years ago
• bheinzerling / bpemb
  Pre-trained subword embeddings in 275 languages, based on Byte-Pair Encoding (BPE)
  ☆1,187Updated last month
• bert-nmt / bert-nmt
  ☆360Updated last year
• google-research-datasets / paws
  This dataset contains 108,463 human-labeled and 656k noisily labeled pairs that feature the importance of modeling structure, context, an…
  ☆555Updated 2 years ago
• nikitakit / self-attentive-parser
  High-accuracy NLP parser with models for 11 languages.
  ☆871Updated 2 years ago
• EdinburghNLP / nematus
  Open-Source Neural Machine Translation in Tensorflow
  ☆797Updated last year
• Hyperparticle / udify
  A single model that parses Universal Dependencies across 75 languages. Given a sentence, jointly predicts part-of-speech tags, morphology…
  ☆220Updated last year
• mandarjoshi90 / coref
  BERT for Coreference Resolution
  ☆445Updated last year
• soaxelbrooke / python-bpe
  Byte Pair Encoding for Python!
  ☆223Updated 2 years ago
• chrisjbryant / errant
  ERRor ANnotation Toolkit: Automatically extract and classify grammatical errors in parallel original and corrected sentences.
  ☆440Updated 7 months ago
• kentonl / e2e-coref
  End-to-end Neural Coreference Resolution
  ☆524Updated 2 years ago
• bitextor / bicleaner
  Bicleaner is a parallel corpus classifier/cleaner that aims at detecting noisy sentence pairs in a parallel corpus.
  ☆150Updated 5 months ago
• kwonmha / bert-vocab-builder
  Builds wordpiece(subword) vocabulary compatible for Google Research's BERT
  ☆226Updated 3 years ago
• explosion / spacy-stanza
  💥 Use the latest Stanza (StanfordNLP) research models directly in spaCy
  ☆725Updated 3 months ago
• feralvam / easse
  Easier Automatic Sentence Simplification Evaluation
  ☆159Updated last year
• fnl / syntok
  Text tokenization and sentence segmentation (segtok v2)
  ☆203Updated 2 years ago
• awasthiabhijeet / PIE
  Fast + Non-Autoregressive Grammatical Error Correction using BERT. Code and Pre-trained models for paper "Parallel Iterative Edit Models …
  ☆228Updated last year
• awslabs / mlm-scoring
  Python library & examples for Masked Language Model Scoring (ACL 2020)
  ☆336Updated last year