Alternatives and similar repositories for mosestokenizer

Users that are interested in mosestokenizer are comparing it to the libraries listed below

• Helsinki-NLP / OpusFilter
  OpusFilter - Parallel corpus processing toolkit
  ☆105Updated 2 weeks ago
• facebookresearch / mlqe
  We release a dataset based on Wikipedia sentences and the corresponding translations in 6 different languages along with the scores (scal…
  ☆81Updated 3 years ago
• thompsonb / prism
  MT Evaluation in Many Languages via Zero-Shot Paraphrasing
  ☆101Updated 11 months ago
• EdinburghNLP / opus-100-corpus
  ☆94Updated last year
• m-popovic / chrF
  a tool for calcualting character n-gram F score
  ☆73Updated 2 years ago
• Helsinki-NLP / MuCoW
  Automatically harvested multilingual contrastive word sense disambiguation test sets for machine translation
  ☆17Updated 4 years ago
• facebookresearch / asset
  A Dataset for Tuning and Evaluation of Sentence Simplification Models with Multiple Rewriting Transformations
  ☆56Updated 2 years ago
• amazon-science / contrastive-controlled-mt
  Code and data for the IWSLT 2022 shared task on Formality Control for SLT
  ☆21Updated 2 years ago
• esdurmus / Wikilingua
  Multilingual abstractive summarization dataset extracted from WikiHow.
  ☆92Updated 4 months ago
• raymondhs / constrained-levt
  Lexically Constrained Neural Machine Translation with Levenshtein Transformer
  ☆39Updated 5 years ago
• qiang2100 / BERT-LS
  Lexical Simplification with Pretrained Encoders
  ☆70Updated 4 years ago
• p-lambda / swords
  The Stanford Word Substitution (Swords) Benchmark
  ☆32Updated 3 years ago
• rbawden / discourse-mt-test-sets
  ☆28Updated last year
• AkariAsai / XORQA
  This is the official repository for NAACL 2021, "XOR QA: Cross-lingual Open-Retrieval Question Answering".
  ☆79Updated 4 years ago
• ufal / low-resource-gec-wnut2019
  Source code for paper Grammatical Error Correction in Low-Resource Scenarios (W-NUT 2019)
  ☆13Updated 3 years ago
• lilt / alignment-scripts
  Scripts to preprocess training and test data and to run fast_align and giza
  ☆108Updated 3 years ago
• cambridgeltl / xcopa
  XCOPA: A Multilingual Dataset for Causal Commonsense Reasoning
  ☆103Updated 4 years ago
• TharinduDR / TransQuest
  Transformer based translation quality estimation
  ☆112Updated last year
• grammarly / GMEG
  GMEG
  ☆29Updated 7 months ago
• shijie-wu / crosslingual-nlp
  This repo supports various cross-lingual transfer learning & multilingual NLP models.
  ☆92Updated last year
• danieldeutsch / sacrerouge
  SacreROUGE is a library dedicated to the use and development of text generation evaluation metrics with an emphasis on summarization.
  ☆144Updated 2 years ago
• HSLCY / GlossBERT
  GlossBERT: BERT for Word Sense Disambiguation with Gloss Knowledge (EMNLP 2019)
  ☆95Updated 2 years ago
• ZurichNLP / nmtscore
  A library of translation-based text similarity measures
  ☆25Updated last year
• machamp-nlp / machamp
  Repository with code for MaChAmp: https://aclanthology.org/2021.eacl-demos.22/
  ☆87Updated last month
• norakassner / mlama
  ☆25Updated last year
• bloomberg / entsum
  Open Source / ENTSUM: A Data Set for Entity-Centric Extractive Summarization
  ☆27Updated 3 years ago
• MicrosoftTranslator / NTREX
  NTREX -- News Test References for MT Evaluation
  ☆84Updated last year
• cisnlp / parcoure
  ParCourE - Parallel Corpus Explorer
  ☆12Updated 3 years ago
• google-research / mt-metrics-eval
  Tools for evaluating the performance of MT metrics on data from recent WMT metrics shared tasks.
  ☆110Updated 4 months ago
• AIPHES / emnlp19-moverscore
  MoverScore: Text Generation Evaluating with Contextualized Embeddings and Earth Mover Distance
  ☆208Updated last year