Alternatives and similar repositories for mosestokenizer

Users that are interested in mosestokenizer are comparing it to the libraries listed below

• thompsonb / prism
  MT Evaluation in Many Languages via Zero-Shot Paraphrasing
  ☆102Updated last year
• rbawden / discourse-mt-test-sets
  ☆29Updated last year
• m-popovic / chrF
  a tool for calcualting character n-gram F score
  ☆75Updated 2 years ago
• facebookresearch / mlqe
  We release a dataset based on Wikipedia sentences and the corresponding translations in 6 different languages along with the scores (scal…
  ☆81Updated 4 years ago
• Helsinki-NLP / MuCoW
  Automatically harvested multilingual contrastive word sense disambiguation test sets for machine translation
  ☆17Updated 5 years ago
• lilt / alignment-scripts
  Scripts to preprocess training and test data and to run fast_align and giza
  ☆107Updated 4 years ago
• Helsinki-NLP / OpusFilter
  OpusFilter - Parallel corpus processing toolkit
  ☆115Updated last month
• EdinburghNLP / opus-100-corpus
  ☆94Updated last year
• mahfuzibnalam / terminology_evaluation
  ☆21Updated 3 years ago
• deep-spin / OpenNMT-APE
  ☆34Updated 5 years ago
• marzenakrp / LiteraryTranslation
  ☆24Updated last year
• danieldeutsch / sacrerouge
  SacreROUGE is a library dedicated to the use and development of text generation evaluation metrics with an emphasis on summarization.
  ☆148Updated 3 years ago
• p-lambda / swords
  The Stanford Word Substitution (Swords) Benchmark
  ☆32Updated 3 years ago
• wmt-conference / wmt21-news-systems
  ☆26Updated 3 years ago
• qiang2100 / BERT-LS
  Lexical Simplification with Pretrained Encoders
  ☆70Updated 4 years ago
• neulab / contextual-mt
  A repository with the code related to experiments around context-aware machine translation
  ☆51Updated 3 months ago
• M4t1ss / parallel-corpora-tools
  Tools for filtering and cleaning parallel and monolingual corpora for machine translation and other natural language processing tasks.
  ☆41Updated 2 years ago
• AppraiseDev / Appraise
  Appraise code used as part of WMT21 human evaluation campaign
  ☆30Updated last month
• Unbabel / MT-Telescope
  ☆34Updated 4 years ago
• sheffieldnlp / mlqe-pe
  Multilingual Quality Estimation and Automatic Post-editing Dataset
  ☆42Updated 3 years ago
• lena-voita / good-translation-wrong-in-context
  This is a repository with the data and code for the ACL 2019 paper "When a Good Translation is Wrong in Context: ..." and the EMNLP 2019 …
  ☆98Updated 5 years ago
• TharinduDR / TransQuest
  Transformer based translation quality estimation
  ☆115Updated 2 years ago
• facebookresearch / wsd-biencoders
  Experiment code for the ACL 2020 paper "Moving Down the Long Tail of Word Sense Disambiguation with Gloss Informed Bi-encoders".
  ☆53Updated 2 years ago
• chaojiang06 / wiki-auto
  Neural CRF Model for Sentence Alignment in Text Simplification
  ☆68Updated last year
• ufal / low-resource-gec-wnut2019
  Source code for paper Grammatical Error Correction in Low-Resource Scenarios (W-NUT 2019)
  ☆13Updated 3 years ago
• shijie-wu / crosslingual-nlp
  This repo supports various cross-lingual transfer learning & multilingual NLP models.
  ☆92Updated 2 years ago
• amazon-science / contrastive-controlled-mt
  Code and data for the IWSLT 2022 shared task on Formality Control for SLT
  ☆22Updated 2 years ago
• esdurmus / Wikilingua
  Multilingual abstractive summarization dataset extracted from WikiHow.
  ☆99Updated 10 months ago
• google-research-datasets / clang8
  cLang-8 is a dataset for grammatical error correction.
  ☆112Updated 3 years ago
• google-research / mt-metrics-eval
  Tools for evaluating the performance of MT metrics on data from recent WMT metrics shared tasks.
  ☆124Updated 3 months ago