Alternatives and similar repositories for mosestokenizer

Users that are interested in mosestokenizer are comparing it to the libraries listed below

• thompsonb / prism
  MT Evaluation in Many Languages via Zero-Shot Paraphrasing
  ☆102Updated last year
• rbawden / discourse-mt-test-sets
  ☆28Updated last year
• facebookresearch / mlqe
  We release a dataset based on Wikipedia sentences and the corresponding translations in 6 different languages along with the scores (scal…
  ☆81Updated 4 years ago
• marzenakrp / LiteraryTranslation
  ☆24Updated last year
• Helsinki-NLP / OpusFilter
  OpusFilter - Parallel corpus processing toolkit
  ☆110Updated last week
• m-popovic / chrF
  a tool for calcualting character n-gram F score
  ☆74Updated 2 years ago
• TharinduDR / TransQuest
  Transformer based translation quality estimation
  ☆113Updated 2 years ago
• lilt / alignment-scripts
  Scripts to preprocess training and test data and to run fast_align and giza
  ☆108Updated 3 years ago
• wmt-conference / wmt21-news-systems
  ☆25Updated 2 years ago
• EdinburghNLP / opus-100-corpus
  ☆94Updated last year
• p-lambda / swords
  The Stanford Word Substitution (Swords) Benchmark
  ☆32Updated 3 years ago
• amazon-science / contrastive-controlled-mt
  Code and data for the IWSLT 2022 shared task on Formality Control for SLT
  ☆21Updated 2 years ago
• danieldeutsch / sacrerouge
  SacreROUGE is a library dedicated to the use and development of text generation evaluation metrics with an emphasis on summarization.
  ☆145Updated 2 years ago
• ZurichNLP / nmtscore
  A library of translation-based text similarity measures
  ☆25Updated last year
• mahfuzibnalam / terminology_evaluation
  ☆21Updated 3 years ago
• neulab / contextual-mt
  A repository with the code related to experiments around context-aware machine translation
  ☆51Updated 3 weeks ago
• shijie-wu / crosslingual-nlp
  This repo supports various cross-lingual transfer learning & multilingual NLP models.
  ☆92Updated 2 years ago
• Helsinki-NLP / MuCoW
  Automatically harvested multilingual contrastive word sense disambiguation test sets for machine translation
  ☆17Updated 4 years ago
• qiang2100 / BERT-LS
  Lexical Simplification with Pretrained Encoders
  ☆70Updated 4 years ago
• ShannonAI / fast-knn-nmt
  ☆33Updated 4 years ago
• deep-spin / OpenNMT-APE
  ☆34Updated 4 years ago
• sheffieldnlp / mlqe-pe
  Multilingual Quality Estimation and Automatic Post-editing Dataset
  ☆42Updated 3 years ago
• kb-labb / kb_bart
  Pretraining scripts for BART transformer model
  ☆12Updated 2 years ago
• AIPHES / emnlp19-moverscore
  MoverScore: Text Generation Evaluating with Contextualized Embeddings and Earth Mover Distance
  ☆209Updated last year
• AkariAsai / XORQA
  This is the official repository for NAACL 2021, "XOR QA: Cross-lingual Open-Retrieval Question Answering".
  ☆80Updated 4 years ago
• M4t1ss / parallel-corpora-tools
  Tools for filtering and cleaning parallel and monolingual corpora for machine translation and other natural language processing tasks.
  ☆41Updated last year
• chaojiang06 / wiki-auto
  Neural CRF Model for Sentence Alignment in Text Simplification
  ☆68Updated 8 months ago
• facebookresearch / access
  Code to reproduce the experiments from the paper.
  ☆101Updated 2 years ago
• grammatical / coling2020-tutorial
  This repository contains materials for our tutorial on automatic grammatical error correction: R. Grundkiewicz, C. Bryant, M. Felice: A C…
  ☆38Updated 4 years ago
• sebastianruder / emnlp2021-multiqa-tutorial
  EMNLP 2021 Tutorial: Multi-Domain Multilingual Question Answering
  ☆38Updated 3 years ago