Alternatives and similar repositories for mosestokenizer:

Users that are interested in mosestokenizer are comparing it to the libraries listed below

• ufal / low-resource-gec-wnut2019
  Source code for paper Grammatical Error Correction in Low-Resource Scenarios (W-NUT 2019)
  ☆13Updated 2 years ago
• Helsinki-NLP / OpusFilter
  OpusFilter - Parallel corpus processing toolkit
  ☆104Updated this week
• cindyxinyiwang / expand-via-lexicon-based-adaptation
  Code for ACL 2022 paper "Expanding Pretrained Models to Thousands More Languages via Lexicon-based Adaptation"
  ☆30Updated 2 years ago
• mayhewsw / multilingual-data-stats
  Statistics on multilingual datasets
  ☆17Updated 2 years ago
• amazon-science / contrastive-controlled-mt
  Code and data for the IWSLT 2022 shared task on Formality Control for SLT
  ☆21Updated last year
• kb-labb / kb_bart
  Pretraining scripts for BART transformer model
  ☆11Updated last year
• facebookresearch / mlqe
  We release a dataset based on Wikipedia sentences and the corresponding translations in 6 different languages along with the scores (scal…
  ☆81Updated 3 years ago
• m-popovic / chrF
  a tool for calcualting character n-gram F score
  ☆68Updated last year
• wmt-conference / wmt21-news-systems
  ☆24Updated 2 years ago
• cambridgeltl / xcopa
  XCOPA: A Multilingual Dataset for Causal Commonsense Reasoning
  ☆101Updated 3 years ago
• rbawden / discourse-mt-test-sets
  ☆28Updated 7 months ago
• ZurichNLP / nmtscore
  A library of translation-based text similarity measures
  ☆25Updated last year
• facebookresearch / wsd-biencoders
  Experiment code for the ACL 2020 paper "Moving Down the Long Tail of Word Sense Disambiguation with Gloss Informed Bi-encoders".
  ☆52Updated last year
• ahmetustun / udapter
  UDapter is a multilingual dependency parser that uses "contextual" adapters together with language-typology features for language-specifi…
  ☆30Updated 2 years ago
• neulab / contextual-mt
  A repository with the code related to experiments around context-aware machine translation
  ☆47Updated 2 years ago
• raymondhs / constrained-levt
  Lexically Constrained Neural Machine Translation with Levenshtein Transformer
  ☆39Updated 4 years ago
• Unbabel / word-level-qe-corpus-builder
  Builds a WMT18-like corpus for word-level QE with annotations in the source and target words.
  ☆10Updated 2 years ago
• thompsonb / prism
  MT Evaluation in Many Languages via Zero-Shot Paraphrasing
  ☆102Updated 5 months ago
• facebookresearch / asset
  A Dataset for Tuning and Evaluation of Sentence Simplification Models with Multiple Rewriting Transformations
  ☆54Updated 2 years ago
• AkariAsai / XORQA
  This is the official repository for NAACL 2021, "XOR QA: Cross-lingual Open-Retrieval Question Answering".
  ☆79Updated 3 years ago
• Helsinki-NLP / MuCoW
  Automatically harvested multilingual contrastive word sense disambiguation test sets for machine translation
  ☆17Updated 4 years ago
• AIPHES / DiscoScore
  DiscoScore: Evaluating Text Generation with BERT and Discourse Coherence
  ☆35Updated last year
• SimonHFL / CWEB
  ☆16Updated 4 years ago
• mahfuzibnalam / terminology_evaluation
  ☆21Updated 2 years ago
• sheffieldnlp / deepQuest
  Framework for neural-based Quality Estimation
  ☆42Updated 4 years ago
• p-lambda / swords
  The Stanford Word Substitution (Swords) Benchmark
  ☆31Updated 2 years ago
• Yao-Dou / LENS
  ☆21Updated 8 months ago
• SapienzaNLP / xl-amr
  XL-AMR is a sequence-to-graph cross-lingual AMR parser that exploits transfer learning (EMNLP2020).
  ☆16Updated 5 months ago
• sebastianruder / emnlp2021-multiqa-tutorial
  EMNLP 2021 Tutorial: Multi-Domain Multilingual Question Answering
  ☆38Updated 3 years ago
• deep-spin / OpenNMT-APE
  ☆33Updated 4 years ago