Alternatives and similar repositories for preprocess:

Users that are interested in preprocess are comparing it to the libraries listed below

• hainan-xv / zipporah
  ☆42Updated 6 years ago
• cfedermann / Appraise
  Appraise evaluation system for manual evaluation of machine translation output
  ☆74Updated 3 years ago
• marian-nmt / marian-examples
  Examples, tutorials and use cases for Marian, including our WMT-2017/18 baselines.
  ☆76Updated last year
• M4t1ss / SoftAlignments
  Neural macine translation soft alignment visualisations for web and command line
  ☆72Updated 3 years ago
• robertostling / eflomal
  Efficient Low-Memory Aligner
  ☆140Updated 2 weeks ago
• robertostling / efmaral
  Efficient Markov Chain word alignment
  ☆53Updated 3 years ago
• antho-rousseau / XenC
  XenC: open-source data selection tool for NLP
  ☆60Updated 8 years ago
• neulab / xnmt
  eXtensible Neural Machine Translation
  ☆185Updated 4 years ago
• ondrejklejch / MT-ComparEval
  Tool for comparison and evaluation of machine translation.
  ☆56Updated 2 years ago
• rsennrich / lingeval97
  ☆18Updated 7 years ago
• ucam-smt / sgnmt
  Decoding platform for machine translation research
  ☆54Updated 5 years ago
• roeeaharoni / morphological-reinflection
  Source code for the paper "Morphological Inflection Generation with Hard Monotonic Attention"
  ☆38Updated 6 years ago
• amittai / cynical
  Cynical data selection
  ☆20Updated 4 years ago
• facebookresearch / mlqe
  We release a dataset based on Wikipedia sentences and the corresponding translations in 6 different languages along with the scores (scal…
  ☆81Updated 3 years ago
• moses-smt / mgiza
  A word alignment tool based on famous GIZA++, extended to support multi-threading, resume training and incremental training.
  ☆161Updated 3 years ago
• odashi / mteval
  Collection of Evaluation Metrics and Algorithms for Machine Translation
  ☆76Updated 6 years ago
• jhclark / tercom
  Translation Error Rate (TER)
  ☆43Updated 6 years ago
• jniehues-kit / SLT.KIT
  Spoken Language Translation System
  ☆14Updated 5 years ago
• claravania / subword-lstm-lm
  LSTM Language Model with Subword Units Input Representations
  ☆42Updated 3 years ago
• lilt / alignment-scripts
  Scripts to preprocess training and test data and to run fast_align and giza
  ☆108Updated 3 years ago
• clab / wikipedia-parallel-titles
  Tools for extracting parallel corpora from article titles across languages in Wikipedia
  ☆72Updated 9 years ago
• joshua-decoder / fisher-callhome-corpus
  The Fisher and CALLHOME Spanish–English Speech Translation Corpus
  ☆39Updated 2 years ago
• salesforce / localization-xml-mt
  A High-Quality Multilingual Dataset for Structured Documentation Translation
  ☆35Updated 6 months ago
• transducens / LASERtrain
  ☆21Updated 5 years ago
• rwsproat / text-normalization-data
  Links to data used in Sproat & Jaitly (https://arxiv.org/abs/1611.00068) experiments.
  ☆76Updated 3 years ago
• snukky / wikiedits
  Automatic extraction of edited sentences from text edition histories.
  ☆82Updated 2 years ago
• kevinduh / sockeye-recipes
  Training scripts and recipes for Sockeye Neural Machine Translation toolkit
  ☆37Updated 5 years ago
• rsennrich / wmt16-scripts
  scripts and configuration files for Edinburgh neural MT submission to WMT 16 shared translation task
  ☆138Updated 4 years ago
• bitextor / bicleaner
  Bicleaner is a parallel corpus classifier/cleaner that aims at detecting noisy sentence pairs in a parallel corpus.
  ☆152Updated 7 months ago
• neulab / word-embeddings-for-nmt
  Supplementary material for "When and Why Are Pre-trained Word Embeddings Useful for Neural Machine Translation?" at NAACL 2018
  ☆121Updated 4 years ago