kpu / preprocessLinks
Corpus preprocessing
☆98Updated last year
Alternatives and similar repositories for preprocess
Users that are interested in preprocess are comparing it to the libraries listed below
Sorting:
- Efficient Markov Chain word alignment☆53Updated 4 years ago
- Examples, tutorials and use cases for Marian, including our WMT-2017/18 baselines.☆77Updated 2 years ago
- eXtensible Neural Machine Translation☆187Updated 5 years ago
- Neural macine translation soft alignment visualisations for web and command line☆72Updated 4 years ago
- ☆42Updated 7 years ago
- A word alignment tool based on famous GIZA++, extended to support multi-threading, resume training and incremental training.☆165Updated 4 years ago
- Efficient Low-Memory Aligner☆146Updated 7 months ago
- LSTM Language Model with Subword Units Input Representations☆42Updated 4 years ago
- Appraise evaluation system for manual evaluation of machine translation output☆77Updated 4 years ago
- XenC: open-source data selection tool for NLP☆64Updated 9 years ago
- ☆12Updated 9 years ago
- Supplementary material for "When and Why Are Pre-trained Word Embeddings Useful for Neural Machine Translation?" at NAACL 2018☆124Updated 5 years ago
- scripts and configuration files for Edinburgh neural MT submission to WMT 16 shared translation task☆138Updated 4 years ago
- Links to data used in Sproat & Jaitly (https://arxiv.org/abs/1611.00068) experiments.☆76Updated 4 years ago
- Tool for comparison and evaluation of machine translation.☆56Updated 3 years ago
- Bicleaner is a parallel corpus classifier/cleaner that aims at detecting noisy sentence pairs in a parallel corpus.☆158Updated last year
- A High-Quality Multilingual Dataset for Structured Documentation Translation☆36Updated 3 months ago
- Spoken Language Translation System☆13Updated 6 years ago
- ☆22Updated 5 years ago
- We release a dataset based on Wikipedia sentences and the corresponding translations in 6 different languages along with the scores (scal…☆81Updated 3 years ago
- Automatic extraction of edited sentences from text edition histories.☆83Updated 3 years ago
- ☆18Updated 7 years ago
- Translation Error Rate (TER)☆45Updated 7 years ago
- A tool that locates, downloads, and extracts machine translation corpora☆156Updated 3 months ago
- Tools for filtering and cleaning parallel and monolingual corpora for machine translation and other natural language processing tasks.☆41Updated last year
- Decoding platform for machine translation research☆55Updated 6 years ago
- Unsupervised Statistical Machine Translation☆229Updated 4 years ago
- The Fisher and CALLHOME Spanish–English Speech Translation Corpus☆40Updated 3 years ago
- Source code for the paper "Morphological Inflection Generation with Hard Monotonic Attention"☆38Updated 7 years ago
- Tools for extracting parallel corpora from article titles across languages in Wikipedia☆73Updated 10 years ago