modernmt / DataCollection
Data collection, alignment and TAUS repository
☆23Updated 7 years ago
Alternatives and similar repositories for DataCollection
Users that are interested in DataCollection are comparing it to the libraries listed below
Sorting:
- ☆42Updated 6 years ago
- ☆23Updated 7 years ago
- A simple neural truecaser written in pytorch and allennlp.☆33Updated 10 months ago
- Tool for comparison and evaluation of machine translation.☆56Updated 2 years ago
- BERT models for many languages created from Wikipedia texts☆33Updated 4 years ago
- Multilingual NLP annotation projection☆51Updated 2 years ago
- Tools for extracting parallel corpora from article titles across languages in Wikipedia☆73Updated 10 years ago
- ☆12Updated 9 years ago
- Open-source tools for morphological tagging, segmentation and stemming.☆40Updated 5 years ago
- Crawling engine that crawls a set of top-level domains looking for documents in a list of languages☆10Updated last year
- Tool for manual evaluation of parallel sentences.☆14Updated last month
- Microsoft Speech Language Translation (MSLT) Corpus☆19Updated 7 years ago
- Tool to fix bitexts and tag near-duplicates for removal☆30Updated 3 months ago
- ☆64Updated 2 years ago
- KenLM extension for spaCy 2.0.☆16Updated 7 years ago
- Appraise evaluation system for manual evaluation of machine translation output☆74Updated 4 years ago
- Symmetrized word alignment models, based on mgizapp and GIZA++☆14Updated 10 years ago
- ☆21Updated 5 years ago
- Normalizes lexically ill-formed text to its most likely clean text, e.g. "c u thr 2nite!" -> "see you there tonight!".☆63Updated 9 years ago
- Transform TMX to text☆28Updated 2 years ago
- Python interface for converting Penn Treebank trees to Stanford Dependencies and Universal Depenencies☆70Updated 6 years ago
- An easy-to-use library to linguistically compare one sentence and its words to another, in the same language or a different one. For inst…☆22Updated 3 years ago
- Neural macine translation soft alignment visualisations for web and command line☆72Updated 3 years ago
- Cynical data selection☆20Updated 4 years ago
- Distributed infrastructure for Machine Translation web services (using Moses, Python, JSON-RPC/web interface)☆33Updated 3 years ago
- Efficient Markov Chain word alignment☆53Updated 3 years ago
- Thot toolkit for statistical machine translation☆53Updated 2 years ago
- OKR: A Consolidated Open Knowledge Representation for Multiple Texts☆41Updated 7 years ago
- Translation Memory Open-source Purifier☆34Updated 2 years ago
- Bilingual sengence aligner☆27Updated last year