modernmt / DataCollection
Data collection, alignment and TAUS repository
☆23Updated 7 years ago
Alternatives and similar repositories for DataCollection:
Users that are interested in DataCollection are comparing it to the libraries listed below
- BERT models for many languages created from Wikipedia texts☆33Updated 4 years ago
- ☆42Updated 6 years ago
- Tool for comparison and evaluation of machine translation.☆56Updated 2 years ago
- Tools for extracting parallel corpora from article titles across languages in Wikipedia☆72Updated 10 years ago
- DKPro C4CorpusTools is a collection of tools for processing CommonCrawl corpus, including Creative Commons license detection, boilerplate…☆51Updated 4 years ago
- ☆12Updated 9 years ago
- Offline extractor of synchronous context-free grammars for machine translation.☆31Updated 9 years ago
- Open-source tools for morphological tagging, segmentation and stemming.☆41Updated 5 years ago
- ☆23Updated 7 years ago
- Translation Memory Open-source Purifier☆33Updated 2 years ago
- ☆21Updated 5 years ago
- MARMOT - the open source framework for feature extraction and machine learning, designed to estimate the quality of Machine Translation o…☆22Updated 7 years ago
- Project OCELoT: an Open, Collaborative Evaluation Leaderboard of Translations☆20Updated 8 months ago
- A simple Python wrapper for the ClearNLP constituents-to-dependencies converter☆10Updated 9 years ago
- OKR: A Consolidated Open Knowledge Representation for Multiple Texts☆41Updated 7 years ago
- Translation Error Rate (TER)☆43Updated 6 years ago
- Latent-variable Synchronous Context-Free Grammar Toolkit☆10Updated 10 years ago
- Machine translation for the real world☆23Updated 5 years ago
- Bilingual sengence aligner☆27Updated last year
- A visual and interactive scoring environment for machine translation systems.☆32Updated 6 years ago
- Crawling engine that crawls a set of top-level domains looking for documents in a list of languages☆10Updated last year
- A BiRNN framework implemented in Python and TensorFlow to extract parallel sentences from aligned comparable corpora.☆33Updated 6 years ago
- A simple neural truecaser written in pytorch and allennlp.☆33Updated 9 months ago
- Appraise evaluation system for manual evaluation of machine translation output☆74Updated 3 years ago
- Distributed infrastructure for Machine Translation web services (using Moses, Python, JSON-RPC/web interface)☆33Updated 3 years ago
- Neural macine translation soft alignment visualisations for web and command line☆72Updated 3 years ago
- Tool to fix bitexts and tag near-duplicates for removal☆30Updated last month
- Geometry-aware Multilingual Embeddings☆26Updated 2 years ago
- Automatic extraction of edited sentences from text edition histories.☆82Updated 3 years ago
- A High-Quality Multilingual Dataset for Structured Documentation Translation☆35Updated 8 months ago