modernmt / DataCollectionLinks
Data collection, alignment and TAUS repository
☆23Updated 7 years ago
Alternatives and similar repositories for DataCollection
Users that are interested in DataCollection are comparing it to the libraries listed below
Sorting:
- DKPro C4CorpusTools is a collection of tools for processing CommonCrawl corpus, including Creative Commons license detection, boilerplate…☆52Updated 5 years ago
- ☆42Updated 6 years ago
- ☆12Updated 9 years ago
- ☆23Updated 7 years ago
- Distributed infrastructure for Machine Translation web services (using Moses, Python, JSON-RPC/web interface)☆34Updated 3 years ago
- Translation Memory Open-source Purifier☆34Updated 2 years ago
- BERT models for many languages created from Wikipedia texts☆33Updated 5 years ago
- Offline extractor of synchronous context-free grammars for machine translation.☆31Updated 9 years ago
- Thot toolkit for statistical machine translation☆53Updated 2 years ago
- Unofficial implementation of Adaptive Input in PyTorch☆12Updated 6 years ago
- Tool for comparison and evaluation of machine translation.☆57Updated 3 years ago
- Neural macine translation soft alignment visualisations for web and command line☆72Updated 3 years ago
- Symmetrized word alignment models, based on mgizapp and GIZA++☆14Updated 11 years ago
- Cynical data selection☆20Updated 4 years ago
- numeric fused-head identification and resolution☆33Updated 5 years ago
- Translation Error Rate (TER)☆44Updated 7 years ago
- KenLM extension for spaCy 2.0.☆16Updated 7 years ago
- OpenNeuroSpell contains parts of NeuroSpell (http://neurospell.com/en.php) released as open-source. More code will be published as soon a…☆20Updated 7 months ago
- OKR: A Consolidated Open Knowledge Representation for Multiple Texts☆41Updated 7 years ago
- Crawling engine that crawls a set of top-level domains looking for documents in a list of languages☆11Updated last year
- Bilingual sengence aligner☆28Updated last year
- ☆22Updated 5 years ago
- A simple neural truecaser written in pytorch and allennlp.☆33Updated last year
- Normalizes lexically ill-formed text to its most likely clean text, e.g. "c u thr 2nite!" -> "see you there tonight!".☆63Updated 9 years ago
- Deep learning model of machine translation using attentional and structural biases☆13Updated 7 years ago
- Open-source tools for morphological tagging, segmentation and stemming.☆40Updated 5 years ago
- ☆31Updated 8 years ago
- Project OCELoT: an Open, Collaborative Evaluation Leaderboard of Translations☆20Updated this week
- Context Encoders (ConEc) as a simple but powerful extension of the word2vec model for learning word embeddings☆21Updated 5 years ago
- A discriminative syntax-based word alignment package for statistical machine translation (Migrated from http://code.google.com/p/nile)☆10Updated 10 years ago