paracrawl / corsetLinks
Corset is a web-based data selection portal that helps you getting relevant data from massive amounts of parallel data.
☆20Updated 2 years ago
Alternatives and similar repositories for corset
Users that are interested in corset are comparing it to the libraries listed below
Sorting:
- Python package for WikiMedia dump processing (Wiktionary, Wikipedia etc). Wikitext parsing, template expansion, Lua module execution. Fo…☆107Updated 2 months ago
- Bitextor generates translation memories from multilingual websites☆300Updated last year
- MorphyNet: a Large Multilingual Database of Derivational and Inflectional Morphology (+morpheme segmentation)☆54Updated 2 years ago
- Wiktra - Python tool of Wiktionary Transliteration modules for 514 languages and its 102 different scripts (orthographies)☆34Updated 7 months ago
- Sentence aligner☆124Updated 4 years ago
- Transform TMX to text☆28Updated 3 years ago
- Best Practices in Translation Memory Management☆47Updated 7 years ago
- Efficient teacher-student models and scripts to make them☆54Updated 2 years ago
- Multilingual sentence alignment using sentence embeddings☆139Updated last year
- OpusCleaner is a web interface that helps you select, clean and schedule your data for training machine translation models.☆57Updated last week
- ☆81Updated last week
- universal tokenizer☆16Updated 4 years ago
- Improved Sentence Alignment in Linear Time and Space☆188Updated 2 years ago
- Master repo for the UniMorph project, includes the UniMorph schema and annotated data files☆33Updated 6 years ago
- Python Finite-State Toolkit☆60Updated last month
- Bicleaner is a parallel corpus classifier/cleaner that aims at detecting noisy sentence pairs in a parallel corpus.☆160Updated last year
- Translation demonstrator☆37Updated 5 years ago
- OpusFilter - Parallel corpus processing toolkit☆115Updated this week
- Translation Memory Open-source Purifier☆35Updated 3 years ago
- SIGMORPHON 2022 Shared Task on Morpheme Segmentation☆31Updated 2 years ago
- Tool to fix bitexts and tag near-duplicates for removal☆34Updated 5 months ago
- Tool for manual evaluation of parallel sentences.☆15Updated 2 weeks ago
- A modern, interlingual wordnet interface for Python☆282Updated last week
- These are lists for a variety of languages containing words that are distinctive to each language.☆41Updated 3 years ago
- A tool that locates, downloads, and extracts machine translation corpora☆162Updated 4 months ago
- Efficient Low-Memory Aligner☆146Updated last year
- A multilingual parallel corpus created from translations of the Bible.☆191Updated 8 months ago
- Open information and community for machine translation☆80Updated 2 weeks ago
- ParaNames: A multilingual resource for parallel names☆39Updated last year
- Seed Machine Translation Data☆33Updated last year