uhermjakob / wildebeestLinks
Scripts investigate, repair and normalize a wide range of text file problems at the character level.
☆20Updated 2 years ago
Alternatives and similar repositories for wildebeest
Users that are interested in wildebeest are comparing it to the libraries listed below
Sorting:
- universal tokenizer☆17Updated 3 years ago
- Library and command line utility to do approximate string matching of a source against a bitext index and get matched source and target.☆52Updated 5 months ago
- Bilingual sentence similarity classifier using Tensorflow☆24Updated 6 years ago
- Translation demonstrator☆34Updated 5 years ago
- Multilingual sentence alignment using sentence embeddings☆123Updated 10 months ago
- An easy-to-use library to linguistically compare one sentence and its words to another, in the same language or a different one. For inst…☆25Updated 3 years ago
- Character-level conversion between Hebrew text and Latin transliteration using deep learning - a demonstration of seq2seq training.☆14Updated 2 years ago
- OpusCleaner is a web interface that helps you select, clean and schedule your data for training machine translation models.☆51Updated 2 months ago
- Improved Sentence Alignment in Linear Time and Space☆181Updated 2 years ago
- A set of pipelines for performing experiments on various NLP tasks with a focus on resource-poor/minority languages.☆36Updated this week
- A guide to building language technology in new languages.☆59Updated 3 years ago
- OpusFilter - Parallel corpus processing toolkit☆110Updated last month
- Efficient Low-Memory Aligner☆146Updated 8 months ago
- NTREX -- News Test References for MT Evaluation☆85Updated last year
- A tokenizer and sentence splitter for German and English web and social media texts.☆147Updated 9 months ago
- MorphyNet: a Large Multilingual Database of Derivational and Inflectional Morphology (+morpheme segmentation)☆48Updated 2 years ago
- Open information and community for machine translation☆80Updated last week
- A tool that locates, downloads, and extracts machine translation corpora☆157Updated last week
- Efficient teacher-student models and scripts to make them☆51Updated last year
- A python module for word inflections designed for use with spaCy.☆93Updated 5 years ago
- AfroLID, a powerful neural toolkit for African languages identification which covers 517 African languages.☆32Updated 6 months ago
- Transliteration data and models☆55Updated 8 years ago
- A multilingual parallel corpus created from translations of the Bible.☆186Updated 4 months ago
- Extracts plain text, language identification and more metadata from WARC records☆23Updated this week
- ☆31Updated last year
- Curated corpus of parallel data derived from versions of the Bible provided by eBible.org.☆75Updated 4 months ago
- Wiktra - Python tool of Wiktionary Transliteration modules for 514 languages and its 102 different scripts (orthographies)☆29Updated 2 months ago
- ☆49Updated last year
- Bilingual sengence aligner☆28Updated last year
- ☆24Updated 3 years ago