MarsPanther / crawl-for-parallel-corpora
simple bs4 based web crawl for a corpus in need of statistical machine translation
☆13Updated 3 years ago
Alternatives and similar repositories for crawl-for-parallel-corpora:
Users that are interested in crawl-for-parallel-corpora are comparing it to the libraries listed below
- Morphological processing for languages of the Horn of Africa☆45Updated 3 months ago
- Different semantic models for Amharic☆19Updated last year
- ☆15Updated 5 years ago
- Amharic English Machine Translation Corpus prepared through website crawelling and custom preprocessing.☆43Updated 6 years ago
- Machine translation (MT) benchmark dataset for languages in the Horn of Africa.☆39Updated 2 years ago
- Natural Language Processing in Ethiopian Languages: Current State, Challenges, and Opportunities☆13Updated 2 years ago
- Indian Language Tagger and Chunker (Hindi, Telugu, Tamil, Marathi, Punjabi, Kanada, Malayalam, Urdu, Bengali)☆41Updated 2 years ago
- A comprehensive list of Hebrew NLP resources.☆273Updated 2 months ago
- A list of resources for conservation, development, and documentation of endangered, minority, and low or under-resourced human languages.☆34Updated last year
- Resources to go with the Indic NLP Library☆73Updated 2 years ago
- Codebase for Indic-Transliteration using Seq2Seq RNN. For latest repo with Transformer-based models, check: https://github.com/AI4Bharat/…☆60Updated 3 years ago
- ☆14Updated 4 years ago
- Amharic/Tigrinya/Oromo Dictionaries☆38Updated last year
- An NLP pipeline for Hebrew☆37Updated last month
- Hebrew word lists☆43Updated 5 months ago
- ☆64Updated 11 months ago
- Best Practices in Translation Memory Management☆45Updated 6 years ago
- A JavaScript-based converter for transliterating Amharic text into Latin characters☆19Updated 3 years ago
- Arabic named entity recognition using AnerCorp corpus (location , organisation, person, Miscellaneous Word)☆37Updated 7 years ago
- A repository for publicly/freely available Natural Language Processing (NLP) datasets for African languages.☆104Updated 11 months ago
- ☆14Updated 2 years ago
- Morphological analysis and generation of Amharic, Oromo, and Tigrinya☆11Updated 8 years ago
- The set of files used for the development of the Amharic Corpus.☆11Updated 7 years ago
- A Language-Independent Unsupervised Morphological Segmentation Framework based on Adaptor Grammars☆17Updated 10 months ago
- This is a repository of the Multi-dialect Arabic BERT model.☆38Updated 4 years ago
- Machine Translation for Africa☆288Updated 2 years ago
- Bilingual term extractor☆53Updated last year
- Code and models for "The Interplay of Variant, Size, and Task Type in Arabic Pre-trained Language Models". EACL 2021, WANLP.☆45Updated 10 months ago
- Arabic Dialects Segmenter Using Keras/BiLSTM/ChainCRF☆10Updated 4 years ago
- Lexical Data of Ge'ez Languages☆54Updated 2 years ago