google-research-datasets / dakshinaLinks
The Dakshina dataset is a collection of text in both Latin and native scripts for 12 South Asian languages. For each language, the dataset includes a large collection of native script Wikipedia text, a romanization lexicon of words in the native script with attested romanizations, and some full sentence parallel data in both a native script of t…
☆199Updated 5 years ago
Alternatives and similar repositories for dakshina
Users that are interested in dakshina are comparing it to the libraries listed below
Sorting:
- Indic-BERT-v1: BERT-based Multilingual Model for 11 Indic Languages and Indian-English. For latest Indic-BERT v2, check: https://github.c…☆287Updated 2 years ago
- Description Describes the IndicNLP corpus and associated datasets☆181Updated 2 years ago
- The project aims on adding a state-of-the-art transliteration module for cross transliterations among all Indian languages including Engl…☆271Updated 2 years ago
- indicTranslate v1 - Machine Translation for 11 Indic languages. For latest v2, check: https://github.com/AI4Bharat/IndicTrans2☆130Updated last year
- Efficient and easy to use transliteration for Indian languages☆50Updated 5 years ago
- Pre-trained, multilingual sequence-to-sequence models for Indian languages☆49Updated 3 years ago
- Fast and accurate spell correction library☆81Updated 3 years ago
- 📄 A repo containing notes and discussions for our weekly NLP/ML paper discussions.☆150Updated 5 years ago
- State of the Art Language models and Classifier for Hindi language (spoken in Indian sub-continent)☆123Updated 5 years ago
- State-Of-The-Art & ready to use mini NLP models for Indian Languages☆44Updated 4 years ago
- Python library for converting UTF to WX and vice-versa for Indian languages.☆47Updated 3 years ago
- Curated list of publicly available parallel corpus for Indian Languages☆34Updated 4 years ago
- A benchmark for code-switched NLP, ACL 2020☆75Updated last year
- Dataset of sentences from Hindi stories tagged with different emotion tags☆11Updated 5 years ago
- Codebase for Indic-Transliteration using Seq2Seq RNN. For latest repo with Transformer-based models, check: https://github.com/AI4Bharat/…☆60Updated 4 years ago
- xfspell — the Transformer Spell Checker☆190Updated 5 years ago
- A collaborative catalog of NLP resources for Indic languages☆611Updated 8 months ago
- ☆47Updated 5 years ago
- Tooling to play around with multilingual machine translation for Indian Languages.☆22Updated 3 years ago
- ☆69Updated 2 years ago
- Resources to go with the Indic NLP Library☆75Updated 3 years ago
- RoBERTa Marathi Language model trained from scratch during huggingface 🤗 x flax community week☆28Updated 4 years ago
- Indian Language Tagger and Chunker (Hindi, Telugu, Tamil, Marathi, Punjabi, Kanada, Malayalam, Urdu, Bengali)☆41Updated 2 years ago
- Create interactive textual heat maps for Jupiter notebooks☆196Updated last year
- 📰Natural language processing (NLP) newsletter☆302Updated 5 years ago
- Material for the COLING 2020 Tutorial on Multilingual NMT☆16Updated 4 years ago
- Resources and tools for Indian language Natural Language Processing☆599Updated last year
- Accelerated NLP pipelines for fast inference on CPU. Built with Transformers and ONNX runtime.☆127Updated 4 years ago
- State-of-the-Art Language Modeling and Text Classification in Hindi Language☆220Updated 6 years ago
- Some notebooks for NLP☆207Updated last year