google-research-datasets / dakshina
The Dakshina dataset is a collection of text in both Latin and native scripts for 12 South Asian languages. For each language, the dataset includes a large collection of native script Wikipedia text, a romanization lexicon of words in the native script with attested romanizations, and some full sentence parallel data in both a native script of t…
☆190Updated 4 years ago
Related projects ⓘ
Alternatives and complementary repositories for dakshina
- Description Describes the IndicNLP corpus and associated datasets☆157Updated last year
- Indic-BERT-v1: BERT-based Multilingual Model for 11 Indic Languages and Indian-English. For latest Indic-BERT v2, check: https://github.c…☆277Updated last year
- The project aims on adding a state-of-the-art transliteration module for cross transliterations among all Indian languages including Engl…☆258Updated 2 years ago
- indicTranslate v1 - Machine Translation for 11 Indic languages. For latest v2, check: https://github.com/AI4Bharat/IndicTrans2☆120Updated 10 months ago
- State of the Art Language models and Classifier for Hindi language (spoken in Indian sub-continent)☆122Updated 4 years ago
- A benchmark for code-switched NLP, ACL 2020☆74Updated 5 months ago
- Indian Language Tagger and Chunker (Hindi, Telugu, Tamil, Marathi, Punjabi, Kanada, Malayalam, Urdu, Bengali)☆40Updated last year
- 📄 A repo containing notes and discussions for our weekly NLP/ML paper discussions.☆149Updated 4 years ago
- Codebase for Indic-Transliteration using Seq2Seq RNN. For latest repo with Transformer-based models, check: https://github.com/AI4Bharat/…☆58Updated 3 years ago
- Efficient and easy to use transliteration for Indian languages☆51Updated 4 years ago
- State of the art open-source translation for Indic languages.☆4Updated 3 years ago
- Xlit-Crowd: Hindi-English Transliteration Corpus☆37Updated 9 years ago
- ☆68Updated last year
- Pre-trained, multilingual sequence-to-sequence models for Indian languages☆45Updated 2 years ago
- Curated list of publicly available parallel corpus for Indian Languages☆30Updated 3 years ago
- Python library for converting UTF to WX and vice-versa for Indian languages.☆48Updated 2 years ago
- A collaborative catalog of NLP resources for Indic languages☆561Updated 8 months ago
- Fast and accurate spell correction library☆76Updated 2 years ago
- A Python based API to access Indian language WordNets.☆37Updated 2 years ago
- State of the Art Language models and Classifier for Tamil language (spoken in India, and few other South Asian countries)☆52Updated 4 years ago
- State-Of-The-Art & ready to use mini NLP models for Indian Languages☆44Updated 3 years ago
- This is a package in Python which implements a tokenizer, stemmer for Hindi language☆91Updated 4 years ago
- Resources and Tool for Bangla language computation☆13Updated last year
- State of the Art Language models and Classifier for Bengali, which is primarily spoken by the Bengalis in South Asia.☆30Updated 4 years ago
- Code Repository for the IndicXNLI paper.☆14Updated last year
- This repository contains datasets and code for the paper "HINT3: Raising the bar for Intent Detection in the Wild" accepted at EMNLP-2020…☆32Updated 3 years ago
- State-of-the-Art Language Modeling and Text Classification in Hindi Language☆218Updated 5 years ago
- ☆13Updated 2 years ago
- 📰Natural language processing (NLP) newsletter☆301Updated 4 years ago
- Dataset of sentences from Hindi stories tagged with different emotion tags☆10Updated 4 years ago