google-research-datasets / indic-gen-bench
IndicGenBench is a high-quality, multilingual, multi-way parallel benchmark for evaluating Large Language Models (LLMs) on 4 user-facing generation tasks across a diverse set 29 of Indic languages covering 13 scripts and 4 language families.
☆43Updated 5 months ago
Alternatives and similar repositories for indic-gen-bench:
Users that are interested in indic-gen-bench are comparing it to the libraries listed below
- Code repository for "Introducing Airavata: Hindi Instruction-tuned LLM"☆55Updated 3 months ago
- Shoonya - Platform to Annotate and label data at scale.☆52Updated 5 months ago
- A blueprint for creating Pretraining and Fine-Tuning datasets for Indic languages☆101Updated 4 months ago
- This repository contains the code for dataset curation and finetuning of instruct variant of the Bilingual OpenHathi model. The resultin…☆23Updated last year
- A lightweight evaluation suite tailored specifically for assessing Indic LLMs across a diverse range of tasks☆32Updated 8 months ago
- A simple, consistent and extendable toolkit for IndicTrans2☆21Updated this week
- FBI: Finding Blindspots in LLM Evaluations with Interpretable Checklists☆26Updated 2 months ago
- Code Repository for the IndicXNLI paper.☆14Updated last year
- Pretraining, fine-tuning and evaluation scripts for IndicBERT-v2 and IndicXTREME☆88Updated 5 months ago
- Pre-trained, multilingual sequence-to-sequence models for Indian languages☆45Updated 2 years ago
- Repository for fine-tuning gemma models using unsloth for indic languages☆85Updated 10 months ago
- indicTranslate v1 - Machine Translation for 11 Indic languages. For latest v2, check: https://github.com/AI4Bharat/IndicTrans2☆122Updated last year
- Consists of the largest (10K) human annotated code-switched semantic parsing dataset & 170K generated utterance using the CST5 augmentati…☆37Updated 2 years ago
- Code for Multilingual Eval of Generative AI paper published at EMNLP 2023☆67Updated 11 months ago
- Scripts to convert datasets from various sources to Hugging Face Datasets.☆58Updated 2 years ago
- Repo for training MLMs, CLMs, or T5-type models on the OLM pretraining data, but it should work with any hugging face text dataset.☆93Updated 2 years ago
- Language Identification with Support for More Than 2000 Labels -- EMNLP 2023☆114Updated 2 months ago
- Using short models to classify long texts☆21Updated last year
- Description Describes the IndicNLP corpus and associated datasets☆161Updated last year
- SeeGULL is a broad-coverage stereotype dataset in English containing stereotypes about identity groups spanning 178 countries across 8 di…☆33Updated last year
- Hinglish Text Classification☆30Updated last year
- Glot500: Scaling Multilingual Corpora and Language Models to 500 Languages -- ACL 2023☆99Updated 9 months ago
- Generate large textual corpora for almost any language by crawling the web☆12Updated 11 months ago
- This repository contains datasets and code for the paper "HINT3: Raising the bar for Intent Detection in the Wild" accepted at EMNLP-2020…☆33Updated 3 years ago
- This repository contains the HiNER dataset released with our paper at LREC 2022☆15Updated last year
- Tools for managing datasets for governance and training.☆82Updated last week
- ☆15Updated 11 months ago
- ☆51Updated last year
- ☆44Updated 2 months ago
- Experiments with generating opensource language model assistants☆97Updated last year