Alternatives and similar repositories for indic-gen-bench

Users that are interested in indic-gen-bench are comparing it to the libraries listed below

• AI4Bharat / IndicBERT
  Pretraining, fine-tuning and evaluation scripts for IndicBERT-v2 and IndicXTREME
  ☆105Updated 7 months ago
• AI4Bharat / IndicInstruct
  Code repository for "Introducing Airavata: Hindi Instruction-tuned LLM"
  ☆61Updated last year
• AI4Bharat / indicTrans
  indicTranslate v1 - Machine Translation for 11 Indic languages. For latest v2, check: https://github.com/AI4Bharat/IndicTrans2
  ☆133Updated last year
• AI4Bharat / IndicLLMSuite
  A blueprint for creating Pretraining and Fine-Tuning datasets for Indic languages
  ☆246Updated last year
• AI4Bharat / Shoonya
  Shoonya - Platform to Annotate and label data at scale.
  ☆60Updated 2 weeks ago
• VarunGumma / IndicTransToolkit
  A simple, consistent and extendable toolkit for IndicTrans2. (Pypi: https://pypi.org/project/indictranstoolkit)
  ☆37Updated 3 months ago
• adithya-s-k / indic_eval
  A lightweight evaluation suite tailored specifically for assessing Indic LLMs across a diverse range of tasks
  ☆38Updated last year
• TeluguLLMLabs / Indic-gemma-7b-Navarasa
  Repository for fine-tuning gemma models using unsloth for indic languages
  ☆96Updated last year
• AI4Bharat / IndicTrans2
  Translation models for 22 scheduled languages of India
  ☆383Updated last month
• OdiaGenAI / GenerativeAI_and_LLM_Odia
  ☆32Updated 2 years ago
• l3cube-pune / MarathiNLP
  Marathi NLP - is a repository dedicated to development of tools and resources for Marathi language.
  ☆151Updated 2 months ago
• AI4Bharat / indicnlp_corpus
  Description Describes the IndicNLP corpus and associated datasets
  ☆188Updated 2 years ago
• cisnlp / GlotLID
  💬 Language Identification with Support for More Than 2000 Labels -- EMNLP 2023
  ☆171Updated 5 months ago
• google-research / metricx
  ☆115Updated 11 months ago
• AI4Bharat / FBI
  FBI: Finding Blindspots in LLM Evaluations with Interpretable Checklists
  ☆30Updated 3 months ago
• AI4Bharat / IndicXlit
  Transliteration models for 21 Indic languages
  ☆103Updated 2 years ago
• vakyansh / cucom
  ☆11Updated 8 months ago
• huggingface / competitions
  ☆124Updated last year
• IlyasMoutawwakil / py-txi
  A Python wrapper around HuggingFace's TGI (text-generation-inference) and TEI (text-embedding-inference) servers.
  ☆33Updated last month
• masakhane-io / lafand-mt
  MAFAND-MT
  ☆59Updated last year
• bigscience-workshop / data_tooling
  Tools for managing datasets for governance and training.
  ☆86Updated last week
• pacman100 / openhathi_instruct
  This repository contains the code for dataset curation and finetuning of instruct variant of the Bilingual OpenHathi model. The resultin…
  ☆23Updated last year
• cfiltnlp / HiNER
  This repository contains the HiNER dataset released with our paper at LREC 2022
  ☆15Updated 2 years ago
• microsoft / Multilingual-Evaluation-of-Generative-AI-MEGA
  Code for Multilingual Eval of Generative AI paper published at EMNLP 2023
  ☆70Updated last year
• google-research-datasets / Hinglish-TOP-Dataset
  Consists of the largest (10K) human annotated code-switched semantic parsing dataset & 170K generated utterance using the CST5 augmentati…
  ☆41Updated 2 years ago
• AI4Bharat / webcorpus
  Generate large textual corpora for almost any language by crawling the web
  ☆12Updated last year
• s-smits / modernbert-finetune
  Fine-tune ModernBERT on a large Dataset with Custom Tokenizer Training
  ☆72Updated last month
• bloomberg / minilmv2.bb
  Our open source implementation of MiniLMv2 (https://aclanthology.org/2021.findings-acl.188)
  ☆61Updated 2 years ago
• AnswerDotAI / ModernBERT-Instruct-mini-cookbook
  ☆51Updated 9 months ago
• flairNLP / transformer-ranker
  Efficiently find the best-suited language model (LM) for your NLP task
  ☆132Updated 3 months ago