Alternatives and similar repositories for indic-gen-bench:

Users that are interested in indic-gen-bench are comparing it to the libraries listed below

• AI4Bharat / IndicInstruct
  Code repository for "Introducing Airavata: Hindi Instruction-tuned LLM"
  ☆58Updated 4 months ago
• AI4Bharat / IndicLLMSuite
  A blueprint for creating Pretraining and Fine-Tuning datasets for Indic languages
  ☆105Updated 5 months ago
• AI4Bharat / indicTrans
  indicTranslate v1 - Machine Translation for 11 Indic languages. For latest v2, check: https://github.com/AI4Bharat/IndicTrans2
  ☆124Updated last year
• VarunGumma / IndicTransToolkit
  A simple, consistent and extendable toolkit for IndicTrans2
  ☆23Updated 2 weeks ago
• AI4Bharat / FBI
  FBI: Finding Blindspots in LLM Evaluations with Interpretable Checklists
  ☆28Updated last week
• adithya-s-k / indic_eval
  A lightweight evaluation suite tailored specifically for assessing Indic LLMs across a diverse range of tasks
  ☆33Updated 9 months ago
• AI4Bharat / IndicBERT
  Pretraining, fine-tuning and evaluation scripts for IndicBERT-v2 and IndicXTREME
  ☆90Updated 6 months ago
• AI4Bharat / Shoonya
  Shoonya - Platform to Annotate and label data at scale.
  ☆53Updated 6 months ago
• TeluguLLMLabs / Indic-gemma-7b-Navarasa
  Repository for fine-tuning gemma models using unsloth for indic languages
  ☆88Updated last year
• pacman100 / openhathi_instruct
  This repository contains the code for dataset curation and finetuning of instruct variant of the Bilingual OpenHathi model. The resultin…
  ☆23Updated last year
• google-research-datasets / Hinglish-TOP-Dataset
  Consists of the largest (10K) human annotated code-switched semantic parsing dataset & 170K generated utterance using the CST5 augmentati…
  ☆37Updated 2 years ago
• google-research / metricx
  ☆85Updated 3 months ago
• cisnlp / Glot500
  Glot500: Scaling Multilingual Corpora and Language Models to 500 Languages -- ACL 2023
  ☆100Updated 10 months ago
• divyanshuaggarwal / IndicXNLI
  Code Repository for the IndicXNLI paper.
  ☆15Updated last year
• AI4Bharat / indicnlp_corpus
  Description Describes the IndicNLP corpus and associated datasets
  ☆164Updated last year
• NirantK / Hinglish
  Hinglish Text Classification
  ☆30Updated last year
• bminixhofer / zett
  Code for Zero-Shot Tokenizer Transfer
  ☆122Updated 2 months ago
• cisnlp / GlotLID
  💬 Language Identification with Support for More Than 2000 Labels -- EMNLP 2023
  ☆122Updated 3 months ago
• huggingface / olm-training
  Repo for training MLMs, CLMs, or T5-type models on the OLM pretraining data, but it should work with any hugging face text dataset.
  ☆93Updated 2 years ago
• IlyasMoutawwakil / py-txi
  A Python wrapper around HuggingFace's TGI (text-generation-inference) and TEI (text-embedding-inference) servers.
  ☆34Updated 3 months ago
• AI4Bharat / webcorpus
  Generate large textual corpora for almost any language by crawling the web
  ☆12Updated last year
• AI4Bharat / IndicTrans2
  Translation models for 22 scheduled languages of India
  ☆292Updated this week
• bloomberg / minilmv2.bb
  Our open source implementation of MiniLMv2 (https://aclanthology.org/2021.findings-acl.188)
  ☆61Updated last year
• EleutherAI / semantic-memorization
  ☆44Updated 4 months ago
• malteos / llm-datasets
  A collection of datasets for language model pretraining including scripts for downloading, preprocesssing, and sampling.
  ☆56Updated 7 months ago
• PrithivirajDamodaran / Alt-ZSC
  Alternate Implementation for Zero Shot Text Classification: Instead of reframing NLI/XNLI, this reframes the text backbone of CLIP models…
  ☆37Updated 2 years ago
• ariG23498 / smart-commit
  Smart commit messages
  ☆18Updated 4 months ago
• neuralwork / instruct-finetune-mistral
  Fine-tune Mistral 7B to generate fashion style suggestions
  ☆34Updated last year
• deshwalmahesh / PHUDGE
  Official repo for the paper PHUDGE: Phi-3 as Scalable Judge. Evaluate your LLMs with or without custom rubric, reference answer, absolute…
  ☆49Updated 8 months ago