Alternatives and similar repositories for indic-gen-bench

Users that are interested in indic-gen-bench are comparing it to the libraries listed below

• AI4Bharat / IndicInstruct
  Code repository for "Introducing Airavata: Hindi Instruction-tuned LLM"
  ☆59Updated 8 months ago
• AI4Bharat / Shoonya
  Shoonya - Platform to Annotate and label data at scale.
  ☆55Updated 10 months ago
• AI4Bharat / IndicBERT
  Pretraining, fine-tuning and evaluation scripts for IndicBERT-v2 and IndicXTREME
  ☆99Updated 3 months ago
• AI4Bharat / IndicLLMSuite
  A blueprint for creating Pretraining and Fine-Tuning datasets for Indic languages
  ☆107Updated 9 months ago
• AI4Bharat / FBI
  FBI: Finding Blindspots in LLM Evaluations with Interpretable Checklists
  ☆29Updated 4 months ago
• AI4Bharat / indicTrans
  indicTranslate v1 - Machine Translation for 11 Indic languages. For latest v2, check: https://github.com/AI4Bharat/IndicTrans2
  ☆127Updated last year
• adithya-s-k / indic_eval
  A lightweight evaluation suite tailored specifically for assessing Indic LLMs across a diverse range of tasks
  ☆37Updated last year
• VarunGumma / IndicTransToolkit
  A simple, consistent and extendable toolkit for IndicTrans2
  ☆34Updated last month
• google-research-datasets / Hinglish-TOP-Dataset
  Consists of the largest (10K) human annotated code-switched semantic parsing dataset & 170K generated utterance using the CST5 augmentati…
  ☆39Updated 2 years ago
• TeluguLLMLabs / Indic-gemma-7b-Navarasa
  Repository for fine-tuning gemma models using unsloth for indic languages
  ☆95Updated last year
• huggingface / olm-training
  Repo for training MLMs, CLMs, or T5-type models on the OLM pretraining data, but it should work with any hugging face text dataset.
  ☆93Updated 2 years ago
• AI4Bharat / IndicTrans2
  Translation models for 22 scheduled languages of India
  ☆331Updated 2 months ago
• huggingface / competitions
  ☆124Updated 8 months ago
• IlyasMoutawwakil / py-txi
  A Python wrapper around HuggingFace's TGI (text-generation-inference) and TEI (text-embedding-inference) servers.
  ☆33Updated 2 months ago
• AI4Bharat / IndicXlit
  Transliteration models for 21 Indic languages
  ☆93Updated last year
• ariG23498 / smart-commit
  Smart commit messages
  ☆18Updated 8 months ago
• NirantK / Hinglish
  Hinglish Text Classification
  ☆30Updated 2 years ago
• google-research-datasets / QAmeleon
  QAmeleon introduces synthetic multilingual QA data using PaLM, a 540B large language model. This dataset was generated by prompt tuning P…
  ☆34Updated last year
• bloomberg / minilmv2.bb
  Our open source implementation of MiniLMv2 (https://aclanthology.org/2021.findings-acl.188)
  ☆61Updated 2 years ago
• AI4Bharat / indic-bart
  Pre-trained, multilingual sequence-to-sequence models for Indian languages
  ☆48Updated 2 years ago
• bigscience-workshop / data_tooling
  Tools for managing datasets for governance and training.
  ☆85Updated last month
• sileod / tasksource
  Datasets collection and preprocessings framework for NLP extreme multitask learning
  ☆184Updated this week
• google-research / metricx
  ☆102Updated 7 months ago
• okarthikb / attention-visualizer
  LLM attention pattern visualizer
  ☆10Updated last year
• AnswerDotAI / ModernBERT-Instruct-mini-cookbook
  ☆48Updated 5 months ago
• google-research-datasets / seahorse
  Seahorse is a dataset for multilingual, multi-faceted summarization evaluation. It consists of 96K summaries with human ratings along 6 q…
  ☆88Updated last year
• nbroad1881 / strideformer
  Using short models to classify long texts
  ☆21Updated 2 years ago
• sayakpaul / count-tokens-hf-datasets
  This project shows how to derive the total number of training tokens from a large text dataset from 🤗 datasets with Apache Beam and Data…
  ☆27Updated 2 years ago
• Knowledgator / FlashDeBERTa
  Trully flash implementation of DeBERTa disentangled attention mechanism.
  ☆61Updated last month
• AI4Bharat / indicnlp_corpus
  Description Describes the IndicNLP corpus and associated datasets
  ☆173Updated 2 years ago