Alternatives and similar repositories for IndicInstruct

Users that are interested in IndicInstruct are comparing it to the libraries listed below

• AI4Bharat / IndicLLMSuite
  A blueprint for creating Pretraining and Fine-Tuning datasets for Indic languages
  ☆107Updated 10 months ago
• AI4Bharat / IndicBERT
  Pretraining, fine-tuning and evaluation scripts for IndicBERT-v2 and IndicXTREME
  ☆100Updated 4 months ago
• TeluguLLMLabs / Indic-gemma-7b-Navarasa
  Repository for fine-tuning gemma models using unsloth for indic languages
  ☆95Updated last year
• VarunGumma / IndicTransToolkit
  A simple, consistent and extendable toolkit for IndicTrans2. (Pypi: https://pypi.org/project/indictranstoolkit)
  ☆34Updated 2 weeks ago
• masakhane-io / lafand-mt
  MAFAND-MT
  ☆57Updated last year
• google-research-datasets / Hinglish-TOP-Dataset
  Consists of the largest (10K) human annotated code-switched semantic parsing dataset & 170K generated utterance using the CST5 augmentati…
  ☆41Updated 2 years ago
• AI4Bharat / Shoonya
  Shoonya - Platform to Annotate and label data at scale.
  ☆56Updated 11 months ago
• rashmimarganiatgithub / LLMS_Library_2023
  LLM_library is a comprehensive repository serves as a one-stop resource hands-on code, insightful summaries.
  ☆69Updated last year
• google-research-datasets / indic-gen-bench
  IndicGenBench is a high-quality, multilingual, multi-way parallel benchmark for evaluating Large Language Models (LLMs) on 4 user-facing …
  ☆51Updated 11 months ago
• deshwalmahesh / PHUDGE
  Official repo for the paper PHUDGE: Phi-3 as Scalable Judge. Evaluate your LLMs with or without custom rubric, reference answer, absolute…
  ☆49Updated last year
• pacman100 / peft-codegen-25
  ☆23Updated 2 years ago
• microsoft / Multilingual-Evaluation-of-Generative-AI-MEGA
  Code for Multilingual Eval of Generative AI paper published at EMNLP 2023
  ☆70Updated last year
• pacman100 / openhathi_instruct
  This repository contains the code for dataset curation and finetuning of instruct variant of the Bilingual OpenHathi model. The resultin…
  ☆23Updated last year
• adithya-s-k / indic_eval
  A lightweight evaluation suite tailored specifically for assessing Indic LLMs across a diverse range of tasks
  ☆37Updated last year
• davanstrien / haiku-dpo
  Using open source LLMs to build synthetic datasets for direct preference optimization
  ☆65Updated last year
• patronus-ai / Lynx-hallucination-detection
  ☆41Updated last year
• IlyasMoutawwakil / py-txi
  A Python wrapper around HuggingFace's TGI (text-generation-inference) and TEI (text-embedding-inference) servers.
  ☆33Updated 2 months ago
• PrithivirajDamodaran / Route0x
  Low latency, High Accuracy, Custom Query routers for Humans and Agents. Built by Prithivi Da
  ☆111Updated 4 months ago
• AI4Bharat / IndicTrans2
  Translation models for 22 scheduled languages of India
  ☆343Updated 3 months ago
• mrmps / ai-chunker
  Chunk your text using gpt4o-mini more accurately
  ☆44Updated last year
• tcapelle / llm_recipes
  A set of scripts and notebooks on LLM finetunning and dataset creation
  ☆110Updated 10 months ago
• OdiaGenAI / GenerativeAI_and_LLM_Odia
  ☆31Updated last year
• AI4Bharat / indicTrans
  indicTranslate v1 - Machine Translation for 11 Indic languages. For latest v2, check: https://github.com/AI4Bharat/IndicTrans2
  ☆129Updated last year
• huggingface / competitions
  ☆124Updated 9 months ago
• facebookresearch / EditEval
  An instruction-based benchmark for text improvements.
  ☆141Updated 2 years ago
• facebookresearch / belebele
  Repo for the Belebele dataset, a massively multilingual reading comprehension dataset.
  ☆335Updated 7 months ago
• daniel-furman / sft-demos
  Lightweight demos for finetuning LLMs. Powered by 🤗 transformers and open-source datasets.
  ☆77Updated 9 months ago
• anyscale / multimodal-ai
  Multimodal AI workloads: batch inference, model training and online serving.
  ☆22Updated last week
• huggingface / data-is-better-together
  Let's build better datasets, together!
  ☆260Updated 7 months ago
• google-research / metricx
  ☆104Updated 7 months ago