Alternatives and similar repositories for IndicTransToolkit:

Users that are interested in IndicTransToolkit are comparing it to the libraries listed below

• AI4Bharat / IndicLLMSuite
  A blueprint for creating Pretraining and Fine-Tuning datasets for Indic languages
  ☆106Updated 6 months ago
• AI4Bharat / IndicInstruct
  Code repository for "Introducing Airavata: Hindi Instruction-tuned LLM"
  ☆59Updated 5 months ago
• adithya-s-k / indic_eval
  A lightweight evaluation suite tailored specifically for assessing Indic LLMs across a diverse range of tasks
  ☆34Updated 10 months ago
• pacman100 / openhathi_instruct
  This repository contains the code for dataset curation and finetuning of instruct variant of the Bilingual OpenHathi model. The resultin…
  ☆23Updated last year
• TeluguLLMLabs / Indic-gemma-7b-Navarasa
  Repository for fine-tuning gemma models using unsloth for indic languages
  ☆90Updated last year
• google-research-datasets / indic-gen-bench
  IndicGenBench is a high-quality, multilingual, multi-way parallel benchmark for evaluating Large Language Models (LLMs) on 4 user-facing …
  ☆45Updated 7 months ago
• PrithivirajDamodaran / Route0x
  Low latency, High Accuracy, Custom Query routers for Humans and Agents. Built by Prithivi Da
  ☆101Updated last week
• AI4Bharat / IndicTrans2
  Translation models for 22 scheduled languages of India
  ☆300Updated 3 weeks ago
• AI4Bharat / IndicBERT
  Pretraining, fine-tuning and evaluation scripts for IndicBERT-v2 and IndicXTREME
  ☆94Updated this week
• AI4Bharat / webcorpus
  Generate large textual corpora for almost any language by crawling the web
  ☆12Updated last year
• huggingface / competitions
  ☆122Updated 5 months ago
• OdiaGenAI / GenerativeAI_and_LLM_Odia
  ☆29Updated last year
• AI4Bharat / IndicXlit
  Transliteration models for 21 Indic languages
  ☆85Updated last year
• aniketmaurya / discord-llm-bot
  Fun project: LLM powered RAG Discord Bot that works seamlessly on CPU
  ☆32Updated last year
• masakhane-io / lafand-mt
  MAFAND-MT
  ☆55Updated 9 months ago
• adithya-s-k / Indic-llm
  A open-source framework designed to adapt pre-trained Language Models (LLMs), such as Llama, Mistral, and Mixtral, to a wide array of dom…
  ☆14Updated 10 months ago
• davanstrien / haiku-dpo
  Using open source LLMs to build synthetic datasets for direct preference optimization
  ☆59Updated last year
• deshwalmahesh / PHUDGE
  Official repo for the paper PHUDGE: Phi-3 as Scalable Judge. Evaluate your LLMs with or without custom rubric, reference answer, absolute…
  ☆49Updated 9 months ago
• pacman100 / peft-codegen-25
  ☆24Updated last year
• knowrohit / know_medical_dialogues
  KMD is a collection of conversational exchanges between patients and doctors on various medical topics. It aims to capture the intricaci…
  ☆24Updated last year
• SRSWTI / axis
  AI eXplainable Inference & Search. Open Sourcing on-premise, ultra-fast latency intelligence to all.
  ☆32Updated last month
• sanchit-gandhi / codesnippets
  ☆10Updated last year
• aulukelvin / LoRA_E5
  ☆17Updated 11 months ago
• louisbrulenaudet / ragoon
  High level library for batched embeddings generation, blazingly-fast web-based RAG and quantized indexes processing ⚡
  ☆67Updated 5 months ago
• AI4Bharat / indicTrans
  indicTranslate v1 - Machine Translation for 11 Indic languages. For latest v2, check: https://github.com/AI4Bharat/IndicTrans2
  ☆125Updated last year
• AI4Bharat / IndicLID
  Language Identification for Indian languages
  ☆16Updated last year
• Pleias / Various-Finetuning
  Set of scripts to finetune LLMs
  ☆37Updated last year
• weaviate-tutorials / Hurricane
  Writing Blog Posts with Generative Feedback Loops!
  ☆47Updated last year
• AblateIt / finetune-study
  Comprehensive analysis of difference in performance of QLora, Lora, and Full Finetunes.
  ☆82Updated last year
• enjalot / latent-data-modal
  Using modal.com to process FineWeb-edu data
  ☆20Updated last week