Alternatives and similar repositories for IndicTransToolkit

Users that are interested in IndicTransToolkit are comparing it to the libraries listed below

• AI4Bharat / IndicLLMSuite
  A blueprint for creating Pretraining and Fine-Tuning datasets for Indic languages
  ☆280Updated last year
• pacman100 / openhathi_instruct
  This repository contains the code for dataset curation and finetuning of instruct variant of the Bilingual OpenHathi model. The resultin…
  ☆23Updated 2 years ago
• AI4Bharat / IndicInstruct
  Code repository for "Introducing Airavata: Hindi Instruction-tuned LLM"
  ☆62Updated last year
• adithya-s-k / indic_eval
  A lightweight evaluation suite tailored specifically for assessing Indic LLMs across a diverse range of tasks
  ☆38Updated last year
• google-research-datasets / indic-gen-bench
  IndicGenBench is a high-quality, multilingual, multi-way parallel benchmark for evaluating Large Language Models (LLMs) on 4 user-facing …
  ☆56Updated last year
• TeluguLLMLabs / Indic-gemma-7b-Navarasa
  Repository for fine-tuning gemma models using unsloth for indic languages
  ☆97Updated last year
• AI4Bharat / IndicTrans2
  Translation models for 22 scheduled languages of India
  ☆385Updated 2 months ago
• AI4Bharat / IndicBERT
  Pretraining, fine-tuning and evaluation scripts for IndicBERT-v2 and IndicXTREME
  ☆105Updated 8 months ago
• Vaibhavs10 / optimise-my-whisper
  ☆206Updated last year
• ariG23498 / quantized-diffusion-inference
  Notebook and Scripts that showcase running quantized diffusion models on consumer GPUs
  ☆38Updated last year
• deshwalmahesh / PHUDGE
  Official repo for the paper PHUDGE: Phi-3 as Scalable Judge. Evaluate your LLMs with or without custom rubric, reference answer, absolute…
  ☆51Updated last year
• AI4Bharat / Shoonya
  Shoonya - Platform to Annotate and label data at scale.
  ☆60Updated 2 months ago
• Vaibhavs10 / translate-with-whisper
  ☆158Updated 2 years ago
• Locutusque / TPU-Alignment
  Fully fine-tune large models like Mistral, Llama-2-13B, or Qwen-14B completely for free
  ☆233Updated last year
• louisbrulenaudet / ragoon
  High level library for batched embeddings generation, blazingly-fast web-based RAG and quantized indexes processing ⚡
  ☆69Updated last month
• huggingface / trl-jobs
  Train LLM on Hugging Face infra
  ☆67Updated last month
• aniketmaurya / discord-llm-bot
  Fun project: LLM powered RAG Discord Bot that works seamlessly on CPU
  ☆32Updated 2 years ago
• mrmps / ai-chunker
  Chunk your text using gpt4o-mini more accurately
  ☆44Updated last year
• aulukelvin / LoRA_E5
  ☆17Updated last year
• nivibilla / build-nanogpt
  Video+code lecture on building nanoGPT from scratch
  ☆68Updated last year
• OdiaGenAI / GenerativeAI_and_LLM_Odia
  ☆32Updated 2 years ago
• AnswerDotAI / ModernBERT-Instruct-mini-cookbook
  ☆53Updated 10 months ago
• PrithivirajDamodaran / Route0x
  Low latency, High Accuracy, Custom Query routers for Humans and Agents. Built by Prithivi Da
  ☆119Updated 9 months ago
• AI4Bharat / IndicXlit
  Transliteration models for 21 Indic languages
  ☆107Updated 2 years ago
• julien-blanchon / arxflix
  Arxflix turns your boring Arxiv research paper into a captivating video.
  ☆57Updated 3 months ago
• IlyasMoutawwakil / py-txi
  A Python wrapper around HuggingFace's TGI (text-generation-inference) and TEI (text-embedding-inference) servers.
  ☆32Updated 3 months ago
• BhabhaAI / dataformer
  Solving data for LLMs - Create quality synthetic datasets!
  ☆150Updated 11 months ago
• davanstrien / haiku-dpo
  Using open source LLMs to build synthetic datasets for direct preference optimization
  ☆71Updated last year
• huggingface / competitions
  ☆125Updated last year
• anakin87 / mistral-haystack
  Mistral + Haystack: build RAG pipelines that rock 🤘
  ☆106Updated last year