Alternatives and similar repositories for IndicTransToolkit

Users that are interested in IndicTransToolkit are comparing it to the libraries listed below

• AI4Bharat / IndicLLMSuite
  A blueprint for creating Pretraining and Fine-Tuning datasets for Indic languages
  ☆116Updated last year
• AI4Bharat / IndicInstruct
  Code repository for "Introducing Airavata: Hindi Instruction-tuned LLM"
  ☆61Updated 11 months ago
• pacman100 / openhathi_instruct
  This repository contains the code for dataset curation and finetuning of instruct variant of the Bilingual OpenHathi model. The resultin…
  ☆23Updated last year
• google-research-datasets / indic-gen-bench
  IndicGenBench is a high-quality, multilingual, multi-way parallel benchmark for evaluating Large Language Models (LLMs) on 4 user-facing …
  ☆53Updated last year
• adithya-s-k / indic_eval
  A lightweight evaluation suite tailored specifically for assessing Indic LLMs across a diverse range of tasks
  ☆38Updated last year
• julien-blanchon / arxflix
  Arxflix turns your boring Arxiv research paper into a captivating video.
  ☆55Updated 3 weeks ago
• KhoomeiK / sanskrit-ocr
  ☆44Updated 3 months ago
• AI4Bharat / IndicTrans2
  Translation models for 22 scheduled languages of India
  ☆370Updated last week
• Vaibhavs10 / translate-with-whisper
  ☆157Updated 2 years ago
• voxos-ai / streaming-whisper-server
  A streaming whisper server for on-prem transcription
  ☆22Updated last year
• TeluguLLMLabs / Indic-gemma-7b-Navarasa
  Repository for fine-tuning gemma models using unsloth for indic languages
  ☆96Updated last year
• Locutusque / TPU-Alignment
  Fully fine-tune large models like Mistral, Llama-2-13B, or Qwen-14B completely for free
  ☆231Updated 11 months ago
• AI4Bharat / IndicBERT
  Pretraining, fine-tuning and evaluation scripts for IndicBERT-v2 and IndicXTREME
  ☆103Updated 6 months ago
• OdiaGenAI / GenerativeAI_and_LLM_Odia
  ☆32Updated 2 years ago
• AI4Bharat / Shoonya
  Shoonya - Platform to Annotate and label data at scale.
  ☆57Updated last year
• Vaibhavs10 / optimise-my-whisper
  ☆207Updated last year
• aniketmaurya / discord-llm-bot
  Fun project: LLM powered RAG Discord Bot that works seamlessly on CPU
  ☆32Updated last year
• huggingface / competitions
  ☆124Updated 11 months ago
• thomwolf / sesame-explorations
  ☆29Updated 5 months ago
• muellerzr / minimal-trainer-zoo
  Minimal example scripts of the Hugging Face Trainer, focused on staying under 150 lines
  ☆195Updated last year
• davanstrien / haiku-dpo
  Using open source LLMs to build synthetic datasets for direct preference optimization
  ☆66Updated last year
• Vaibhavs10 / notebooks
  ☆127Updated 6 months ago
• AI4Bharat / Chitralekha
  Chitralekha - A video transcreation platform for Indic languages, supporting transcription, translation and voice-over
  ☆109Updated 9 months ago
• apehex / tokun
  Tokun to can tokens
  ☆18Updated 3 months ago
• l4b4r4b4b4 / AIDocks
  LLM-Training-API: Including Embeddings & ReRankers, mergekit, LaserRMT
  ☆27Updated last year
• PrithivirajDamodaran / Route0x
  Low latency, High Accuracy, Custom Query routers for Humans and Agents. Built by Prithivi Da
  ☆116Updated 6 months ago
• huggingface / trl-jobs
  Train LLM on Hugging Face infra
  ☆63Updated last month
• cohere-ai / BinaryVectorDB
  Efficient vector database for hundred millions of embeddings.
  ☆208Updated last year
• AI4Bharat / IndicXlit
  Transliteration models for 21 Indic languages
  ☆99Updated last year
• mogwai / nanodrz
  Speaker Diarization with Transformers
  ☆69Updated 4 months ago