Pretraining, fine-tuning and evaluation scripts for IndicBERT-v2 and IndicXTREME
☆122Apr 6, 2025Updated last year
Alternatives and similar repositories for IndicBERT
Users that are interested in IndicBERT are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- This repository contains the HiNER dataset released with our paper at LREC 2022☆17Jun 6, 2023Updated 3 years ago
- A collaborative catalog of NLP resources for Indic languages☆639Dec 14, 2024Updated last year
- Translation models for 22 scheduled languages of India☆460Oct 3, 2025Updated 10 months ago
- Pre-trained, multilingual sequence-to-sequence models for Indian languages☆51Jul 20, 2022Updated 4 years ago
- Pretraining, fine-tuning and evaluation scripts for Indic-Wav2Vec2☆118Aug 28, 2025Updated 11 months ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- The IIT Bombay English-Hindi Parallel Corpus☆20Apr 26, 2022Updated 4 years ago
- ☆12Mar 31, 2020Updated 6 years ago
- A collection of Bangla newspaper and blog crawlers. Can be used to mine bangla text data for Natural Language Processing tasks.☆18Jan 30, 2023Updated 3 years ago
- Code for extracting parallel corpora from pmindia☆17Jan 28, 2020Updated 6 years ago
- This will hold the data pipeline to convert raw audio data to speech which will act as input dataset for speech-to-text pipeline☆33Feb 15, 2023Updated 3 years ago
- A rule-based lemmatizer for Bengali / Bangla based written in Python. Under active development.☆26Dec 28, 2019Updated 6 years ago
- A open-source framework designed to adapt pre-trained Language Models (LLMs), such as Llama, Mistral, and Mixtral, to a wide array of dom…☆24May 27, 2024Updated 2 years ago
- Code repository for "Introducing Airavata: Hindi Instruction-tuned LLM"☆65Oct 26, 2024Updated last year
- IndicGenBench is a high-quality, multilingual, multi-way parallel benchmark for evaluating Large Language Models (LLMs) on 4 user-facing …☆59Sep 1, 2024Updated last year
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- 🍼 Baby's CoThought: Leveraging LLMs for Enhanced Reasoning in Compact Models [BabyLM Challenge]☆17Jan 10, 2025Updated last year
- A machine-learning based open-domain QA chatbot from scratch 🤖☆11Oct 31, 2018Updated 7 years ago
- ☆15Dec 4, 2025Updated 8 months ago
- Place for editing the data backing ashtadhyayi.com☆13Updated this week
- Marathi NLP - is a repository dedicated to development of tools and resources for Marathi language.☆163Sep 14, 2025Updated 11 months ago
- Framework for working with brat-annotated .ann files☆10Mar 16, 2026Updated 5 months ago
- Data for the quantitative study of (Vedic) Sanskrit☆162Mar 5, 2026Updated 5 months ago
- Description Describes the IndicNLP corpus and associated datasets☆206Apr 16, 2023Updated 3 years ago
- Drupal Membership Module☆12Jul 6, 2020Updated 6 years ago
- Deploy open-source AI quickly and easily - Special Bonus Offer • AdRunpod Hub is built for open source. One-click deployment and autoscaling endpoints without provisioning your own infrastructure.
- Curated implementation notebooks and scripts of deep learning based natural language processing tasks and challenges in TensorFlow.☆11Apr 24, 2020Updated 6 years ago
- Yet Another Neural Machine Translation Toolkit☆180Mar 7, 2025Updated last year
- The Dakshina dataset is a collection of text in both Latin and native scripts for 12 South Asian languages. For each language, the datase…☆211May 27, 2020Updated 6 years ago
- ☆17Sep 4, 2022Updated 3 years ago
- State of the Art Language models and Classifier for Bengali, which is primarily spoken by the Bengalis in South Asia.☆32Aug 6, 2020Updated 6 years ago
- Tools for calculating psycholinguistically-relevant metrics of language statistics using transformer language models☆13Nov 11, 2022Updated 3 years ago
- ☆11Jan 16, 2020Updated 6 years ago
- A large scale Sanskrit-English translation dataset☆85Mar 20, 2023Updated 3 years ago
- This will hold the crowdsourcing platform to be used to store voice data from various speakers which will act as input dataset for speech…☆17Mar 6, 2023Updated 3 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- ☆13Dec 15, 2022Updated 3 years ago
- Apache Solr search engine integration for Drupal on DDEV (please consider ddev/ddev-solr first)☆14Apr 28, 2026Updated 3 months ago
- ☆10Jan 31, 2022Updated 4 years ago
- Resources and tools for Indian language Natural Language Processing☆643Jun 7, 2024Updated 2 years ago
- This is the repository for MorphScore, a tokenizer evaluation framework for morphological alignment.☆18Jul 10, 2025Updated last year
- Protocol buffers and other common resources.☆12Updated this week
- Resources to go with the Indic NLP Library☆78Jun 12, 2022Updated 4 years ago