Pretraining, fine-tuning and evaluation scripts for IndicBERT-v2 and IndicXTREME
☆124Apr 6, 2025Updated last year
Alternatives and similar repositories for IndicBERT
Users that are interested in IndicBERT are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- A collaborative catalog of NLP resources for Indic languages☆641Dec 14, 2024Updated last year
- Translation models for 22 scheduled languages of India☆490Oct 3, 2025Updated last year
- The IIT Bombay English-Hindi Parallel Corpus☆21Apr 26, 2022Updated 4 years ago
- Pretraining, fine-tuning and evaluation scripts for Indic-Wav2Vec2☆122Aug 28, 2025Updated last year
- Dataset accompanying "PARIKSHA: A Large-Scale Investigation of Human-LLM Evaluator Agreement on Multilingual and Multi-Cultural Data" (pu…☆14Dec 4, 2024Updated last year
- Deploy open-source AI quickly and easily - Special Bonus Offer • AdRunpod Hub is built for open source. One-click deployment and autoscaling endpoints without provisioning your own infrastructure.
- Description Describes the IndicNLP corpus and associated datasets☆206Apr 16, 2023Updated 3 years ago
- Code, notebooks, and other material for FuturePath AI's training course on Generative AI☆13Apr 24, 2025Updated last year
- Marathi NLP - is a repository dedicated to development of tools and resources for Marathi language.☆166Sep 14, 2025Updated last year
- Minimalist library for LLM usage☆13May 31, 2026Updated 5 months ago
- Indic-BERT-v1: BERT-based Multilingual Model for 11 Indic Languages and Indian-English. For latest Indic-BERT v2, check: https://github.c…☆297May 11, 2023Updated 3 years ago
- ☆12Mar 31, 2020Updated 6 years ago
- Code for extracting parallel corpora from pmindia☆17Jan 28, 2020Updated 6 years ago
- A collection of Bangla newspaper and blog crawlers. Can be used to mine bangla text data for Natural Language Processing tasks.☆18Jan 30, 2023Updated 3 years ago
- Resources and tools for Indian language Natural Language Processing☆653Jun 7, 2024Updated 2 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- The Dakshina dataset is a collection of text in both Latin and native scripts for 12 South Asian languages. For each language, the datase…☆214May 27, 2020Updated 6 years ago
- Transliteration models for 21 Indic languages☆146Oct 13, 2023Updated 3 years ago
- Data for the quantitative study of (Vedic) Sanskrit☆169Aug 24, 2026Updated 2 months ago
- A open-source framework designed to adapt pre-trained Language Models (LLMs), such as Llama, Mistral, and Mixtral, to a wide array of dom…☆24May 27, 2024Updated 2 years ago
- PathPiece tokenizer☆14Nov 10, 2024Updated last year
- Curated implementation notebooks and scripts of deep learning based natural language processing tasks and challenges in TensorFlow.☆11Apr 24, 2020Updated 6 years ago
- FAQ Generator for Classroom Climate Change Education using OpenAI☆19Nov 4, 2022Updated 4 years ago
- ⌨️ Learn how to use TypeScript to enhance your JavaScript skills with type safety.☆13Oct 6, 2026Updated last month
- IndicGenBench is a high-quality, multilingual, multi-way parallel benchmark for evaluating Large Language Models (LLMs) on 4 user-facing …☆60Sep 1, 2024Updated 2 years ago
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- Code Repository for the IndicXNLI paper.☆15Jul 8, 2023Updated 3 years ago
- CodeSwitch is a NLP tool, can use for language identification, pos tagging, name entity recognition, sentiment analysis of code mixed dat…☆38Nov 2, 2020Updated 6 years ago
- Python version of the SymSpell Compound algorithm☆12Sep 18, 2018Updated 8 years ago
- Natural Language Toolkit for Indic Languages aims to provide out of the box support for various NLP tasks that an application developer m…☆839Jan 20, 2024Updated 2 years ago
- This will hold the crowdsourcing platform to be used to store voice data from various speakers which will act as input dataset for speech…☆17Mar 6, 2023Updated 3 years ago
- Yet Another Neural Machine Translation Toolkit☆180Mar 7, 2025Updated last year
- Multidocument Summarization for Literature Review Shared Task 2022☆30Oct 16, 2022Updated 4 years ago
- Resources to go with the Indic NLP Library☆79Jun 12, 2022Updated 4 years ago
- Abstractive text summarization done with the help of LSTMs using encoder-decoder model which was able to achieve accuracy of 77.27% on t…☆10Sep 22, 2020Updated 6 years ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- A Continually LoRA PreTrained and FineTuned 7B Llama-2 Indic model for Malayalam Language.☆72Jul 16, 2024Updated 2 years ago
- ☆10Aug 19, 2024Updated 2 years ago
- Code for the paper "Greed is All You Need: An Evaluation of Tokenizer Inference Methods"☆15Sep 2, 2026Updated 2 months ago
- A hypernym discovery system which learns to predict is-a relationships between words using projection learning☆36Jun 24, 2020Updated 6 years ago
- ☆18Aug 28, 2025Updated last year
- indicTranslate v1 - Machine Translation for 11 Indic languages. For latest v2, check: https://github.com/AI4Bharat/IndicTrans2☆145Jan 2, 2024Updated 2 years ago
- State of the Art Language models and Classifier for Tamil language (spoken in India, and few other South Asian countries)☆52Aug 7, 2020Updated 6 years ago