A lightweight evaluation suite tailored specifically for assessing Indic LLMs across a diverse range of tasks
☆39Jun 10, 2024Updated last year
Alternatives and similar repositories for indic_eval
Users that are interested in indic_eval are comparing it to the libraries listed below
Sorting:
- A open-source framework designed to adapt pre-trained Language Models (LLMs), such as Llama, Mistral, and Mixtral, to a wide array of dom…☆23May 27, 2024Updated last year
- IndicGenBench is a high-quality, multilingual, multi-way parallel benchmark for evaluating Large Language Models (LLMs) on 4 user-facing …☆57Sep 1, 2024Updated last year
- Add Siri like Native AI Agents in you App.☆55Jan 18, 2025Updated last year
- Notes of PRNN course taught at IISC as part of MTech AI curriculum☆16Nov 30, 2024Updated last year
- Ultra-fast semantic tool filtering for MCP (Model Context Protocol) servers using embedding similarity. Reduce your tool context from 100…☆36Nov 8, 2025Updated 3 months ago
- ☆17Oct 17, 2024Updated last year
- 🚀 End-to-end examples and analysis of deploying LLMs serverless using Modal, Runpod, and Beam☆28Mar 25, 2024Updated last year
- A framework for pitting LLMs against each other in an evolving library of games ⚔☆35Apr 17, 2025Updated 10 months ago
- Problem-Oriented Segmentation and Retrieval EMNLP 2024 Findings☆34Nov 12, 2024Updated last year
- ☆10Sep 10, 2023Updated 2 years ago
- Model for Udacity's challenge which uses end-to-end learning to predict steering angles from just front camera image as input for self dr…☆10Apr 21, 2017Updated 8 years ago
- [CVPR2024] Learning from Synthetic Human Group Activities☆14Feb 24, 2025Updated last year
- Cross-lingual Fact-to-Text Alignment and Generation for Low-Resource Languages☆11Jan 1, 2023Updated 3 years ago
- DOMAINEVAL is an auto-constructed benchmark for multi-domain code generation that consists of 2k+ subjects (i.e., description, reference …☆14Dec 12, 2024Updated last year
- A framework for few-shot evaluation of autoregressive language models.☆12Jul 14, 2025Updated 7 months ago
- ☆12Jan 11, 2026Updated last month
- A Catalog lists instruction sets, models available for Indic language☆10Mar 14, 2024Updated last year
- Diagram question answering system described in "A Diagram is Worth a Dozen Images"☆39Apr 11, 2017Updated 8 years ago
- A Discord bot that answers questions about Replicate.☆16Jan 5, 2024Updated 2 years ago
- A Swedish Natural Language Understanding Benchmark☆11Dec 12, 2025Updated 2 months ago
- Gossip Glomers solution https://fly.io/dist-sys/☆12Sep 12, 2024Updated last year
- Mind maps related to software engineering☆12Dec 3, 2025Updated 3 months ago
- Vulnerability teaching showcase☆13Apr 19, 2016Updated 9 years ago
- ☆11Feb 22, 2025Updated last year
- Search Google from CLI☆10Nov 5, 2022Updated 3 years ago
- Reacts component for interacting with the Ethereum Name Service.☆16Aug 27, 2023Updated 2 years ago
- LLM benchmarks☆13Feb 22, 2024Updated 2 years ago
- AI assisted article writing project☆13Jan 31, 2025Updated last year
- Shaping Language Models with Cognitive Insights☆15Feb 29, 2024Updated 2 years ago
- Notebooks and tests for 🤗 Diffusers library☆10Aug 6, 2023Updated 2 years ago
- Code and Data for GlitchBench☆13Feb 27, 2024Updated 2 years ago
- Survey of available speech datasets for Polish ASR development☆17Jan 1, 2025Updated last year
- Granular Synthesis Max external☆11Feb 3, 2017Updated 9 years ago
- 🎯 Speech Recognition Challenge by Speech Lab - IIT Madras☆11Nov 5, 2020Updated 5 years ago
- The official Python library for Openlayer, the Continuous Model Improvement Platform for AI. 📈☆16Feb 25, 2026Updated last week
- This project is an automated research and summarization tool that allows users to conduct research on a specific question and summarize t…☆12Jun 3, 2024Updated last year
- ☆11Nov 5, 2024Updated last year
- Run FMBench simultaneously across multiple Amazon EC2 machines to benchmark an FM across multiple serving stacks simultaneously☆15Apr 11, 2025Updated 10 months ago
- Initial commit of Wallet Connect v2.0 demo for Unreal Engine 5 not suitable for stable releases.☆12Mar 8, 2023Updated 2 years ago