A comprehensive guide to LLM evaluation methods designed to assist in identifying the most suitable evaluation techniques for various use cases, promote the adoption of best practices in LLM assessment, and critically assess the effectiveness of these evaluation methods.
☆205Oct 10, 2026Updated this week
Alternatives and similar repositories for LLMEvaluation
Users that are interested in LLMEvaluation are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- This compendium reviews significant published research contributions and industrial engineering practices in leveraging Generative AI and…☆124Oct 1, 2026Updated last week
- Bangla TTS Inference pipeline using Vit TTS☆16Mar 24, 2024Updated 2 years ago
- A framework for few-shot evaluation of autoregressive language models.☆13Feb 14, 2024Updated 2 years ago
- RACF (Recency Aware Collaborative Filtering) is the implementation of the "Recency Aware Collaborative Filtering for Next Basket Recommen…☆25Feb 15, 2025Updated last year
- Sharing both practical insights and theoretical knowledge about LLM evaluation that we gathered while managing the Open LLM Leaderboard a…☆2,155Dec 3, 2025Updated 10 months ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- [ACL'25] Official Code for LlamaDuo: LLMOps Pipeline for Seamless Migration from Service LLMs to Small-Scale Local LLMs☆318Jul 13, 2025Updated last year
- Fine-tune Bangla ASR model which was trained Bangla Mozilla Common Voice Dataset☆14Apr 16, 2024Updated 2 years ago
- This is code for How Do Social Bots Participate in Misinformation Spread? A Comprehensive Dataset and Analysis☆18Oct 6, 2026Updated last week
- ☆24Dec 12, 2024Updated last year
- Table detection with Florence.☆15Jul 11, 2024Updated 2 years ago
- Google 공식 Rouge Implementation을 한국어에서 사용할 수 있도록 처리☆17Jan 3, 2024Updated 2 years ago
- ☆10Oct 28, 2024Updated last year
- ☆17Nov 23, 2023Updated 2 years ago
- ☆14May 30, 2024Updated 2 years ago
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- ☆82Jun 5, 2024Updated 2 years ago
- It's a cooler way to store simple linear models.☆26Jul 15, 2024Updated 2 years ago
- Financial Risk Assessment System☆29Nov 29, 2024Updated last year
- ↔️ T5 Machine Translation from English to Korean☆18Aug 11, 2022Updated 4 years ago
- An assignment for CMU CS11-711 Advanced NLP, building NLP systems from scratch☆171Dec 15, 2022Updated 3 years ago
- Extract features and bounding boxes using the original Bottom-up Attention Faster-RCNN in a few lines of Python code☆11Sep 18, 2022Updated 4 years ago
- Evaluation tools shared across anserini, pyserini, and pygaggle☆36Aug 24, 2026Updated last month
- ☆59Apr 18, 2026Updated 5 months ago
- Experiments to assess SPADE on different LLM pipelines.☆18Apr 7, 2024Updated 2 years ago
- Deploy open-source AI quickly and easily - Special Bonus Offer • AdRunpod Hub is built for open source. One-click deployment and autoscaling endpoints without provisioning your own infrastructure.
- Shapley values for Time Series ML/DL Models☆25Apr 21, 2026Updated 5 months ago
- Linear Relational Embeddings (LREs) and Linear Relational Concepts (LRCs) for LLMs in PyTorch☆11Aug 7, 2024Updated 2 years ago
- EmbedRank implemented in Python.☆15Jun 17, 2024Updated 2 years ago
- [ACL 2024 Findings] Light-PEFT: Lightening Parameter-Efficient Fine-Tuning via Early Pruning☆14Sep 2, 2024Updated 2 years ago
- ☆12Feb 16, 2024Updated 2 years ago
- R code for cost-effectiveness model evaluating directly acting oral anticoagulants (DOACs) for prevention of stroke in atrial fibrillatio…☆12Jan 14, 2020Updated 6 years ago
- mcp wrapper for openai built-in tools☆12Mar 13, 2025Updated last year
- Speeech Recognition for Indic languages.☆14Apr 3, 2021Updated 5 years ago
- SeeGULL is a broad-coverage stereotype dataset in English containing stereotypes about identity groups spanning 178 countries across 8 di…☆38Sep 25, 2023Updated 3 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- A framework for few-shot evaluation of language models.☆14,206Sep 14, 2026Updated 3 weeks ago
- A curated list of awesome energy forecasting resources such as, code libraries, datasets, courses, tutorials, research papers, competitio…☆29Dec 9, 2019Updated 6 years ago
- Inspect: A framework for large language model evaluations☆2,994Updated this week
- ☆580May 21, 2026Updated 4 months ago
- auto ticket reservation program (python)☆14Jan 28, 2020Updated 6 years ago
- Data-Driven Evaluation for LLM-Powered Applications☆519Aug 10, 2026Updated 2 months ago
- Deploying a simple, customized Flask API in python via Google App Engine☆13Aug 20, 2017Updated 9 years ago