A comprehensive guide to LLM evaluation methods designed to assist in identifying the most suitable evaluation techniques for various use cases, promote the adoption of best practices in LLM assessment, and critically assess the effectiveness of these evaluation methods.
☆199Aug 3, 2026Updated 2 weeks ago
Alternatives and similar repositories for LLMEvaluation
Users that are interested in LLMEvaluation are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- This compendium reviews significant published research contributions and industrial engineering practices in leveraging Generative AI and…☆104Jul 6, 2026Updated last month
- A framework for few-shot evaluation of autoregressive language models.☆13Feb 14, 2024Updated 2 years ago
- Sharing both practical insights and theoretical knowledge about LLM evaluation that we gathered while managing the Open LLM Leaderboard a…☆2,144Dec 3, 2025Updated 8 months ago
- [ACL'25] Official Code for LlamaDuo: LLMOps Pipeline for Seamless Migration from Service LLMs to Small-Scale Local LLMs☆317Jul 13, 2025Updated last year
- ☆24Dec 12, 2024Updated last year
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- Table detection with Florence.☆15Jul 11, 2024Updated 2 years ago
- Google 공식 Rouge Implementation을 한국어에서 사용할 수 있도록 처리☆17Jan 3, 2024Updated 2 years ago
- Text Match Cut Video Generator Web App☆37Feb 19, 2026Updated 5 months ago
- Sculpt: Structuring unstructured data with LLMs☆40Sep 22, 2025Updated 10 months ago
- ☆17Nov 23, 2023Updated 2 years ago
- ☆80Jun 5, 2024Updated 2 years ago
- Tensorflow object detection api in single line☆12Dec 23, 2021Updated 4 years ago
- Financial Risk Assessment System☆29Nov 29, 2024Updated last year
- ↔️ T5 Machine Translation from English to Korean☆18Aug 11, 2022Updated 4 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Evaluation tools shared across anserini, pyserini, and pygaggle☆36Updated this week
- ☆58Apr 18, 2026Updated 4 months ago
- Experiments to assess SPADE on different LLM pipelines.☆17Apr 7, 2024Updated 2 years ago
- Multiple ways to model user preference in recommender systems☆18May 2, 2024Updated 2 years ago
- Lightweight ngram random text generator☆12Jul 11, 2014Updated 12 years ago
- EmbedRank implemented in Python.☆15Jun 17, 2024Updated 2 years ago
- [ACL 2024 Findings] Light-PEFT: Lightening Parameter-Efficient Fine-Tuning via Early Pruning☆13Sep 2, 2024Updated last year
- ☆12Feb 16, 2024Updated 2 years ago
- R code for cost-effectiveness model evaluating directly acting oral anticoagulants (DOACs) for prevention of stroke in atrial fibrillatio…☆12Jan 14, 2020Updated 6 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- SeeGULL is a broad-coverage stereotype dataset in English containing stereotypes about identity groups spanning 178 countries across 8 di…☆38Sep 25, 2023Updated 2 years ago
- A framework for few-shot evaluation of language models.☆13,704Updated this week
- Inspect: A framework for large language model evaluations☆2,570Updated this week
- ☆571May 21, 2026Updated 2 months ago
- auto ticket reservation program (python)☆14Jan 28, 2020Updated 6 years ago
- Data-Driven Evaluation for LLM-Powered Applications☆515Aug 10, 2026Updated last week
- This repository contains the code and data for the paper "VisOnlyQA: Large Vision Language Models Still Struggle with Visual Perception o…☆29Jul 9, 2025Updated last year
- 🌊 ADHD-friendly productivity app. One next step at a time, flow-based workflows.☆16Feb 9, 2026Updated 6 months ago
- Lighteval is your all-in-one toolkit for evaluating LLMs across multiple backends☆2,522Aug 11, 2026Updated last week
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- A Hands on series on developing LLM applications☆70Sep 28, 2024Updated last year
- Tutorials and related talks given by the aeon community☆20Oct 11, 2025Updated 10 months ago
- Overall Equipment Effectiveness: Performant and Scalable End-to-End Equipment Monitoring☆13Jun 15, 2023Updated 3 years ago
- Structured output benchmarks comparing DSPy and BAML with different LLMs☆28Dec 23, 2025Updated 7 months ago
- ☆50May 22, 2024Updated 2 years ago
- Learn how to build agents that can reason over their own documents☆14May 21, 2024Updated 2 years ago
- The LLM Evaluation Framework☆17,668Updated this week