A comprehensive guide to LLM evaluation methods designed to assist in identifying the most suitable evaluation techniques for various use cases, promote the adoption of best practices in LLM assessment, and critically assess the effectiveness of these evaluation methods.
☆207Oct 27, 2026Updated last week
Alternatives and similar repositories for LLMEvaluation
Users that are interested in LLMEvaluation are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- This compendium reviews significant published research contributions and industrial engineering practices in leveraging Generative AI and…☆124Updated this week
- First token cutoff sampling inference example☆30Jan 15, 2024Updated 2 years ago
- A framework for few-shot evaluation of autoregressive language models.☆13Feb 14, 2024Updated 2 years ago
- Turn any website into clean, LLM-ready data. Open-source web crawler with stealth mode, distributed crawling, real-time WebSocket progres…☆60Aug 27, 2026Updated 2 months ago
- An example project demonstrating how to perform OCR with multi-modal LLMs☆10Mar 14, 2024Updated 2 years ago
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- PreAct: Computer-Using Agents that Get Faster on Repeated Tasks (arXiv:2606.17929). Compile successful runs into verified state-machine p…☆19Jun 17, 2026Updated 4 months ago
- Sharing both practical insights and theoretical knowledge about LLM evaluation that we gathered while managing the Open LLM Leaderboard a…☆2,165Dec 3, 2025Updated 11 months ago
- Python client to integrate Cleanlab Codex with your AI Agent☆19Nov 19, 2025Updated 11 months ago
- [ACL'25] Official Code for LlamaDuo: LLMOps Pipeline for Seamless Migration from Service LLMs to Small-Scale Local LLMs☆317Jul 13, 2025Updated last year
- Implementation of various data science techniques and research papers☆31Dec 15, 2024Updated last year
- ☆24Dec 12, 2024Updated last year
- ☆10Oct 28, 2024Updated 2 years ago
- ↔️ T5 Machine Translation from English to Korean☆18Aug 11, 2022Updated 4 years ago
- Google 공식 Rouge Implementation을 한국어에서 사용할 수 있도록 처리☆17Jan 3, 2024Updated 2 years ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- ☆17Nov 23, 2023Updated 2 years ago
- ☆82Jun 5, 2024Updated 2 years ago
- It's a cooler way to store simple linear models.☆26Jul 15, 2024Updated 2 years ago
- Social Network Analysis and STEM Education is designed to prepare researchers to apply network analysis in order to better understand and…☆17Jul 14, 2025Updated last year
- Set of scripts to finetune LLMs☆39Mar 30, 2024Updated 2 years ago
- In situ interactive widgets for responsible AI 🌱☆28Mar 11, 2024Updated 2 years ago
- Synthetic Data Generation for Evaluation☆16Feb 21, 2025Updated last year
- Evaluation tools shared across anserini, pyserini, and pygaggle☆36Oct 18, 2026Updated 2 weeks ago
- Official repository for the paper: "You Only Prune Once: Designing Calibration-Free Model Compression With Policy Learning" [ICLR 2025]☆10Apr 13, 2025Updated last year
- End-to-end encrypted cloud storage - Proton Drive • AdSpecial offer: 40% Off Yearly / 80% Off First Month. Protect your most important files, photos, and documents from prying eyes.
- Experiments to assess SPADE on different LLM pipelines.☆18Apr 7, 2024Updated 2 years ago
- A curated list of awesome resources, libraries, frameworks, and tools for multi-agent systems (MAS) research and development.☆32Feb 17, 2025Updated last year
- 📊 Create visualizations from numbers in documents.☆14Dec 19, 2023Updated 2 years ago
- Official implementation of MergeRec: Model Merging for Data-Isolated Cross-Domain Sequential Recommendation (KDD 2026)☆10Jan 31, 2026Updated 9 months ago
- An analysis of the systemic impact, on the Web, of AI systems, and in particular ones based on Machine Learning models, and the role that…☆31Sep 17, 2025Updated last year
- MobileNetV2: Inverted Residuals and Linear Bottlenecks☆10Jul 22, 2019Updated 7 years ago
- Multiple ways to model user preference in recommender systems☆18May 2, 2024Updated 2 years ago
- Academic Evaluation Modules☆11Updated this week
- Best practices for distilling large language models.☆647Feb 1, 2024Updated 2 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- 11/15 NYC DataDive Amnesty International project☆12Nov 18, 2013Updated 12 years ago
- This is a project based on machine learning and deep learning method for playing Gobang by controlling mechanical arm（利用机械臂下五子棋）☆13Apr 16, 2023Updated 3 years ago
- A framework for few-shot evaluation of language models.☆14,422Updated this week
- Learning to route instances for Human vs AI Feedback (ACL Main '25)☆30Jul 23, 2025Updated last year
- A web-based platform for annotating short-text documents to be used in applied text-mining based research.☆10Jan 28, 2021Updated 5 years ago
- Official Implementation of Papar CM2☆27Apr 21, 2026Updated 6 months ago
- Implementing various machine learning algorithm from scratch☆32Mar 9, 2026Updated 7 months ago