A comprehensive guide to LLM evaluation methods designed to assist in identifying the most suitable evaluation techniques for various use cases, promote the adoption of best practices in LLM assessment, and critically assess the effectiveness of these evaluation methods.
☆197Jul 6, 2026Updated this week
Alternatives and similar repositories for LLMEvaluation
Users that are interested in LLMEvaluation are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- A framework for few-shot evaluation of autoregressive language models.☆13Feb 14, 2024Updated 2 years ago
- First token cutoff sampling inference example☆30Jan 15, 2024Updated 2 years ago
- This is code for How Do Social Bots Participate in Misinformation Spread? A Comprehensive Dataset and Analysis☆18Nov 5, 2025Updated 8 months ago
- [ACL'25] Official Code for LlamaDuo: LLMOps Pipeline for Seamless Migration from Service LLMs to Small-Scale Local LLMs☆317Jul 13, 2025Updated 11 months ago
- Table detection with Florence.☆15Jul 11, 2024Updated last year
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- Awesome Bangla Datasets☆52Mar 29, 2025Updated last year
- ☆17Nov 23, 2023Updated 2 years ago
- ☆80Jun 5, 2024Updated 2 years ago
- ↔️ T5 Machine Translation from English to Korean☆18Aug 11, 2022Updated 3 years ago
- Experiments to assess SPADE on different LLM pipelines.☆17Apr 7, 2024Updated 2 years ago
- Linear Relational Embeddings (LREs) and Linear Relational Concepts (LRCs) for LLMs in PyTorch☆10Aug 7, 2024Updated last year
- SeeGULL is a broad-coverage stereotype dataset in English containing stereotypes about identity groups spanning 178 countries across 8 di…☆38Sep 25, 2023Updated 2 years ago
- ZYN: Zero-Shot Reward Models with Yes-No Questions☆35Aug 15, 2023Updated 2 years ago
- Python library for Evaluation☆17Mar 31, 2026Updated 3 months ago
- Open source password manager - Proton Pass • AdSecurely store, share, and autofill your credentials with Proton Pass, the end-to-end encrypted password manager trusted by millions.
- Tutorials and related talks given by the aeon community☆20Oct 11, 2025Updated 8 months ago
- LLM query engine to retrieve augmented responses from json files.☆15Oct 12, 2023Updated 2 years ago
- Cookbooks showcasing various applications of Cleanlab☆22Jan 20, 2026Updated 5 months ago
- Python client library for Cleanlab Trustworthy Language Model☆24Dec 9, 2025Updated 7 months ago
- SQLite integration via WASM☆12Dec 5, 2023Updated 2 years ago
- Implementation of NAACL'25 "Empowering Retrieval-based Conversational Recommendation with Contrasting User Preferences"☆14Sep 9, 2025Updated 10 months ago
- ☆11Nov 12, 2020Updated 5 years ago
- Predicting point-wise path loss through satellite images and height maps using deep learning.☆10Sep 16, 2022Updated 3 years ago
- S3 log bucket parser app for Django☆15Sep 12, 2011Updated 14 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Evaluate your model using advanced prompt strategies☆21Jan 30, 2026Updated 5 months ago
- This is the official code for the EMNLP findings 2025 paper "Enhancing Time Awareness in Generative Recommendation".☆19May 24, 2026Updated last month
- 无人机+人工智能工程实践项目的学习笔记☆13Mar 1, 2019Updated 7 years ago
- A team of AI agents that answer document related questions (RAG alternative)☆14Apr 16, 2025Updated last year
- Your local personalised AI agent☆43Nov 27, 2024Updated last year
- German dataset for DPR model training☆19Jul 21, 2024Updated last year
- Code for "Approaching Deep Learning through the Spectral Dynamics of Weights"☆13Oct 30, 2024Updated last year
- ICDE 2025 Paper, Grounding Natural Language to SQL Translation with Data-Based Self-Explanations☆17May 24, 2025Updated last year
- The official repository for MGFiD (NAACL 2024 Findings)☆15Jul 27, 2024Updated last year
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- Sharing both practical insights and theoretical knowledge about LLM evaluation that we gathered while managing the Open LLM Leaderboard a…☆2,128Dec 3, 2025Updated 7 months ago
- An R library for estimating causal effects☆12Apr 25, 2025Updated last year
- ☆17Feb 8, 2025Updated last year
- 🤗 LeRobot: Making AI for Robotics more accessible with end-to-end learning☆38Jan 30, 2026Updated 5 months ago
- 3-Pipeline LLMOps Financial advisor. Steaming pipeline deployed on AWS, 24/7 collects, embeds live-data into QdrantDB. Training pipeline …☆26Apr 12, 2025Updated last year
- Training and evaluation code for the paper "Headless Language Models: Learning without Predicting with Contrastive Weight Tying" (https:/…☆29Apr 17, 2024Updated 2 years ago
- Create embeddings for LLM using the Nomic API☆23Nov 21, 2024Updated last year