Sample notebooks and prompts for LLM evaluation
☆176Nov 2, 2025Updated last year
Alternatives and similar repositories for LLM-Evaluation
Users that are interested in LLM-Evaluation are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- A complete guide to evaluate LLMs and RAGs. Both theory and code based approaches covered.☆27Nov 16, 2023Updated 2 years ago
- Perplexity Lite using Langgraph, Tavily, and GPT-4.☆14Jan 11, 2024Updated 2 years ago
- ☆13Updated this week
- Learn how to use Transformer-based models for named-entity recognition (NER) tasks and how to analyze various model features, constraints…☆17Jun 29, 2022Updated 4 years ago
- Evals for agents☆15Dec 4, 2024Updated last year
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Scalable Meta-Evaluation of LLMs as Evaluators☆43Feb 15, 2024Updated 2 years ago
- ☆15Mar 26, 2026Updated 7 months ago
- (1) Courses on key machine learning and software engineering topics; (2) and a workflow for creating similar courses with LLMs in Cursor.…☆13Jun 9, 2025Updated last year
- SLIM Models by LLMWare. A streamlit app showing the capabilities for AI Agents and Function Calls.☆21Feb 11, 2024Updated 2 years ago
- Real-time data pipeline for AI apps in Azure☆26Dec 5, 2023Updated 2 years ago
- Example of how to rotate mTLS certificates in a Temporal Worker☆13Apr 14, 2026Updated 6 months ago
- Benchmarking QA systems on PDFs☆17Feb 20, 2026Updated 8 months ago
- A set of examples demonstrating how to evaluate Generative AI augmented systems using traditional information retrieval and LLM-As-A-Judg…☆11Oct 24, 2025Updated last year
- Potential reference implementation for Context Window Architecture proposal☆17Jul 8, 2025Updated last year
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- 🔍 LangKit: An open-source toolkit for monitoring Large Language Models (LLMs). 📚 Extracts signals from prompts & responses, ensuring sa…☆1,005Nov 22, 2024Updated last year
- My journey during 10 weeks of building FiftyOne plugins☆22Nov 12, 2023Updated 2 years ago
- synthetic data for ml☆25Jan 30, 2025Updated last year
- Documenting my AI journey☆20Feb 22, 2023Updated 3 years ago
- Code and Data for "Evaluating Correctness and Faithfulness of Instruction-Following Models for Question Answering"☆87Oct 8, 2026Updated 3 weeks ago
- MCP Server for connecting to Snowflake with read-only questions☆14Apr 28, 2025Updated last year
- Repository for my LLM notebooks☆30Aug 8, 2024Updated 2 years ago
- ☆18Jun 26, 2024Updated 2 years ago
- ☆10Feb 25, 2025Updated last year
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- A template for the easy creation of a custom Dialogflow Webhook to handle fulfillment.☆12Jan 7, 2023Updated 3 years ago
- Ini kumpulan beberapa materi lab pada Digitalent Schoolarship Python Essentials 2019☆10Mar 27, 2022Updated 4 years ago
- ☆26Dec 31, 2024Updated last year
- Automatically evaluate your LLMs in Google Colab☆699May 7, 2024Updated 2 years ago
- The official GitHub page for the survey paper "A Survey on Evaluation of Large Language Models".☆1,615Oct 28, 2026Updated last week
- Learning to Combine Local and Global Image Information for Contactless Palmprint Recognition☆11Dec 7, 2021Updated 4 years ago
- ☆10Aug 22, 2023Updated 3 years ago
- 11/15 NYC DataDive Amnesty International project☆12Nov 18, 2013Updated 12 years ago
- AI readiness & verification toolkit — measure how ready your codebase is for autonomous AI coding agents, and get a roadmap to autonomy…☆21Oct 12, 2026Updated 3 weeks ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- A tool for evaluating LLMs☆428Mar 15, 2026Updated 7 months ago
- Just a bunch of benchmark logs for different LLMs☆131Jul 28, 2024Updated 2 years ago
- A list of LLM benchmark frameworks.☆75Feb 17, 2024Updated 2 years ago
- Supercharge Your LLM Application Evaluations 🚀☆16,251Feb 24, 2026Updated 8 months ago
- Python SDK for running evaluations on LLM generated responses☆302Jun 6, 2025Updated last year
- Sample applications built on the Graphlit Platform☆79Oct 11, 2025Updated last year
- [KDD24-ADS] R-Eval: A Unified Toolkit for Evaluating Domain Knowledge of Retrieval Augmented Large Language Models☆11Apr 9, 2024Updated 2 years ago