This repository stems from our paper, “Cataloguing LLM Evaluations”, and serves as a living, collaborative catalogue of LLM evaluation frameworks, benchmarks and papers.
☆21Nov 16, 2023Updated 2 years ago
Alternatives and similar repositories for LLM-Evals-Catalogue
Users that are interested in LLM-Evals-Catalogue are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Transform an XML document into a tabular data set. Better than spreadsheets.☆10Jan 18, 2016Updated 10 years ago
- Hubcap is an autonomous AI agent in 25 lines of code: a small Autobot that you can't trust. *This is the Python fork/port* from https://g…☆22Nov 10, 2025Updated 7 months ago
- Moonshot - A simple and modular tool to evaluate and red-team any LLM application.☆334Jun 10, 2026Updated 3 weeks ago
- Physics-guided data-driven solutions for the wind energy industry☆28Jan 7, 2026Updated 6 months ago
- Sparkling Water for R☆13Sep 1, 2017Updated 8 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- Trino On K8S Via Helm & Metastore Workshop Querying Delta Tables☆12Jan 27, 2025Updated last year
- ☆15Nov 25, 2025Updated 7 months ago
- Comparison of Metaflow, MLFlow and DVC☆14Aug 4, 2021Updated 4 years ago
- Benchmarking LLMs and Agents in Rigorous Financial Analysis and Forecast☆28May 10, 2026Updated last month
- [EMNLP 2022] Code for our paper “ZeroGen: Efficient Zero-shot Learning via Dataset Generation”.☆47Feb 18, 2022Updated 4 years ago
- A web app to search pubmed☆12Jul 8, 2024Updated 2 years ago
- ☆12Jun 22, 2026Updated 2 weeks ago
- Preprint/draft article/blog on some explainable machine learning misconceptions. WIP!☆29Jul 13, 2019Updated 6 years ago
- Example showing unstructured.io + timescaledb + PGAI☆18Nov 15, 2024Updated last year
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- ☆10Oct 2, 2024Updated last year
- Production-grade Retrieval Augmented Generation (RAG) architecture using Open Source components☆64Jan 12, 2026Updated 5 months ago
- ☆161Jul 1, 2026Updated last week
- Using Machine Learning to Measure Job Skill Similarities - See more at: http://blog.nycdatascience.com/?p=11683&preview=true#sthash.NnPZZ…☆18Jun 20, 2016Updated 10 years ago
- A directory of practical and usable AI agents resources from applications and platforms to frameworks and utilities and other parts of th…☆36Apr 28, 2026Updated 2 months ago
- WhatsApp chatbot with Dialogflow and Twilio api☆10May 6, 2024Updated 2 years ago
- https://icml.cc/virtual/2023/poster/24354☆10Aug 15, 2023Updated 2 years ago
- Code for paper "AnswerQuest: A System for Generating Question-Answer Items from Multi-Paragraph Documents"☆19Jun 12, 2023Updated 3 years ago
- Sample notebooks and prompts for LLM evaluation☆173Nov 2, 2025Updated 8 months ago
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- ☆18Jul 20, 2025Updated 11 months ago
- ☆15Dec 7, 2023Updated 2 years ago
- Simulator of a VC Portfolio☆12Apr 23, 2025Updated last year
- ☆15May 23, 2024Updated 2 years ago
- ☆11Feb 3, 2025Updated last year
- MultiModal RAG using Qwen 2 VL and Colpali.☆20Sep 28, 2024Updated last year
- CLUE: A Clinical Language Understanding Evaluation for LLMs☆22Jan 22, 2025Updated last year
- [WWW demo 2026] TrustResearcher: Automating Knowledge-Grounded and Transparent Research Ideation with Multi-Agent Collaboration☆46Feb 26, 2026Updated 4 months ago
- TYPO3 Extension ⇢ Integration of sendinblue as finisher of the form extension☆11Jan 23, 2025Updated last year
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- ☆38May 7, 2025Updated last year
- Abstractive text summarization http://arxiv.org/abs/1509.00685☆24Mar 18, 2016Updated 10 years ago
- Labs for the "Build an agentic LLM assistant on AWS" workshop. A step by step agentic llm assistant development workshop using serverless…☆80Oct 14, 2025Updated 8 months ago
- This project is an AI Recruitment System designed to accelerate the hiring process for HR and technical recruiters.☆17Jan 3, 2025Updated last year
- Simple WPF HL7 Fluentpath Tester tool☆20Jun 22, 2023Updated 3 years ago
- Code of our paper "Method-Level Bug Severity Prediction using Source Code Metrics and LLMs" which is accepted to ISSRE 2023.☆10Nov 12, 2023Updated 2 years ago
- Repository for my LLM notebooks☆30Aug 8, 2024Updated last year