This repository stems from our paper, “Cataloguing LLM Evaluations”, and serves as a living, collaborative catalogue of LLM evaluation frameworks, benchmarks and papers.
☆23Nov 16, 2023Updated 2 years ago
Alternatives and similar repositories for LLM-Evals-Catalogue
Users that are interested in LLM-Evals-Catalogue are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- The data and code for paper: "SOPBench: Evaluating Language Agents at Following Standard Operating Procedures and Constraints"☆23Sep 13, 2026Updated last month
- Library for integrated use of H2O with Hyperopt☆13Apr 8, 2024Updated 2 years ago
- Starter template for building ModelFusion terminal apps with TypeScript.☆13Feb 13, 2024Updated 2 years ago
- Developer documentation for EMF APIs☆16Sep 21, 2026Updated 3 weeks ago
- ☆21Sep 27, 2024Updated 2 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Sparkling Water for R☆13Sep 1, 2017Updated 9 years ago
- Bindings to avr-libc☆16Feb 13, 2021Updated 5 years ago
- Guidelines for the responsible use of explainable AI and machine learning.☆17Jan 30, 2023Updated 3 years ago
- Repo for my live-training about autogen☆28Jul 16, 2026Updated 3 months ago
- Repository for the Hybrid WordPress theme.☆14Jan 9, 2013Updated 13 years ago
- Trino On K8S Via Helm & Metastore Workshop Querying Delta Tables☆11Jan 27, 2025Updated last year
- [EMNLP 2022] Code for our paper “ZeroGen: Efficient Zero-shot Learning via Dataset Generation”.☆47Feb 18, 2022Updated 4 years ago
- Hubcap is an autonomous AI agent in 25 lines of code: a small Autobot that you can't trust. *This is the Python fork/port* from https://g…☆22Nov 10, 2025Updated 11 months ago
- ☆10Oct 2, 2024Updated 2 years ago
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- A web app to search pubmed☆12Jul 8, 2024Updated 2 years ago
- Using Machine Learning to Measure Job Skill Similarities - See more at: http://blog.nycdatascience.com/?p=11683&preview=true#sthash.NnPZZ…☆18Jun 20, 2016Updated 10 years ago
- A Model Context Protocol server for document Q&A powered by Langflow . It demonstrates core MCP concepts by providing a simple interface …☆15Apr 16, 2025Updated last year
- Example showing unstructured.io + timescaledb + PGAI☆18Oct 1, 2026Updated 2 weeks ago
- Data for "Quantifying Memorization Across Neural Language Models"☆10Mar 26, 2024Updated 2 years ago
- Collection of PHP 5.4 Traits☆20Jan 30, 2014Updated 12 years ago
- A pool of free media on Open Device Labs☆19Apr 4, 2019Updated 7 years ago
- ☆18Mar 16, 2026Updated 7 months ago
- Towards Explainability of Machine Learning Models in Insurance Pricing☆32Jun 17, 2020Updated 6 years ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- A tiny Claude Code skill that keeps your prompt cache warm during idle sessions, so your next message reads from cache instead of paying …☆71Updated this week
- ☆11Feb 3, 2025Updated last year
- Distributed parallel computing on data.table☆35Apr 30, 2016Updated 10 years ago
- TYPO3 Extension ⇢ Integration of sendinblue as finisher of the form extension☆11Jan 23, 2025Updated last year
- ☆15Dec 7, 2023Updated 2 years ago
- ☆25Aug 10, 2025Updated last year
- [EMNLP 2022] Distillation-Resistant Watermarking (DRW) for Model Protection in NLP☆13Aug 17, 2023Updated 3 years ago
- Webpack config for Angular JS 1.7☆11Dec 8, 2022Updated 3 years ago
- MultiModal RAG using Qwen 2 VL and Colpali.☆20Sep 28, 2024Updated 2 years ago
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- A GEPA proposer with less overfitting and helpful parameters.☆60Oct 6, 2026Updated last week
- Hand off tasks to Devin — a plugin/skill for Claude Code, Codex, Cursor, and any coding agent☆74Jul 19, 2026Updated 2 months ago
- Code of our paper "Method-Level Bug Severity Prediction using Source Code Metrics and LLMs" which is accepted to ISSRE 2023.☆10Nov 12, 2023Updated 2 years ago
- ☆29Feb 22, 2018Updated 8 years ago
- ☆17Jun 5, 2024Updated 2 years ago
- A workflow for ast-grep rules generation with Claude Code. Enforce your LLM-generated code with strict rules!☆20Jul 24, 2025Updated last year
- CLUE: A Clinical Language Understanding Evaluation for LLMs☆24Jan 22, 2025Updated last year