This repository stems from our paper, “Cataloguing LLM Evaluations”, and serves as a living, collaborative catalogue of LLM evaluation frameworks, benchmarks and papers.
☆24Nov 16, 2023Updated 2 years ago
Alternatives and similar repositories for LLM-Evals-Catalogue
Users that are interested in LLM-Evals-Catalogue are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Estimates fatigue loads in wind turbines from SCADA data based on supervised learning.☆10Sep 11, 2018Updated 8 years ago
- The Dataset and Official Implementation for <Discursive Socratic Questioning: Evaluating the Faithfulness of Language Models’ Understandi…☆20Aug 7, 2024Updated 2 years ago
- Code for Preventing Language Models From Hiding Their Reasoning, which evaluates defenses against LLM steganography.☆25Oct 6, 2026Updated last month
- Code for "Unifying Grokking and Double Descent" from the NeurIPS 2022 ML Safety Workshop.☆11Feb 17, 2023Updated 3 years ago
- Elo Rating System for any 2 VS 2 sport such as baby-foot.☆18Nov 11, 2023Updated 2 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Sparkling Water for R☆13Sep 1, 2017Updated 9 years ago
- Accompanying codebase for neuroscope.io, a website for displaying max activating dataset examples for language model neurons☆15Feb 13, 2023Updated 3 years ago
- Generating, validating and running exploitable verifiable coding problems☆15Sep 30, 2026Updated last month
- ☆12Nov 11, 2025Updated 11 months ago
- Physics-guided data-driven solutions for the wind energy industry☆28Jan 7, 2026Updated 10 months ago
- The category map for agent credential management. Products, integrations, recipes, patterns, threat models. Curated by Authsome.☆12Jun 2, 2026Updated 5 months ago
- Sandbox escape benchmark for LLM capability evaluation☆14Apr 29, 2026Updated 6 months ago
- 🔍 FastMCP-powered documentation search engine that provides unified access to multiple framework docs (Next.js, Tailwind, Framer Motion,…☆13Mar 17, 2025Updated last year
- Code and supplementary material complementing the WES-publication: "Change-point detection in wind turbine SCADA data for robust conditio…☆22Sep 2, 2021Updated 5 years ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- ☆13Jan 31, 2025Updated last year
- Code for EMNLP 2023 paper: DALE: Generative Data Augmentation for Low-Resource Legal NLP☆11Oct 27, 2023Updated 3 years ago
- legal data in machine-readable form☆16Sep 13, 2026Updated last month
- Benchmark dataset for evaluating trusted monitors on AI agent transcripts☆20May 16, 2026Updated 5 months ago
- Advanced Architectures for Vertical AI Agents — 3 free lessons, code included. Full course at systemdrd.com☆11Oct 29, 2026Updated last week
- (redoing) | Check demo branch for old update. | Legal Workflow and Contract Lifecycle Management System.☆12Sep 11, 2025Updated last year
- [EMNLP 2022] Code for our paper “ZeroGen: Efficient Zero-shot Learning via Dataset Generation”.☆47Feb 18, 2022Updated 4 years ago
- A Python-based logical reasoning system combining rule-based engines with Large Language Models (LLMs) for business automation. Supports …☆15Jun 17, 2025Updated last year
- ☆14Jul 2, 2020Updated 6 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- LegalAI is a passion project which explores and simplifies the complexities of obtaining legal information using LLMs.☆13Nov 23, 2023Updated 2 years ago
- A simple screen parsing tool towards pure vision based GUI agent☆10Feb 20, 2025Updated last year
- 국가연구개발(정부 R&D) 규정 검토용 MCP 서버 — 혁신법·시행령·행정규칙 55종을 AI로 검색·검토 (Korean national R&D regulations MCP)☆14Updated this week
- AI-first fixed-layout document workspaces. Your AI agent writes proposals, whitepapers, theses, books — A4, PDF, web reader.☆14Aug 29, 2026Updated 2 months ago
- This is the documentation for the AI-READI dataset called "Flagship Dataset of Type 2 Diabetes from the AI-READI Project".☆14Oct 29, 2026Updated last week
- A PDF document RAG MCP that is easy to setup, supports completely local parsing and embedding, hybrid search, and semantic chunking. Also…☆13Sep 15, 2025Updated last year
- Jagged Frontier: LLM vulnerability detection benchmark harnesses (API + Claude Code agentic)☆16Updated this week
- GDPR in XML for all 24 EU languages, plus XSLT for transformation to HTML☆13Nov 18, 2022Updated 3 years ago
- A professional AI-powered contract analysis tool that provides intelligent legal review from multiple perspectives. This web application …☆21Mar 2, 2025Updated last year
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- ☆11Feb 22, 2025Updated last year
- A place for ideas and drafts related to GAI risk management.☆23Jan 17, 2026Updated 9 months ago
- I know Kung Fu☆26Mar 27, 2025Updated last year
- Das erste Legal Tech Lehrbuch - open source, kostenfrei, für alle☆15Sep 28, 2019Updated 7 years ago
- A pre-configured environment ready for AI-assisted document work☆20Apr 5, 2026Updated 7 months ago
- ☆10Oct 2, 2024Updated 2 years ago
- [SDM22] PyTorch implementation for "Neural Graph Matching for Pre-training Graph Neural Networks".☆18Apr 5, 2022Updated 4 years ago