This repository stems from our paper, “Cataloguing LLM Evaluations”, and serves as a living, collaborative catalogue of LLM evaluation frameworks, benchmarks and papers.
☆20Nov 16, 2023Updated 2 years ago
Alternatives and similar repositories for LLM-Evals-Catalogue
Users that are interested in LLM-Evals-Catalogue are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- A simple repository showcasing a few LLM Evaluation strategies and leverages W&B Sweeps to optimize the LLM system.☆12Jul 11, 2023Updated 2 years ago
- Estimates fatigue loads in wind turbines from SCADA data based on supervised learning.☆10Sep 11, 2018Updated 7 years ago
- Moonshot - A simple and modular tool to evaluate and red-team any LLM application.☆322Feb 5, 2026Updated 3 months ago
- ☆20Apr 10, 2025Updated last year
- A Python tool for visualizing satellite positions using TLE (Two Line Element) data☆12May 1, 2022Updated 4 years ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- ☆19Mar 28, 2026Updated last month
- Guidelines for the responsible use of explainable AI and machine learning.☆17Jan 30, 2023Updated 3 years ago
- ☆27Dec 2, 2025Updated 5 months ago
- Explore and visualise package download stats from Rstudio mirror by accounting for downloads from dependent packages☆15Jul 26, 2020Updated 5 years ago
- Benchmarking LLMs and Agents in Rigorous Financial Analysis and Forecast☆23Jan 9, 2026Updated 4 months ago
- ☆11Feb 22, 2025Updated last year
- [SDM22] PyTorch implementation for "Neural Graph Matching for Pre-training Graph Neural Networks".☆17Apr 5, 2022Updated 4 years ago
- [EMNLP 2022] Code for our paper “ZeroGen: Efficient Zero-shot Learning via Dataset Generation”.☆47Feb 18, 2022Updated 4 years ago
- A place for ideas and drafts related to GAI risk management.☆22Jan 17, 2026Updated 3 months ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- ☆12Mar 19, 2026Updated last month
- Preprint/draft article/blog on some explainable machine learning misconceptions. WIP!☆29Jul 13, 2019Updated 6 years ago
- ☆10Oct 2, 2024Updated last year
- Using Machine Learning to Measure Job Skill Similarities - See more at: http://blog.nycdatascience.com/?p=11683&preview=true#sthash.NnPZZ…☆18Jun 20, 2016Updated 9 years ago
- A directory of practical and usable AI agents resources from applications and platforms to frameworks and utilities and other parts of th…☆35Apr 28, 2026Updated last week
- WhatsApp chatbot with Dialogflow and Twilio api☆10May 6, 2024Updated 2 years ago
- Performing secure code review with LLMs (and vibe coding IDEs)☆41Aug 5, 2025Updated 9 months ago
- https://icml.cc/virtual/2023/poster/24354☆10Aug 15, 2023Updated 2 years ago
- Code for paper "AnswerQuest: A System for Generating Question-Answer Items from Multi-Paragraph Documents"☆19Jun 12, 2023Updated 2 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- [NeurIPS 2022] Explaining Graph Neural Networks with Structure-Aware Cooperative Games (GStarX)☆14Oct 20, 2022Updated 3 years ago
- Sample notebooks and prompts for LLM evaluation☆161Nov 2, 2025Updated 6 months ago
- Sample web applications built using FastAPI and Cloud SQL☆15May 5, 2025Updated last year
- ☆18Jul 20, 2025Updated 9 months ago
- Reading comprehension based question-answering model for news articles.☆11Jun 22, 2022Updated 3 years ago
- VoteCollector - Voting Platform for Dorm Room Fund☆12Jan 9, 2023Updated 3 years ago
- Simulator of a VC Portfolio☆12Apr 23, 2025Updated last year
- ☆15May 23, 2024Updated last year
- ☆11Feb 3, 2025Updated last year
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- [WWW demo 2026] TrustResearcher: Automating Knowledge-Grounded and Transparent Research Ideation with Multi-Agent Collaboration☆47Feb 26, 2026Updated 2 months ago
- TYPO3 Extension ⇢ Integration of sendinblue as finisher of the form extension☆11Jan 23, 2025Updated last year
- ☆38May 7, 2025Updated last year
- ☆51Sep 23, 2024Updated last year
- ☆10Jun 5, 2021Updated 4 years ago
- ☆21Mar 8, 2026Updated 2 months ago
- Abstractive text summarization http://arxiv.org/abs/1509.00685☆24Mar 18, 2016Updated 10 years ago