This repository stems from our paper, “Cataloguing LLM Evaluations”, and serves as a living, collaborative catalogue of LLM evaluation frameworks, benchmarks and papers.
☆22Nov 16, 2023Updated 2 years ago
Alternatives and similar repositories for LLM-Evals-Catalogue
Users that are interested in LLM-Evals-Catalogue are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Moonshot - A simple and modular tool to evaluate and red-team any LLM application.☆339Jun 10, 2026Updated last month
- ☆10Oct 3, 2022Updated 3 years ago
- Repo for my live-training about autogen☆28Jul 16, 2026Updated last week
- Trino On K8S Via Helm & Metastore Workshop Querying Delta Tables☆12Jan 27, 2025Updated last year
- [EMNLP 2022] Code for our paper “ZeroGen: Efficient Zero-shot Learning via Dataset Generation”.☆47Feb 18, 2022Updated 4 years ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- Hubcap is an autonomous AI agent in 25 lines of code: a small Autobot that you can't trust. *This is the Python fork/port* from https://g…☆22Nov 10, 2025Updated 8 months ago
- I know Kung Fu☆25Mar 27, 2025Updated last year
- Generate network packets using generative modeling☆15May 17, 2023Updated 3 years ago
- ☆11Feb 22, 2025Updated last year
- Preprint/draft article/blog on some explainable machine learning misconceptions. WIP!☆29Jul 13, 2019Updated 7 years ago
- A list of Numerical Multimodal reasoning papers and their implementation☆11May 13, 2024Updated 2 years ago
- ☆10Oct 2, 2024Updated last year
- WhatsApp chatbot with Dialogflow and Twilio api☆10May 6, 2024Updated 2 years ago
- ☆12Jun 22, 2026Updated last month
- End-to-end encrypted email - Proton Mail • AdSpecial offer: 40% Off Yearly / 80% Off First Month. All Proton services are open source and independently audited for security.
- https://icml.cc/virtual/2023/poster/24354☆10Aug 15, 2023Updated 2 years ago
- Using Machine Learning to Measure Job Skill Similarities - See more at: http://blog.nycdatascience.com/?p=11683&preview=true#sthash.NnPZZ…☆18Jun 20, 2016Updated 10 years ago
- From FHIR ingestion to patient outcomes analysis☆15Dec 2, 2024Updated last year
- A Model Context Protocol server for document Q&A powered by Langflow . It demonstrates core MCP concepts by providing a simple interface …☆15Apr 16, 2025Updated last year
- Oscillink — Self‑Optimizing Coherent Memory for Embedding Workflows☆15Nov 24, 2025Updated 8 months ago
- [NeurIPS 2022] Explaining Graph Neural Networks with Structure-Aware Cooperative Games (GStarX)☆15Oct 20, 2022Updated 3 years ago
- ☆18Mar 16, 2026Updated 4 months ago
- Reading comprehension based question-answering model for news articles.☆11Jun 22, 2022Updated 4 years ago
- Code for paper "AnswerQuest: A System for Generating Question-Answer Items from Multi-Paragraph Documents"☆19Jun 12, 2023Updated 3 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Sample web applications built using FastAPI and Cloud SQL☆15May 5, 2025Updated last year
- ☆15Dec 7, 2023Updated 2 years ago
- A mobile Implementation of llama.cpp☆26Oct 11, 2023Updated 2 years ago
- Practical ideas on securing machine learning models☆37May 27, 2021Updated 5 years ago
- TYPO3 Extension ⇢ Integration of sendinblue as finisher of the form extension☆11Jan 23, 2025Updated last year
- Webpack config for Angular JS 1.7☆11Dec 8, 2022Updated 3 years ago
- Simulator of a VC Portfolio☆12Apr 23, 2025Updated last year
- Fork of https://github.com/EdgarLopezPhD/PaySim☆17Jul 8, 2021Updated 5 years ago
- MultiModal RAG using Qwen 2 VL and Colpali.☆20Sep 28, 2024Updated last year
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- Labs for the "Build an agentic LLM assistant on AWS" workshop. A step by step agentic llm assistant development workshop using serverless…☆81Oct 14, 2025Updated 9 months ago
- ☆21Jun 22, 2026Updated last month
- Code of our paper "Method-Level Bug Severity Prediction using Source Code Metrics and LLMs" which is accepted to ISSRE 2023.☆10Nov 12, 2023Updated 2 years ago
- Abstractive text summarization http://arxiv.org/abs/1509.00685☆24Mar 18, 2016Updated 10 years ago
- Sample notebooks and prompts for LLM evaluation☆175Nov 2, 2025Updated 8 months ago
- ☆13Oct 20, 2022Updated 3 years ago
- Documenting large text datasets 🖼️ 📚☆14Dec 17, 2024Updated last year