Top papers related to LLM-based agent evaluation
☆106Jul 29, 2026Updated this week
Alternatives and similar repositories for LLM-Agent-Evaluation-Survey
Users that are interested in LLM-Agent-Evaluation-Survey are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Comprehensive LLM Error Analysis and Reporting☆54Jul 27, 2026Updated last week
- The official repo of the paper "StressTest: Can YOUR Speech LM Handle the Stress?"☆20Jun 28, 2026Updated last month
- The official repo of "WhiStress: Enriching Transcriptions with Sentence Stress Detection" (Interspeech 2025)☆39Jul 24, 2025Updated last year
- ☆20Jul 23, 2026Updated last week
- ☆48Jul 7, 2025Updated last year
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Asynchronous LLM Agent playing games of Mafia against human players☆23Nov 12, 2025Updated 8 months ago
- WONDA: data curation pipeline for training small language models on loop invariant synthesis. Accepted to ICML 2026☆17Jun 29, 2026Updated last month
- General agent evaluation framework☆66Jul 27, 2026Updated last week
- Official implementation of "DGD: Dynamic 3D Gaussians Distillation".☆70Aug 16, 2024Updated last year
- A Lossless Compression Library for AI pipelines☆325Apr 11, 2026Updated 3 months ago
- An official implementation of ProbeGen☆13Oct 20, 2024Updated last year
- 🦄 Unitxt is a Python library for enterprise-grade evaluation of AI performance, offering the world's largest catalog of tools and data …☆218May 27, 2026Updated 2 months ago
- Official PyTorch Implementation for the "Recovering the Pre-Fine-Tuning Weights of Generative Models" paper (ICML 2024).☆86Apr 15, 2025Updated last year
- Annotatability, a method to identify meaningful patterns in single-cell genomics data through annotation-trainability analysis, which est…☆19Jun 23, 2025Updated last year
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- The official code for the SALMon🍣 benchmark (ICASSP 2025 - Oral)☆50Aug 15, 2025Updated 11 months ago
- ☆14Jul 13, 2025Updated last year
- Research framework for low resource text classification that allows the user to experiment with classification models and active learning…☆101Mar 9, 2022Updated 4 years ago
- CUGA is an open-source generalist agent harness for the enterprise, supporting complex task execution on web and APIs, OpenAPI/MCP integr…☆864Updated this week
- Open-source, Cloud-native Streams☆12Apr 7, 2021Updated 5 years ago
- A Benchmark for Evaluating Multi-Hop, Multi-Source Tool-Calling in AI Agents☆63Updated this week
- ☆46Jan 21, 2025Updated last year
- ☆16Apr 2, 2025Updated last year
- RAG Templates Optimization Engine.☆19Updated this week
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- Official implementation for "Stable Flow: Vital Layers for Training-Free Image Editing" [CVPR 2025]☆409Jun 8, 2025Updated last year
- Official repository for "Speaking Style Conversion With Discrete Self-Supervised Units" (EMNLP 2023). https://arxiv.org/abs/2212.09730☆130Dec 8, 2023Updated 2 years ago
- code for the paper "Cluster & Tune: Boost Cold Start Performance in Text Classification" for ACL2022☆27May 18, 2022Updated 4 years ago
- ☆10May 8, 2026Updated 2 months ago
- QuoteSum is a textual QA dataset containing Semi-Extractive Multi-source Question Answering (SEMQA) examples written by humans, based on …☆13Mar 25, 2024Updated 2 years ago
- Repo for "AlphaResearch: Accelerating New Algorithm Discovery with Language Models"☆58Nov 12, 2025Updated 8 months ago
- A Codex skill (via CLI) which runs codex in parallel to reflect on previous conversations to brainstorm some skills you could add to your…☆19Jan 23, 2026Updated 6 months ago
- A Python library for inference-time scaling LLMs☆36Updated this week
- Real-time security for AI agents on Moltbook☆65Feb 4, 2026Updated 5 months ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- The dataset includes widget captions that describes UI element's functionalities. It is used for training and evaluation of the widget ca…☆23Jun 24, 2021Updated 5 years ago
- VeriWeb: Verifiable Long-Chain Web Benchmark for Agentic Information-Seeking☆88Jan 21, 2026Updated 6 months ago
- Official pytorch re-implementation of "Demystifying Inter-Class Disentanglement", ICLR 2020.☆13Dec 2, 2021Updated 4 years ago
- ☆30May 27, 2026Updated 2 months ago
- [ICML 2026] Official implementation for "DyPE: Dynamic Position Extrapolation for Ultra High Resolution Diffusion".☆357May 18, 2026Updated 2 months ago
- Corpus exploration platform using advanced tools such as interactive summarization and multi document coreference resolution☆12Jun 15, 2023Updated 3 years ago
- Experiments on using ChatGPT for failure mode classification☆12Sep 20, 2023Updated 2 years ago