Compendium of over 50 benchmarks for evaluating AI agents, categorized into Function Calling & Tool Use, General Assistant & Reasoning, Coding & Software Engineering, and Computer Interaction.
☆196Oct 15, 2025Updated 11 months ago
Alternatives and similar repositories for ai-agent-benchmark-compendium
Users that are interested in ai-agent-benchmark-compendium are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- A repostory with several COBOL libraries [intended to be used with the latest COBOL standard], each containing a number of very useful fu…☆13Feb 10, 2025Updated last year
- THUIR website☆10Feb 23, 2026Updated 6 months ago
- Demonstrating the efficiency of pmdarima’s auto_arima() function compared to implementing a traditional ARIMA model.☆12Feb 16, 2021Updated 5 years ago
- Seamless Voice Interactions with LLMs☆12Oct 28, 2023Updated 2 years ago
- AI studying companion, powered by LlamaCloud☆23Nov 24, 2025Updated 9 months ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- LLM-as-a-judge using G-eval Scratch☆15Oct 12, 2025Updated 11 months ago
- ☆45Mar 7, 2025Updated last year
- ☆13Feb 25, 2025Updated last year
- An autonomous LLM Web Agent☆16Feb 13, 2026Updated 7 months ago
- Multi-Agent LangGraph System☆13May 22, 2025Updated last year
- CICS Process Management Application☆12Jun 6, 2020Updated 6 years ago
- ☆19Dec 31, 2025Updated 8 months ago
- A Question Generation Application leveraging RAG and Weaviate vector store to be able to retrieve relative contexts and generate a more u…☆17Feb 3, 2025Updated last year
- General plug-and-play inference library for Recursive Language Models (RLMs), supporting various sandboxes.☆17Apr 26, 2026Updated 4 months ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- Skill-RM: Unifying Heterogeneous Evaluation Criteria via Agent Skill☆25Jun 8, 2026Updated 3 months ago
- ☆311Jul 1, 2026Updated 2 months ago
- Detect hallucinations, repetitive bug fix (AKA. bottomless pit) and help AI coder's with access to documentations and suggest fixes.☆15Aug 15, 2026Updated last month
- A P model of durable Promises☆14Oct 6, 2023Updated 2 years ago
- This is a fork of SGLang for hip-attention integration. Please refer to hip-attention for detail.☆18Mar 31, 2026Updated 5 months ago
- A small program in COBOL for a Bank Account☆11Jun 30, 2024Updated 2 years ago
- VAEGAN, I Love u☆16Aug 15, 2023Updated 3 years ago
- Contains a sample CICS COBOL and IMS COBOL application that uses the API Requester function of z/OS Connect EE.☆16Feb 28, 2023Updated 3 years ago
- An evaluation framework to test AI in a trial-and-error process. It is a simplified Natural Selection test.☆22Mar 11, 2025Updated last year
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- A framework for optimizing DSPy programs with RL☆339Jan 12, 2026Updated 8 months ago
- PolicyShiftGuard: Benchmarking and Improving Policy-Adaptive Image Guardrails☆22Jul 8, 2026Updated 2 months ago
- Turns issues into merged PRs/MRs with zero human intervention — supports GitHub and GitLab, and Claude Code, Codex CLI, Kiro CLI, Antigra…☆38Sep 11, 2026Updated last week
- AI Agent and CLI for Code Translation and Software Development in Scientific Computing☆19Aug 26, 2026Updated 3 weeks ago
- LiveMCPBench is a benchmark for evaluating the ability of agents to navigate and utilize a large-scale MCP toolset. It provides a compreh…☆104Dec 18, 2025Updated 9 months ago
- Sage is a skills framework that makes AI agents think before they act, stay focused under complexity, and deliver outcomes you can trust.…☆27Aug 16, 2026Updated last month
- 🎯Awesome-AgenticRAG_DeepResearch: A curated list of resources on Agentic RAG & DeepResearch. 学习参考关于AgenticRAG、DeepResearch的发展相关论文☆33Jul 23, 2026Updated last month
- Data Synthesis for Deep Research Based on Semi-Structured Data☆217Jul 14, 2026Updated 2 months ago
- ☆14Jun 16, 2020Updated 6 years ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- ☆16Aug 5, 2025Updated last year
- ☆94Feb 6, 2026Updated 7 months ago
- Visual codebase mapping plugin for OpenCode - auto-generates architecture diagrams as you code☆39Jan 5, 2026Updated 8 months ago
- ☆16Jul 23, 2024Updated 2 years ago
- Learn DSPy's core abstractions while building a deep research agent.☆46Mar 8, 2026Updated 6 months ago
- ☆10Nov 6, 2021Updated 4 years ago
- Replication package of ELFuzz☆15Feb 8, 2026Updated 7 months ago