Compendium of over 50 benchmarks for evaluating AI agents, categorized into Function Calling & Tool Use, General Assistant & Reasoning, Coding & Software Engineering, and Computer Interaction.
☆114Oct 15, 2025Updated 5 months ago
Alternatives and similar repositories for ai-agent-benchmark-compendium
Users that are interested in ai-agent-benchmark-compendium are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- powerful and fast tool calling agents☆79Mar 19, 2025Updated last year
- A course on building Large Language Models☆12Mar 24, 2025Updated last year
- WorldQuant University Deep Learning for Computer Vision Certification Projects☆22Apr 3, 2025Updated 11 months ago
- ☆27Updated this week
- ☆45Sep 26, 2021Updated 4 years ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- ☆25Sep 10, 2025Updated 6 months ago
- Creates Flashcards of Terms and Definitions☆10May 8, 2025Updated 10 months ago
- Python interface for Agora☆67Mar 8, 2025Updated last year
- 仓库主要记录 NLP 算法工程师相关的顶会论文研读笔记【问答篇】☆22Mar 22, 2023Updated 3 years ago
- 📦 A set of bash scripts that package and unpack your codebase into and from a single JSON file, ready to be analyzed and understood by l…☆11Nov 10, 2024Updated last year
- Snowflake LLM-based text to SQL and document retrieval in Streamlit☆46Nov 16, 2023Updated 2 years ago
- Shift from passive documentation to active enforcement.☆47Mar 14, 2026Updated 2 weeks ago
- My CV details☆15Jan 22, 2025Updated last year
- ☆24Jan 30, 2025Updated last year
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click and start building anything your business needs.
- Run a fleet of CLI agents to do tasks and research☆19Dec 11, 2025Updated 3 months ago
- You're probably looking for https://github.com/briancavalier/most-behave instead☆11Jul 19, 2018Updated 7 years ago
- FinanceRAG project by KAIST students. Advanced Retrieval-Augmented Generation (RAG) system designed for the financial domain.☆15Feb 11, 2025Updated last year
- ETL-10-K-Filings is a Python-based open-source project designed for ETL of financial data from SEC Edgar filings. Focusing on the MDA Sec…☆16Feb 11, 2024Updated 2 years ago
- A command line utility to locally index and download filings from the SEC Edgar database.☆13Feb 18, 2025Updated last year
- 中文soft-masked bert文本纠错复现☆21May 20, 2021Updated 4 years ago
- ☆18Jul 20, 2025Updated 8 months ago
- ☆25Aug 25, 2025Updated 7 months ago
- Stream Claude Code's hidden output (thinking, tool calls, subagents) to a separate terminal in real-time☆80Updated this week
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- ☆39Mar 3, 2026Updated 3 weeks ago
- Run Claude Code (and codex) to generate a project plan, then run them in a loop for days until they're done☆14Jan 18, 2026Updated 2 months ago
- Hidden cost extractor for SEC filings.☆18Mar 1, 2022Updated 4 years ago
- A beginner's guide to Elasticsearch.☆18Sep 15, 2021Updated 4 years ago
- A bot that summaries conversations and records them for future use☆11Oct 14, 2020Updated 5 years ago
- Fast search index for SPLADE sparse retrieval models implemented in Python using Numpy and Numba☆37Oct 16, 2025Updated 5 months ago
- Code of how to build a ml-pipeline using DVC☆16Jun 16, 2024Updated last year
- ERT webviz plugins☆13Jan 9, 2026Updated 2 months ago
- A Context Compiler for TypeScript. Deterministic, diffable architectural contracts and dependency graphs for AI coding workflows.☆62Updated this week
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- Landscape2 sites settings and deployment workflows☆37Mar 12, 2026Updated 2 weeks ago
- Library for training process reward models☆29Jun 3, 2025Updated 9 months ago
- Example implementations of Claude's Memory Tool API - Next.js web app and Python CLI for building applications with persistent memory☆53Oct 14, 2025Updated 5 months ago
- R interface to XBRL US API☆22Feb 22, 2018Updated 8 years ago
- 📡 Simple peer that does not rely upon node polyfills☆20Oct 26, 2023Updated 2 years ago
- Remote control solution for Fusion 360 using client-server architecture. Features JSON socket communication, modular design with Python s…☆27Jun 12, 2025Updated 9 months ago
- Automatize local data analysis with team of tool-using GPT agents☆16Apr 1, 2024Updated last year