Evaluation package that allows benchmarking of agentic AIs from various sources and frameworks by producing statistical results which can be compared across different use cases and datasets.
☆79Jun 26, 2026Updated last month
Alternatives and similar repositories for agent-quality-inspect
Users that are interested in agent-quality-inspect are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Multi-Agent LLM Evaluation Docs: https://maseval.readthedocs.io/☆37Jul 5, 2026Updated last month
- Experiments on using ChatGPT for failure mode classification☆12Sep 20, 2023Updated 2 years ago
- SDK to track cost-per-outcome for AI workflows☆18Apr 25, 2026Updated 3 months ago
- Official GitHub repo for Scaling Physical Reasoning with the PHYSICS Dataset (NeurIPS25).☆16Sep 20, 2025Updated 10 months ago
- Know what your AI agents cost. API gateway with budget enforcement, session tracking, and MCP tools.☆16Updated this week
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- In-Situ Evaluator: Real-Time Subsample Analysis☆16Jan 25, 2026Updated 6 months ago
- AI context observability & optimization for Claude Code, Copilot CLI, Codex, Gemini — TUI dashboard, preset optimization, cost tracking, …☆14Aug 5, 2026Updated last week
- ⚠️ ARCHIVED - All development moved to https://github.com/itbench-hub/ITBench-CISO-SRE-FinOps-Agent☆21Sep 9, 2025Updated 11 months ago
- Source code for the paper: Hear Both Sides: Efficient Multi-Agent Debate via Diversity-Aware Message Retention☆18Apr 16, 2026Updated 3 months ago
- Claude Skill - SAP Private Cloud ERP Expert - RISE with SAP☆25Jul 22, 2026Updated 3 weeks ago
- A repository containing examples of AI paradigm implementations following best practices when building AI solutions with SAP services and…☆56Updated this week
- [ACL25' Findings] SWE-Dev is an SWE agent with a scalable test case construction pipeline.☆65Jul 21, 2025Updated last year
- Self-hosted dashboard for OpenClaw AI agents. Cost tracking, budget enforcement, session replay, config safety.☆16Mar 10, 2026Updated 5 months ago
- Claude Code session cost tracker. Efficiency score, productive vs wasted breakdown, live terminal dashboard.☆18Apr 4, 2026Updated 4 months ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- A Model Context Protocol server allows Clients to interact with Xero☆21Updated this week
- Custom Scheduler to deploy ML models to TRTIS for GPU Sharing☆12Apr 1, 2020Updated 6 years ago
- An open-source, code-first C# (Dotnet) toolkit for building, evaluating, and deploying sophisticated AI agents with flexibility and contr…☆24Jul 11, 2026Updated last month
- Discover AI skills for SAP — search, filter, and install skills for your digital assistant.☆40Jul 30, 2026Updated 2 weeks ago
- A fast canonical-correlation-based search algorithm for feature selection, system identification, data pruning, etc.☆31Jul 17, 2026Updated 3 weeks ago
- ☆26Feb 28, 2025Updated last year
- Sample Jupyter Notebook for playing around with the Anomaly Detection service to be made available on API Hub☆30Jan 11, 2026Updated 7 months ago
- A comprehensive toolkit for deploying production-ready Generative AI infrastructure on Amazon EKS. Includes pre-configured components for…☆93Updated this week
- [KDD 2025] AgentGen: Enhancing Planning Abilities for Large Language Model based Agent via Environment and Task Generation☆35Nov 18, 2025Updated 8 months ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- A curated list of public dataset related to Industry 4.0.☆23Nov 4, 2022Updated 3 years ago
- An intuitive, easy-to-use python interface for batch resource requesting, access, job submission, and observation. Simplifying the develo…☆35Updated this week
- Database MCP server for MySQL, MariaDB, PostgreSQL, and SQLite - with builtin PII redaction and write-prevention☆30Aug 1, 2026Updated last week
- Agent economic trading market infrastructure. A system used for managing Agents, discovering Agents, scheduling Agents, evaluating Agents…☆33Updated this week
- Delegate complex tasks to Manus AI - web research, report generation, code building, data scraping. Task templates, monitoring, cost trac…☆26Mar 16, 2026Updated 4 months ago
- ☆29Jul 3, 2026Updated last month
- A minimal HTTP server implemented from scratch using Python sockets and threads☆12May 19, 2018Updated 8 years ago
- Durable Cloudflare computers for agents: run repos, steer live workspaces, verify results, and return receipts.☆47Jul 27, 2026Updated 2 weeks ago
- MCP server for Kaggle☆39May 21, 2026Updated 2 months ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- A Model Context Protocol (MCP) server for Langfuse, enabling AI agents to query Langfuse trace data for enhanced debugging and observabil…☆104Updated this week
- Cited 83-model x 49-benchmark LLM evaluation matrix with 18 matrix completion methods☆40Feb 25, 2026Updated 5 months ago
- A self-hosted, secure code execution sandbox for LLM agents deployed on your cloud infrastructure using SkyPilot. Built on llm-sandbox fo…☆17Jul 20, 2025Updated last year
- ☆46Jan 21, 2025Updated last year
- ☆40Jul 30, 2026Updated 2 weeks ago
- The Durable Task Framework is a lightweight, embeddable engine for writing durable, fault-tolerant business logic (orchestrations) as ord…☆17Aug 4, 2026Updated last week
- Observability-first proxy for MCP servers☆30Updated this week