Evaluation package that allows benchmarking of agentic AIs from various sources and frameworks by producing statistical results which can be compared across different use cases and datasets.
☆79Jun 26, 2026Updated 3 months ago
Alternatives and similar repositories for agent-quality-inspect
Users that are interested in agent-quality-inspect are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- A client SDK for the Data Attribute Recommendation service on SAP Business Technology Platform (SAP BTP). Part of SAP AI Business Service…☆21Jun 30, 2026Updated 3 months ago
- Experiments on using ChatGPT for failure mode classification☆12Sep 20, 2023Updated 3 years ago
- SDK to track cost-per-outcome for AI workflows☆18Aug 18, 2026Updated last month
- Official Spring AI support for latest watsonx.ai services☆27Updated this week
- Official GitHub repo for Scaling Physical Reasoning with the PHYSICS Dataset (NeurIPS25).☆16Sep 20, 2025Updated last year
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Know what your AI agents cost. API gateway with budget enforcement, session tracking, and MCP tools.☆16Oct 1, 2026Updated last week
- AI context observability & optimization for Claude Code, Copilot CLI, Codex, Gemini — TUI dashboard, preset optimization, cost tracking, …☆14Sep 16, 2026Updated 3 weeks ago
- In-Situ Evaluator: Real-Time Subsample Analysis☆17Jan 25, 2026Updated 8 months ago
- Code implementation for paper AbsenceBench: Language Models Can't Tell What's Missing☆19Oct 23, 2025Updated 11 months ago
- Source code for the paper: Hear Both Sides: Efficient Multi-Agent Debate via Diversity-Aware Message Retention☆18Aug 14, 2026Updated 2 months ago
- General purpose program synthetiser with existing Programming By Examples (PBE) pipeline☆25Jan 3, 2026Updated 9 months ago
- ContextCore: An MCP server for Claude (or any AI tool) that enables massive token saving through hybrid search (BM25 + Embeddings)☆23Jul 22, 2026Updated 2 months ago
- Comprehensive AI Model Evaluation Framework with advanced techniques including Temperature-Controlled Verdict Aggregation via Generalized…☆60Oct 7, 2026Updated last week
- Drive OSS standards and tools for data curation and evaluation creation for state of the art AI agents☆57Sep 30, 2026Updated 2 weeks ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Claude Code session cost tracker. Efficiency score, productive vs wasted breakdown, live terminal dashboard.☆19Apr 4, 2026Updated 6 months ago
- Code repository for CISO agent as part of ITBench☆22May 8, 2025Updated last year
- ☆33Updated this week
- Custom Scheduler to deploy ML models to TRTIS for GPU Sharing☆12Apr 1, 2020Updated 6 years ago
- 🏦 ComputeCFO — Your AI Financial Officer. Track, analyze, and optimize LLM API spending. Budget controls, ROI analysis, cost prediction.☆23Jul 9, 2026Updated 3 months ago
- A comprehensive toolkit for deploying production-ready Generative AI infrastructure on Amazon EKS. Includes pre-configured components for…☆96Oct 3, 2026Updated last week
- [KDD 2025] AgentGen: Enhancing Planning Abilities for Large Language Model based Agent via Environment and Task Generation☆35Nov 18, 2025Updated 10 months ago
- Go functions framework for OpenFunction☆18Jun 17, 2024Updated 2 years ago
- A curated list of public dataset related to Industry 4.0.☆25Nov 4, 2022Updated 3 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Delegate complex tasks to Manus AI - web research, report generation, code building, data scraping. Task templates, monitoring, cost trac…☆28Mar 16, 2026Updated 6 months ago
- The open-source AI agent control plane: MCP firewall, model gateway with budgets, human approvals, runtime observability, and audit trail…☆77Updated this week
- MCP server implemented in Elixir☆36Updated this week
- A universal plugin framework for development tools that enables seamless browser-server communication and MCP (Model Context Protocol) in…☆34Apr 27, 2026Updated 5 months ago
- Cited 83-model x 49-benchmark LLM evaluation matrix with 18 matrix completion methods☆41Feb 25, 2026Updated 7 months ago
- Gardener Hackathon related stuff lives here. Everything related to past and future hackathons is welcome☆11Oct 24, 2025Updated 11 months ago
- Customised fork of cluster-autoscaler to support machine-controller-manager☆17Sep 29, 2026Updated 2 weeks ago
- The Durable Task Framework is a lightweight, embeddable engine for writing durable, fault-tolerant business logic (orchestrations) as ord…☆17Updated this week
- Observability-first proxy for MCP servers☆30Aug 9, 2026Updated 2 months ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- Lightweight cross-platform AI coding agent usage & cost tracker. Single binary, SQLite, web dashboard. | 轻量跨平台 AI 编程工具用量与费用追踪器，单二进制、SQLit…☆29Jul 29, 2026Updated 2 months ago
- Automatically generate database models, GraphQL schema, REST endpoints, MCPs, SDKs and tests from Pydantic models.☆29Oct 7, 2026Updated last week
- ☆51May 4, 2026Updated 5 months ago
- Depth map integration using VTK and Cuda☆15Sep 11, 2017Updated 9 years ago
- ModelMesh Performance Scripts, Dashboard and Pipelines☆13Apr 14, 2026Updated 6 months ago
- A context engineering agent designed to generate, manage, and optimize structured context sets from your database schemas. It bridges the…☆40Updated this week
- Docker example running flask app, redis db, and nginx proxy server with ssl☆10Aug 6, 2017Updated 9 years ago