Comprehensive AI Model Evaluation Framework with advanced techniques including Temperature-Controlled Verdict Aggregation via Generalized Power Mean. Support for multiple LLM providers and 15+ evaluation metrics for RAG systems and AI agents.
☆59Sep 28, 2026Updated this week
Alternatives and similar repositories for Eval-ai-library
Users that are interested in Eval-ai-library are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- A DuckDB ADBC Scanner Extension - adds support for using ADBC drivers with DuckDB as a client.☆25Updated this week
- DuckDB Kernel - analytical execution runtime for Jupyter☆24Jun 29, 2026Updated 3 months ago
- Incremental View Maintenance on DuckDB☆51Updated this week
- Query Elasticsearch data directly from DuckDB☆23Apr 29, 2026Updated 5 months ago
- DuckDB wrapper for FAISS - Experimental☆32Aug 6, 2026Updated last month
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Know what your AI agents cost. API gateway with budget enforcement, session tracking, and MCP tools.☆16Sep 9, 2026Updated 3 weeks ago
- AI context observability & optimization for Claude Code, Copilot CLI, Codex, Gemini — TUI dashboard, preset optimization, cost tracking, …☆14Sep 16, 2026Updated 2 weeks ago
- VectraDB is an in-memory, high performance vector database written in Go.☆33Jun 21, 2026Updated 3 months ago
- ContextCore: An MCP server for Claude (or any AI tool) that enables massive token saving through hybrid search (BM25 + Embeddings)☆23Jul 22, 2026Updated 2 months ago
- Self-hosted dashboard for OpenClaw AI agents. Cost tracking, budget enforcement, session replay, config safety.☆15Mar 10, 2026Updated 6 months ago
- Claude Code session cost tracker. Efficiency score, productive vs wasted breakdown, live terminal dashboard.☆19Apr 4, 2026Updated 5 months ago
- A Model Context Protocol server allows Clients to interact with Xero☆23Updated this week
- The package to wrap Aiport server implementation (DuckDB Airport Extension)☆45Apr 6, 2026Updated 5 months ago
- An open-source, code-first C# (Dotnet) toolkit for building, evaluating, and deploying sophisticated AI agents with flexibility and contr…☆24Jul 11, 2026Updated 2 months ago
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- Please see https://github.com/microsoftgraph/msgraph-training-ios-swift for a Swift sample.☆11Mar 6, 2020Updated 6 years ago
- FastroAI wraps PydanticAI with production essentials: cost tracking in microcents, multi-step pipelines, and tools that handle failures g…☆19Jul 21, 2026Updated 2 months ago
- 🏦 ComputeCFO — Your AI Financial Officer. Track, analyze, and optimize LLM API spending. Budget controls, ROI analysis, cost prediction.☆23Jul 9, 2026Updated 2 months ago
- Swift library for decoding JSON☆12Feb 20, 2021Updated 5 years ago
- A DuckDB extension implementing Measures in SQL☆58Sep 14, 2026Updated 2 weeks ago
- Open Source geospatial object engine written in Rust☆81Updated this week
- Database MCP server for MySQL, MariaDB, PostgreSQL, and SQLite - with builtin PII redaction and write-prevention☆32Sep 18, 2026Updated 2 weeks ago
- Agent economic trading market infrastructure. A system used for managing Agents, discovering Agents, scheduling Agents, evaluating Agents…☆33Updated this week
- Delegate complex tasks to Manus AI - web research, report generation, code building, data scraping. Task templates, monitoring, cost trac…☆28Mar 16, 2026Updated 6 months ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- Durable Cloudflare computers for agents: run repos, steer live workspaces, verify results, and return receipts.☆55Jul 27, 2026Updated 2 months ago
- MCP server implemented in Elixir☆36Sep 4, 2026Updated 3 weeks ago
- Todo TeamCity plugin☆10Jul 23, 2015Updated 11 years ago
- Observability-first proxy for MCP servers☆30Aug 9, 2026Updated last month
- Lightweight cross-platform AI coding agent usage & cost tracker. Single binary, SQLite, web dashboard. | 轻量跨平台 AI 编程工具用量与费用追踪器，单二进制、SQLit…☆29Jul 29, 2026Updated 2 months ago
- Automatically generate database models, GraphQL schema, REST endpoints, MCPs, SDKs and tests from Pydantic models.☆29Sep 9, 2026Updated 3 weeks ago
- jarroo/FuturePromise: Port of Apple's SwiftNIO implementation of Futures and Promises, based on DispatchQueue instead of EventLoop.☆14Mar 22, 2018Updated 8 years ago
- A context engineering agent designed to generate, manage, and optimize structured context sets from your database schemas. It bridges the…☆40Sep 25, 2026Updated last week
- A powerful DuckDB extension that enables seamless querying of Snowflake databases using Arrow ADBC drivers with runtime loading capabilit…☆63Sep 22, 2026Updated last week
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- Swift support for Atom IDE.☆18Nov 20, 2018Updated 7 years ago
- RootCause is a local-first MCP server that turns natural-language requests into evidence-backed incident analysis, Kubernetes diagnostics…☆42May 31, 2026Updated 4 months ago
- An open-source Python SDK for analyzing, evaluating, and curating agent traces stored in BigQuery. Built on top of the BigQuery Agent Ana…☆51Updated this week
- Your AI writes the code; Karajan governs how it happens: TDD-first method, cross-AI review on every commit and git gates that make a fals…☆40Updated this week
- A comprehensive Burp Suite Professional extension providing MCP server functionality for AI-powered security testing with AI Agents☆29Sep 12, 2026Updated 3 weeks ago
- PinchBench is a benchmarking system for evaluating LLM models as OpenClaw coding agents. Made with 🦀 by the humans at https://kilo.ai☆41Updated this week
- Standalone MCP server plugin for IDA Pro.☆52Sep 20, 2026Updated last week