Comprehensive AI Model Evaluation Framework with advanced techniques including Temperature-Controlled Verdict Aggregation via Generalized Power Mean. Support for multiple LLM providers and 15+ evaluation metrics for RAG systems and AI agents.
☆58Jul 10, 2026Updated 3 weeks ago
Alternatives and similar repositories for Eval-ai-library
Users that are interested in Eval-ai-library are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Comprehensive AI Evaluation Framework with advanced techniques including Temperature-Controlled Verdict Aggregation via Generalized Power…☆15Mar 3, 2026Updated 5 months ago
- Incremental View Maintenance on DuckDB☆31Updated this week
- DuckDB wrapper for FAISS - Experimental☆31Mar 9, 2026Updated 4 months ago
- AI context observability & optimization for Claude Code, Copilot CLI, Codex, Gemini — TUI dashboard, preset optimization, cost tracking, …☆14Jun 17, 2026Updated last month
- VectraDB is an in-memory, high performance vector database written in Go.☆33Jun 21, 2026Updated last month
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- CLI that simplifies the use of Docker Machine, Swarm, and Compose☆10Aug 7, 2016Updated 9 years ago
- ContextCore: An MCP server for Claude (or any AI tool) that enables massive token saving through hybrid search (BM25 + Embeddings)☆22Jul 22, 2026Updated last week
- Claude Code session cost tracker. Efficiency score, productive vs wasted breakdown, live terminal dashboard.☆18Apr 4, 2026Updated 3 months ago
- 自动化构建react, vue, jquery, js类库, koa/express/egg项目, node-plugin, typescript 等等多种项目结构初始化☆10Dec 27, 2019Updated 6 years ago
- The Hugr service☆45Updated this week
- The package to wrap Aiport server implementation (DuckDB Airport Extension)☆45Apr 6, 2026Updated 3 months ago
- Videos and articles blog☆11Mar 1, 2022Updated 4 years ago
- public profile readme☆14Jan 23, 2025Updated last year
- 🏦 ComputeCFO — Your AI Financial Officer. Track, analyze, and optimize LLM API spending. Budget controls, ROI analysis, cost prediction.☆23Jul 9, 2026Updated 3 weeks ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- A highly performant Fast-Fourier Transformer in go☆48Oct 29, 2025Updated 9 months ago
- Swift library for decoding JSON☆12Feb 20, 2021Updated 5 years ago
- Open Source geospatial object engine written in Rust☆73May 17, 2026Updated 2 months ago
- An implementation of Measures in SQL as a DuckDB extension☆58Jul 3, 2026Updated last month
- Hyperdrive - A Hypermedia Specification☆12Jan 30, 2018Updated 8 years ago
- Opinionated AI agent skills for building applications with MotherDuck☆53Updated this week
- Database MCP server for MySQL, MariaDB, PostgreSQL, and SQLite - with builtin PII redaction and write-prevention☆30Updated this week
- react 17.0.2 版本源码学习 debug☆15Apr 11, 2022Updated 4 years ago
- Delegate complex tasks to Manus AI - web research, report generation, code building, data scraping. Task templates, monitoring, cost trac…☆26Mar 16, 2026Updated 4 months ago
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- The open-source AI agent control plane: MCP firewall, model gateway with budgets, human approvals, runtime observability, and audit trail…☆43Updated this week
- My personal website.☆18Dec 22, 2025Updated 7 months ago
- dgit是一个可以直接下载github 指定分支指定目录下的文件或目录的工具☆16Aug 24, 2020Updated 5 years ago
- 记录您对左耳朵耗子（陈皓）的点滴回忆☆15May 17, 2023Updated 3 years ago
- Todo TeamCity plugin☆10Jul 23, 2015Updated 11 years ago
- Lightweight cross-platform AI coding agent usage & cost tracker. Single binary, SQLite, web dashboard. | 轻量跨平台 AI 编程工具用量与费用追踪器，单二进制、SQLit…☆28Updated this week
- jarroo/FuturePromise: Port of Apple's SwiftNIO implementation of Futures and Promises, based on DispatchQueue instead of EventLoop.☆14Mar 22, 2018Updated 8 years ago
- An open-source Python SDK for analyzing, evaluating, and curating agent traces stored in BigQuery. Built on top of the BigQuery Agent Ana…☆35Updated this week
- A Go toolkit for building AI agents and applications across multiple providers. Unified LLM client, agent framework with handoffs, tool c…☆36Updated this week
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Your AI coding activity, at a glance. Native macOS menu bar app that monitors Claude Code, Cursor, Codex & Gemini — live token tracking, …☆31Jun 5, 2026Updated last month
- Agent pipeline for the startup evaluation☆30Apr 27, 2026Updated 3 months ago
- Deterministic governance for AI coding agents. Cedar-based policy engine that intercepts every agent action and evaluates it against dete…☆38Updated this week
- Local multi-agent coding orchestrator with 22 pipeline roles, TDD enforcement, SonarQube integration, and automated code review. Supports…☆31Updated this week
- A comprehensive Burp Suite Professional extension providing MCP server functionality for AI-powered security testing with AI Agents☆29Jul 21, 2026Updated last week
- Simulated environments for robot agent evaluation and reinforcement learning.☆34Jul 7, 2026Updated 3 weeks ago
- Standalone MCP server plugin for IDA Pro.☆46Apr 27, 2026Updated 3 months ago