Comprehensive AI Model Evaluation Framework with advanced techniques including Temperature-Controlled Verdict Aggregation via Generalized Power Mean. Support for multiple LLM providers and 15+ evaluation metrics for RAG systems and AI agents.
☆55Jul 10, 2026Updated last month
Alternatives and similar repositories for Eval-ai-library
Users that are interested in Eval-ai-library are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Comprehensive AI Evaluation Framework with advanced techniques including Temperature-Controlled Verdict Aggregation via Generalized Power…☆16Mar 3, 2026Updated 5 months ago
- A DuckDB ADBC Scanner Extension - adds support for using ADBC drivers with DuckDB as a client.☆19Aug 11, 2026Updated last week
- DuckDB Kernel - analytical execution runtime for Jupyter☆24Jun 29, 2026Updated last month
- Query Elasticsearch data directly from DuckDB☆22Apr 29, 2026Updated 3 months ago
- CrabbyQ is a rust framework for routing events inspired by Faststream and axum. And its crabby as a crab about latency!☆21May 11, 2026Updated 3 months ago
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- Know what your AI agents cost. API gateway with budget enforcement, session tracking, and MCP tools.☆16Aug 16, 2026Updated last week
- Игрушечный, но душный репозиторий около Memory Models☆22Aug 5, 2026Updated 2 weeks ago
- chaos_theory is a modern Rust property-based testing and structure-aware fuzzing library☆21Updated this week
- Python Socket.IO server and client☆19Aug 10, 2026Updated 2 weeks ago
- CLI that simplifies the use of Docker Machine, Swarm, and Compose☆10Aug 7, 2016Updated 10 years ago
- ContextCore: An MCP server for Claude (or any AI tool) that enables massive token saving through hybrid search (BM25 + Embeddings)☆23Jul 22, 2026Updated last month
- Self-hosted dashboard for OpenClaw AI agents. Cost tracking, budget enforcement, session replay, config safety.☆16Mar 10, 2026Updated 5 months ago
- Claude Code session cost tracker. Efficiency score, productive vs wasted breakdown, live terminal dashboard.☆18Apr 4, 2026Updated 4 months ago
- A Model Context Protocol server allows Clients to interact with Xero☆21Updated this week
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Fast data structures and algorithms written in Rust, usable from Python.☆76Updated this week
- The Hugr service☆46Updated this week
- An open-source, code-first C# (Dotnet) toolkit for building, evaluating, and deploying sophisticated AI agents with flexibility and contr…☆24Jul 11, 2026Updated last month
- pdf_text_overlay is a python library to write text on top of pdf.☆41May 9, 2025Updated last year
- FastroAI wraps PydanticAI with production essentials: cost tracking in microcents, multi-step pipelines, and tools that handle failures g…☆19Jul 21, 2026Updated last month
- 🏦 ComputeCFO — Your AI Financial Officer. Track, analyze, and optimize LLM API spending. Budget controls, ROI analysis, cost prediction.☆23Jul 9, 2026Updated last month
- A modular and flexible backtesting framework for trading strategies in Python using Backtrader.☆27Aug 25, 2025Updated 11 months ago
- Swift library for decoding JSON☆12Feb 20, 2021Updated 5 years ago
- An implementation of Measures in SQL as a DuckDB extension☆58Jul 3, 2026Updated last month
- Deploy open-source AI quickly and easily - Special Bonus Offer • AdRunpod Hub is built for open source. One-click deployment and autoscaling endpoints without provisioning your own infrastructure.
- Agent economic trading market infrastructure. A system used for managing Agents, discovering Agents, scheduling Agents, evaluating Agents…☆33Aug 11, 2026Updated last week
- Delegate complex tasks to Manus AI - web research, report generation, code building, data scraping. Task templates, monitoring, cost trac…☆27Mar 16, 2026Updated 5 months ago
- The open-source AI agent control plane: MCP firewall, model gateway with budgets, human approvals, runtime observability, and audit trail…☆48Updated this week
- CSS template to modify and enhance the appearance of Streamlit applications☆31Apr 23, 2025Updated last year
- MCP server implemented in Elixir☆35Updated this week
- Local-first desktop IDE for dbt, with AI assistance and one-click project/model generation.☆60Updated this week
- Build high-performance, scalable, server-side reactive web applications — without a separate frontend framework or a complex JavaScript s…☆46Updated this week
- Observability-first proxy for MCP servers☆30Aug 9, 2026Updated 2 weeks ago
- Lightweight cross-platform AI coding agent usage & cost tracker. Single binary, SQLite, web dashboard. | 轻量跨平台 AI 编程工具用量与费用追踪器，单二进制、SQLit…☆28Jul 29, 2026Updated 3 weeks ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Local-first beat library built for producers — catalog, BPM/key analysis, license tiers & PDFs, tagged-MP3 + loopkit export, and assisted…☆27Updated this week
- A context engineering agent designed to generate, manage, and optimize structured context sets from your database schemas. It bridges the…☆38Aug 13, 2026Updated last week
- A powerful DuckDB extension that enables seamless querying of Snowflake databases using Arrow ADBC drivers with runtime loading capabilit…☆59Aug 7, 2026Updated 2 weeks ago
- A Go toolkit for building AI agents and applications across multiple providers. Unified LLM client, agent framework with handoffs, tool c…☆38Updated this week
- Your AI coding activity, at a glance. Native macOS menu bar app that monitors Claude Code, Cursor, Codex & Gemini — live token tracking, …☆33Jun 5, 2026Updated 2 months ago
- Agent pipeline for the startup evaluation☆30Apr 27, 2026Updated 3 months ago
- RootCause is a local-first MCP server that turns natural-language requests into evidence-backed incident analysis, Kubernetes diagnostics…☆42May 31, 2026Updated 2 months ago