Comprehensive AI Model Evaluation Framework with advanced techniques including Temperature-Controlled Verdict Aggregation via Generalized Power Mean. Support for multiple LLM providers and 15+ evaluation metrics for RAG systems and AI agents.
☆57Sep 8, 2026Updated this week
Alternatives and similar repositories for Eval-ai-library
Users that are interested in Eval-ai-library are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- A DuckDB ADBC Scanner Extension - adds support for using ADBC drivers with DuckDB as a client.☆20Sep 4, 2026Updated last week
- Incremental View Maintenance on DuckDB☆43Updated this week
- Query Elasticsearch data directly from DuckDB☆23Apr 29, 2026Updated 4 months ago
- A lightweight Docker orchestrator that helps you run and scale background processes on a single server—simple, fast, and without the hass…☆14Feb 17, 2026Updated 6 months ago
- CrabbyQ is a rust framework for routing events inspired by Faststream and axum. And its crabby as a crab about latency!☆21May 11, 2026Updated 4 months ago
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- VectraDB is an in-memory, high performance vector database written in Go.☆33Jun 21, 2026Updated 2 months ago
- Personal configs☆17Updated this week
- Python Socket.IO server and client☆19Aug 10, 2026Updated last month
- CLI that simplifies the use of Docker Machine, Swarm, and Compose☆10Aug 7, 2016Updated 10 years ago
- ContextCore: An MCP server for Claude (or any AI tool) that enables massive token saving through hybrid search (BM25 + Embeddings)☆23Jul 22, 2026Updated last month
- Mutation testing for type annotation in python projects☆20Jun 17, 2026Updated 2 months ago
- Claude Code session cost tracker. Efficiency score, productive vs wasted breakdown, live terminal dashboard.☆18Apr 4, 2026Updated 5 months ago
- ☆19Jul 22, 2026Updated last month
- Local speech-to-text transcription app for Linux using Whisper models.☆25Jan 12, 2026Updated 8 months ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- The package to wrap Aiport server implementation (DuckDB Airport Extension)☆45Apr 6, 2026Updated 5 months ago
- Please see https://github.com/microsoftgraph/msgraph-training-ios-swift for a Swift sample.☆11Mar 6, 2020Updated 6 years ago
- 🏦 ComputeCFO — Your AI Financial Officer. Track, analyze, and optimize LLM API spending. Budget controls, ROI analysis, cost prediction.☆23Jul 9, 2026Updated 2 months ago
- Innovative service for team formation at IT competitions.☆22Jun 13, 2026Updated 3 months ago
- Swift library for decoding JSON☆12Feb 20, 2021Updated 5 years ago
- Open Source geospatial object engine written in Rust☆76May 17, 2026Updated 3 months ago
- Hyperdrive - A Hypermedia Specification☆12Jan 30, 2018Updated 8 years ago
- Database MCP server for MySQL, MariaDB, PostgreSQL, and SQLite - with builtin PII redaction and write-prevention☆31Sep 1, 2026Updated last week
- Delegate complex tasks to Manus AI - web research, report generation, code building, data scraping. Task templates, monitoring, cost trac…☆27Mar 16, 2026Updated 5 months ago
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- Opinionated AI agent skills for building applications with MotherDuck☆58Sep 6, 2026Updated last week
- MCP server implemented in Elixir☆35Sep 4, 2026Updated last week
- Local-first desktop IDE for dbt, with AI assistance and one-click project/model generation.☆61Updated this week
- A universal plugin framework for development tools that enables seamless browser-server communication and MCP (Model Context Protocol) in…☆34Apr 27, 2026Updated 4 months ago
- Multi-agent racing tournament on MetaDrive☆35Apr 1, 2026Updated 5 months ago
- Todo TeamCity plugin☆10Jul 23, 2015Updated 11 years ago
- Observability-first proxy for MCP servers☆30Aug 9, 2026Updated last month
- Lightweight cross-platform AI coding agent usage & cost tracker. Single binary, SQLite, web dashboard. | 轻量跨平台 AI 编程工具用量与费用追踪器，单二进制、SQLit…☆29Jul 29, 2026Updated last month
- Automatically generate database models, GraphQL schema, REST endpoints, MCPs, SDKs and tests from Pydantic models.☆29Updated this week
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- A context engineering agent designed to generate, manage, and optimize structured context sets from your database schemas. It bridges the…☆39Updated this week
- Local-first beat library built for producers — catalog, BPM/key analysis, license tiers & PDFs, tagged-MP3 + loopkit export, and assisted…☆29Aug 31, 2026Updated last week
- An open-source Python SDK for analyzing, evaluating, and curating agent traces stored in BigQuery. Built on top of the BigQuery Agent Ana…☆47Updated this week
- Swift support for Atom IDE.☆18Nov 20, 2018Updated 7 years ago
- Agent pipeline for the startup evaluation☆30Apr 27, 2026Updated 4 months ago
- RootCause is a local-first MCP server that turns natural-language requests into evidence-backed incident analysis, Kubernetes diagnostics…☆42May 31, 2026Updated 3 months ago
- Local multi-agent coding orchestrator with 22 pipeline roles, TDD enforcement, SonarQube integration, and automated code review. Supports…☆35Updated this week