Comprehensive AI Evaluation Framework with advanced techniques including Temperature-Controlled Verdict Aggregation via Generalized Power Mean. Support for multiple LLM providers and 15+ evaluation metrics for RAG systems and AI agents.
☆15Mar 3, 2026Updated 7 months ago
Alternatives and similar repositories for eval-ai-library
Users that are interested in eval-ai-library are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- The web GUI & productivity workspace for OpenClaw (237K+ stars) — tasks, news, dashboards, package tracking, skill marketplace. Self-host…☆14Mar 2, 2026Updated 7 months ago
- A lightweight Docker orchestrator that helps you run and scale background processes on a single server—simple, fast, and without the hass…☆13Feb 17, 2026Updated 8 months ago
- CrabbyQ is a rust framework for routing events inspired by Faststream and axum. And its crabby as a crab about latency!☆22May 11, 2026Updated 5 months ago
- Repository for Git course.☆12Jul 26, 2024Updated 2 years ago
- Personal configs☆16Oct 23, 2026Updated last week
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Nodejs Chatroom running on long polling and native websockets☆16Sep 13, 2014Updated 12 years ago
- Игрушечный, но душный репозиторий около Memory Models☆21Aug 5, 2026Updated 2 months ago
- Python Socket.IO server and client☆19Aug 10, 2026Updated 2 months ago
- JavaScript-Typescript-Questions☆18Mar 21, 2024Updated 2 years ago
- Native macOS menu bar dictation utility: hold a key, speak, and insert text.☆22Sep 27, 2026Updated last month
- Comprehensive AI Model Evaluation Framework with advanced techniques including Temperature-Controlled Verdict Aggregation via Generalized…☆60Oct 23, 2026Updated last week
- Mutation testing for type annotation in python projects☆25Oct 22, 2026Updated last week
- chaos_theory is a modern Rust property-based testing and structure-aware fuzzing library☆25Sep 20, 2026Updated last month
- Helps keep usages of ObsoleteAttribute consistent.☆35Updated this week
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- Local speech-to-text transcription app for Linux using Whisper models.☆27Jan 12, 2026Updated 9 months ago
- Blazing-fast data structures written in Rust for Python.☆81Oct 22, 2026Updated last week
- Innovative service for team formation at IT competitions.☆22Jun 13, 2026Updated 4 months ago
- ☆35Sep 6, 2026Updated last month
- OrcaSlicer fork that prints with two different nozzle sizes in one print, each at its own layer height.☆49Updated this week
- A modular and flexible backtesting framework for trading strategies in Python using Backtrader.☆29Aug 25, 2025Updated last year
- ☆30Jul 22, 2026Updated 3 months ago
- Tool for detecting duplicate photos and diffing directories☆48Aug 27, 2026Updated 2 months ago
- A proof of concept for zero downtime blue/green deployments with HAProxy, Docker and docker-compose.☆38Jun 20, 2019Updated 7 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- CSS template to modify and enhance the appearance of Streamlit applications☆29Apr 23, 2025Updated last year
- A range of scripts to provision and configure open source cloud services.☆25May 30, 2021Updated 5 years ago
- ☆28Feb 26, 2026Updated 8 months ago
- A SIMD boosted high-performance and correct Python JSON parsing library, faster than the fastest.☆39Updated this week
- OOMWOO One open-source vacuum cleaner 3D CAD design☆82Updated this week
- AI-powered REST API testing framework - drop-in replacement for requests with intelligent validation☆39Sep 9, 2025Updated last year
- Build high-performance, scalable, server-side reactive web applications — without a separate frontend framework or a complex JavaScript s…☆45Updated this week
- file browser for the web☆51Oct 14, 2026Updated 2 weeks ago
- Multi-agent racing tournament on MetaDrive☆37Apr 1, 2026Updated 6 months ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- Python library for building modular CLI applications☆34Oct 20, 2026Updated last week
- EXPERIMENTAL project to build small tools useful for developers of EPiServer CMS☆46Jan 22, 2024Updated 2 years ago
- An API compatibility layer for log4js - library makers should use this to avoid version conflicts☆34Aug 29, 2022Updated 4 years ago
- aiohttp-powered httpx client☆50Jul 25, 2026Updated 3 months ago
- A kanban board for your codebase. Features stored as markdown.☆98Jul 1, 2026Updated 3 months ago
- Complete Python toolkit for Claude Code — 20 skills, 11 agents, 11 commands for FastAPI, Django, SQLAlchemy, pytest, Allure, PostgreSQL, …☆53Mar 25, 2026Updated 7 months ago
- A local-only calories tracker app made with TanStack Router, PGlite, Effect, XState and drizzle. The app is all client-side, fast, privat…☆65Mar 12, 2025Updated last year