Accuracy, latency p95, and cost benchmarking for model-based solutions, with per-field ground-truth scoring.
☆105Sep 2, 2026Updated last month
Alternatives and similar repositories for ai-evaluation-framework
Users that are interested in ai-evaluation-framework are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- A map of modern time-series forecasting architectures, each with a short README and runnable code.☆133Sep 2, 2026Updated last month
- A general-purpose engine for large-scale, repeated information gathering by a fleet of workers.☆147Oct 1, 2026Updated 2 weeks ago
- OpenMail platform plugin for Hermes Agent: an email address for your agent☆69Oct 6, 2026Updated last week
- ☆296Sep 22, 2026Updated 3 weeks ago
- Your browser. Ready to act. An MIT-licensed desktop browser agent for website tasks, cited research, and supported games.☆123Oct 7, 2026Updated last week
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- Lossless AI compression: 33% less GPU memory, bit for bit.☆252Updated this week
- ☆102Sep 27, 2026Updated 2 weeks ago
- Paper artifacts, figures, aggregate data, and share cards for the DXRG paper: What LLM Trading Agents Actually Do in Production (six mont…☆80Sep 10, 2026Updated last month
- Pump Terminal is a self hosted web-based Solana token launcher and trading console for Pump.fun workflows. It provides a tabbed UI for to…☆64Feb 8, 2026Updated 8 months ago
- A typed, self-hosted data layer for structured personal data, built to make that data usable anywhere.☆117Updated this week
- A 302 neuron network on the real C. elegans wiring diagram, with a steering layer for local language models.☆205Updated this week
- Hive Memory☆161Updated this week
- ☆98Updated this week
- ☆276Aug 19, 2026Updated last month
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- Reproducible monthly demand forecasting with Random Forest, chronological backtests, transparent baselines, and a guided local app.☆73Oct 7, 2026Updated last week
- Free DLSS Frame Generation (x2/x3/x4) for Baldur's Gate 3 on Vulkan via NVIDIA Streamline. Compatible with BG3SE, MCM and DLSS 5 (Neural …☆94Oct 1, 2026Updated 2 weeks ago
- A local-first Windows application for dictation and meeting transcription, with searchable notes, optional local AI formatting and privat…☆207Updated this week
- WebView automation for Kotlin Multiplatform. Run page workflows in an embedded WebView on Android, iOS and desktop, from your app, a test…☆105Updated this week
- Universal AI Charter: plain-language governance principles and a public certification registry for AI models, built on disclosure instead…☆108Sep 26, 2026Updated 3 weeks ago
- ☆77Updated this week
- A sniper to snipe highly wanted Minecraft usernames, very quickly. Uses the multi-threaded feature in Elixir to bypass Minecraft's antibo…☆235Jul 2, 2021Updated 5 years ago
- 记得她说过的每一句话，也记得你答应过的每一件事。A self-hosted AI chief of staff for your chats — remembers what they said and what you promised.☆119Sep 28, 2026Updated 2 weeks ago
- All-in-one interview preparation platform for java engineering track☆88Sep 4, 2026Updated last month
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- A closed-loop control plane for cloud-native distributed systems: forecast-driven autoscaling, streaming-pipeline recalibration, governed…☆425Updated this week
- Know Your Backend is a Plugin that help your AI to generate a structured Model/View/Controller application, witouth surprise, code duplic…☆79Updated this week
- A real-time machine learning system that predicts when a user is likely to make a mistake before it occurs.☆182Sep 21, 2026Updated 3 weeks ago
- Understand your agent's decisions☆166Aug 16, 2026Updated 2 months ago
- Open-source AI citation monitoring platform.☆126Updated this week
- Catalogo curato dei server MCP (Model Context Protocol) italiani — dati pubblici, legal-tech, fatturazione, PA e altro.☆92Sep 11, 2026Updated last month
- Hands-off algorithmic stock trading on AWS Lambda — ~$0.15/month. Alpaca + SAM + Python.☆84Updated this week
- Bosnian-first offline assistant: type, speak, and snap street text → English. FastAPI app + Kaggle-trained listen/read models. Fail-stop …☆171Updated this week
- Automatic computer use agent for end-to-end automation workflows on macOS, Windows, Linux, iOS and the browser.☆109Updated this week
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Seedance 2.0 API — text-to-video and image-to-video examples☆329Aug 14, 2026Updated 2 months ago
- The Arandu project skeleton, which aru new clones.☆281Updated this week
- Self-hosted PaaS for one machine: apps, local AI models and databases, operable by coding agents over MCP.☆86Updated this week
- Botscent tells your site if an AI agent, not a person, is browsing it, and which one. 5 KB, MIT, 0 deps.☆77Oct 8, 2026Updated last week
- Reconstruct 3D meshes from images with several open-source models and score which did it best.☆278Sep 2, 2026Updated last month
- On-device voice dictation for iPhone and Android. Optional self-hosted VocaGateway. Android 13+ beta, iOS 17+ source build.☆79Updated this week
- ☆1,194Oct 10, 2026Updated last week