☑️ A curated list of tools, methods & platforms for evaluating AI reliability in real applications
☆99Mar 25, 2026Updated 4 months ago
Alternatives and similar repositories for awesome-ai-eval
Users that are interested in awesome-ai-eval are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- An archiving/caching statistics tool for the Brawlhalla API☆11Jun 27, 2026Updated last month
- AI-powered Ethereum crypto trading bot using ChatGPT for automated DeFi strategies, arbitrage, and passive income generation.☆19Jan 12, 2026Updated 6 months ago
- Provide quick access to useful actions by adding context menus to your iOS app.☆18Dec 24, 2025Updated 7 months ago
- StepShield: When, Not Whether to Intervene on Rogue Agents — NeurIPS 2026 benchmark for temporal evaluation of AI agent guardrails (9,429…☆82Jul 7, 2026Updated 3 weeks ago
- Static security scanner for AI agents. Catches prompt injection, runaway loops, missing oversight, and compliance gaps across 21 framewor…☆29Updated this week
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- A fully featured implementation of the Sui SDK for developing Unity games☆22Nov 12, 2025Updated 8 months ago
- SmallML is a three-layer Bayesian framework that enables small and medium-sized enterprises (SMEs) to build production-grade machine lear…☆32Jun 20, 2026Updated last month
- Comprehensive Game Hacking Cheat Sheet for security researchers, reverse engineers, and CTF participants. Covers memory analysis, anti-ch…☆77Jan 11, 2026Updated 6 months ago
- Implements a machine learning-based SMS spam detection system. It classifies incoming text messages as Spam or Ham (Not Spam) using Natur…☆25Dec 24, 2025Updated 7 months ago
- A Python SDK for FinancialData.Net API - Real-time & Historical Stock Market Data☆34Updated this week
- A standalone HLS/MP4 video player with subtitle support, watch party, Chromecast and Automatic Thumbnails generation. Built with React.☆22Jul 17, 2026Updated last week
- MCP server for spreadsheet analysis and editing. Slim, token-efficient tool surface designed for LLM agents.☆51Jul 20, 2026Updated last week
- ContextLoom is the shared "brain" for multi-agent systems. It weaves together memory threads from frameworks like DSPy and CrewAI into a …☆12Dec 6, 2025Updated 7 months ago
- Quick setup for projects or repositories using Claude Code with built-in agents, ticket system, and planning tools.☆56Jan 18, 2026Updated 6 months ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- High-performance indexer for services using the U2P system written in Rust☆515Jun 27, 2026Updated last month
- The RL training platform. Use ReinforceNow to train reliable AI agents from raw data to production.☆32Feb 9, 2026Updated 5 months ago
- A modern PowerShell-based GUI tool for Microsoft Intune administration - including device ownership analysis, configuration backup, assig…☆37Jan 14, 2026Updated 6 months ago
- Django Smart Home☆14Jul 7, 2026Updated 3 weeks ago
- The opensource all-in-one framework for Prediction Markets☆149May 14, 2026Updated 2 months ago
- Build and ship production ML pipelines faster: a pipeline library with an optional self-hosted visual layer for modular, reproducible wor…☆46Updated this week
- Teaching LLMs to reason in the Latent Space to precondition responses.☆158Jul 22, 2026Updated last week
- ☆27Jan 14, 2026Updated 6 months ago
- ☆84Updated this week
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- Dockerized Hytale server with auto-updates, configurable env vars, persistent storage, and optional authentication.☆30Feb 16, 2026Updated 5 months ago
- Agent Markdown Language☆90Dec 23, 2025Updated 7 months ago
- The Zero-Config TypeScript Framework for Modern Backends.☆99Jul 3, 2026Updated 3 weeks ago
- LLM and agent evaluation for Java & Kotlin. Runs in JUnit and CI. Spring AI, LangChain4j, Koog, Embabel, and any LLM client.☆47Updated this week
- DimanDocs public repo☆18Jun 14, 2026Updated last month
- Extract Text from Image☆124Jun 15, 2026Updated last month
- An AI-driven genomic intelligence system delivering structured ClinVar interpretation and high-precision exon, intron, and gene queries u…☆23May 4, 2026Updated 2 months ago
- Turn ML models into APIs with one command☆22Jan 29, 2026Updated 6 months ago
- Deploy any AI model, agent, database, RAG, and pipeline locally or remotely in minutes☆835Jun 10, 2026Updated last month
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- ICS Incident Response Automation Framework Python framework for executing automated incident response playbooks in ICS/SCADA environments…☆18Nov 29, 2025Updated 8 months ago
- A unified, driver-based Laravel toolkit for working with multiple LLM providers for chat, image generation, and more.☆39May 14, 2026Updated 2 months ago
- MCP server that gives AI assistants deep codebase understanding. Semantic graph, BM25 search, impact analysis, code review.☆68Jul 17, 2026Updated last week
- OwnPay - 🏆 Top 3 @ Monad NYC Hackathon | Apple Pay-like contactless payments for Web3. Payment layer (not a wallet) that brings the sa…☆163Dec 18, 2025Updated 7 months ago
- The most popular Dungeon Rampage cheat, fully free and open source☆34Dec 11, 2025Updated 7 months ago
- ☆23Oct 22, 2025Updated 9 months ago
- Worlds first open-source real-time end-to-end spoken dialogue model with personalized voice cloning.☆550Apr 17, 2026Updated 3 months ago