☑️ A curated list of tools, methods & platforms for evaluating AI reliability in real applications
☆105Mar 25, 2026Updated 4 months ago
Alternatives and similar repositories for awesome-ai-eval
Users that are interested in awesome-ai-eval are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Open Source Reviews Curated by GitHub Users☆13Nov 18, 2025Updated 9 months ago
- AI-powered Ethereum crypto trading bot using ChatGPT for automated DeFi strategies, arbitrage, and passive income generation.☆20Jan 12, 2026Updated 7 months ago
- Ray Core for Golang☆14Jan 11, 2026Updated 7 months ago
- Provide quick access to useful actions by adding context menus to your iOS app.☆18Dec 24, 2025Updated 7 months ago
- StepShield: When, Not Whether to Intervene on Rogue Agents — NeurIPS 2026 benchmark for temporal evaluation of AI agent guardrails (9,429…☆78Jul 7, 2026Updated last month
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- AfterCrypt Protocol SDK☆15Jan 23, 2026Updated 6 months ago
- This CLI scaffolds a fully working MCP server in seconds — with TypeScript or JavaScript, built-in tools, resources, and dev commands. Th…☆48Nov 20, 2025Updated 8 months ago
- Scrape Product Data, Search Results, Ads, Reviews, and More From Amazon☆25Dec 18, 2025Updated 8 months ago
- A fully featured implementation of the Sui SDK for developing Unity games☆22Nov 12, 2025Updated 9 months ago
- Focuses on detecting spam messages in SMS text using Natural Language Processing (NLP) and Machine Learning techniques. It leverages text…☆26Jan 5, 2026Updated 7 months ago
- Open‑source, client‑side browser fingerprinting library that generates stable anchor‑based visitor IDs entirely in the browser, with no b…☆10Dec 11, 2025Updated 8 months ago
- SmallML is a three-layer Bayesian framework that enables small and medium-sized enterprises (SMEs) to build production-grade machine lear…☆32Jun 20, 2026Updated last month
- Implements a machine learning-based SMS spam detection system. It classifies incoming text messages as Spam or Ham (Not Spam) using Natur…☆25Dec 24, 2025Updated 7 months ago
- Subnet 22☆48Jul 31, 2026Updated 2 weeks ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- A Python SDK for FinancialData.Net API - Real-time & Historical Stock Market Data☆36Jul 24, 2026Updated 3 weeks ago
- Your personal AI assistant KIT for automated trading with openclaw, with full documentation available at https://devs.sidex.fun/documenta…☆23Feb 13, 2026Updated 6 months ago
- A standalone HLS/MP4 video player with subtitle support, watch party, Chromecast and Automatic Thumbnails generation. Built with React.☆22Jul 17, 2026Updated last month
- VRChat Group Tools. Make managing groups easier.☆15May 11, 2026Updated 3 months ago
- ContextLoom is the shared "brain" for multi-agent systems. It weaves together memory threads from frameworks like DSPy and CrewAI into a …☆12Dec 6, 2025Updated 8 months ago
- Quick setup for projects or repositories using Claude Code with built-in agents, ticket system, and planning tools.☆56Jan 18, 2026Updated 7 months ago
- High-performance indexer for services using the U2P system written in Rust☆514Updated this week
- The RL training platform. Use ReinforceNow to train reliable AI agents from raw data to production.☆30Feb 9, 2026Updated 6 months ago
- Convert between YAML, JSON, TOML,XML, INI and ENV config formats seamlessly☆14Jan 3, 2026Updated 7 months ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Scam intelligence, phishing attribution, drainer mapping. Legal OSINT only. Public data. Real cases. For researchers and victims.☆181Nov 30, 2025Updated 8 months ago
- A modern PowerShell-based GUI tool for Microsoft Intune administration - including device ownership analysis, configuration backup, assig…☆37Jan 14, 2026Updated 7 months ago
- ☆41Feb 14, 2026Updated 6 months ago
- Django Smart Home☆13Jul 7, 2026Updated last month
- ☆16Apr 6, 2026Updated 4 months ago
- The opensource all-in-one framework for Prediction Markets☆149May 14, 2026Updated 3 months ago
- Teaching LLMs to reason in the Latent Space to precondition responses.☆179Jul 22, 2026Updated 3 weeks ago
- Production operations framework for AI-powered SaaS. The architectural patterns, failure modes, and operational playbooks that determine …☆13Mar 10, 2026Updated 5 months ago
- Shannon-Uncontained. A Docker-free, black‑box ‑first fork that treats AI as a fallible witness rather than an oracle: treats uncertainty a…☆60Mar 16, 2026Updated 5 months ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- ☆27Jan 14, 2026Updated 7 months ago
- ☆56Jan 27, 2026Updated 6 months ago
- Manage AWS IAM Identity Center permission sets and account assignments with Terraform.☆39Jul 23, 2026Updated 3 weeks ago
- Farnsworth is an autonomous, infinitely-memorable, self-evolving companion AI built entirely with free open-source tools.☆66Mar 20, 2026Updated 4 months ago
- Training/Fine-tuning at the speed of light☆808Updated this week
- Lightweight & Fast Security Scanner for React Native & Expo☆500Apr 19, 2026Updated 3 months ago
- Stop feeding your AI agent the entire codebase. Give it ctx instead. FIrst context engine for AI agents that actually works.☆25Feb 14, 2026Updated 6 months ago