AutoEvals is a tool for quickly and easily evaluating AI model outputs using best practices.
☆973Jul 17, 2026Updated this week
Alternatives and similar repositories for autoevals
Users that are interested in autoevals are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Evaluate your LLM-powered apps with TypeScript☆1,624Apr 28, 2026Updated 2 months ago
- JavaScript Tracing & Evals library for Braintrust☆26Updated this week
- A vitest extension for running evals.☆317Updated this week
- The TypeScript LLM Evaluation Library☆161Nov 11, 2025Updated 8 months ago
- The pretty much "official" DSPy framework for Typescript☆2,832Updated this week
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- The LLM Evaluation Framework☆16,968Updated this week
- Bash for Agents☆3,958Updated this week
- Mastra is the modern TypeScript framework for AI-powered applications and agents.☆26,366Updated this week
- AI Observability & Evaluation☆10,641Updated this week
- structured outputs for llms☆13,579Jul 13, 2026Updated last week
- Typed model metadata and context/cost utilities that help AI apps answer: Does this fit? What will it cost? Should we compact now? How mu…☆258Jul 2, 2026Updated 2 weeks ago
- Laminar - open-source observability platform purpose-built for AI agents. YC S24.☆3,103Updated this week
- 🪢 Open source AI engineering platform: LLM evals, observability, metrics, prompt management, playground, datasets. Integrates with OpenT…☆31,497Updated this week
- Test your prompts, agents, and RAGs. Red teaming/pentesting/vulnerability scanning for AI. Compare performance of GPT, Claude, Gemini, De…☆23,439Updated this week
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- Prompt design using JSX.☆2,841Oct 15, 2025Updated 9 months ago
- A lightweight React Hook intended mainly for AI chat applications, for smoothly sticking to bottom of messages☆758Jun 4, 2026Updated last month
- OpenTelemetry Instrumentation for AI Observability☆1,101Updated this week
- Stream resumption for web streams☆562Mar 17, 2026Updated 4 months ago
- ☆406Updated this week
- DSPy: The framework for programming—not prompting—language models☆36,252Updated this week
- The programming language for agents☆8,570Updated this week
- Wow!☆12Oct 25, 2024Updated last year
- The SDK For Browser Agents☆23,570Updated this week
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- Infrastructure as TypeScript☆2,211Updated this week
- Supercharge Your LLM Application Evaluations 🚀☆14,918Feb 24, 2026Updated 4 months ago
- The data primitive for the agent loop.☆1,629Updated this week
- 🧊 Open source LLM observability platform. One line of code to monitor, evaluate, and experiment. YC W23 🍓☆5,971Jul 5, 2026Updated 2 weeks ago
- The leading workflow orchestration platform. Run stateful step functions and AI workflows on serverless, servers, or the edge.☆5,622Updated this week
- The platform for LLM evaluations and AI agent testing☆3,403Updated this week
- Build and deploy AI Agents on Cloudflare☆5,289Updated this week
- The AI Toolkit for TypeScript. From the creators of Next.js, the AI SDK is a free open-source library for building AI-powered application…☆25,685Updated this week
- PartyKit, for Workers☆1,222Jul 13, 2026Updated last week
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Essential utilities for building production-ready AI applications with Vercel AI SDK. State management, debugging, structured streaming, …☆2,084Dec 25, 2025Updated 6 months ago
- Structured Outputs☆14,573Updated this week
- The sandbox agent framework.☆7,367Jul 13, 2026Updated last week
- Evals is a framework for evaluating LLMs and LLM systems, and an open-source registry of benchmarks.☆18,954Apr 14, 2026Updated 3 months ago
- The Generative UI framework☆15,722Jul 8, 2026Updated last week
- The fastest, litest AI Gateway. Rust core with Python SDK. Call 100+ LLM APIs in OpenAI (or native) format with cost tracking, guardrails…☆54,122Updated this week
- Readymade evaluators for agent trajectories☆652Jul 14, 2026Updated last week