braintrustdata / autoevalsLinks
AutoEvals is a tool for quickly and easily evaluating AI model outputs using best practices.
☆680Updated this week
Alternatives and similar repositories for autoevals
Users that are interested in autoevals are comparing it to the libraries listed below
Sorting:
- structured extraction for llms☆754Updated 9 months ago
- Create state-machine-powered LLM agents using XState☆320Updated 5 months ago
- Low latency JSON generation using LLMs ⚡️☆397Updated last year
- ☆155Updated 4 months ago
- Prompt engineering, automated.☆346Updated 6 months ago
- ☆96Updated this week
- The toolkit for AI devtools context engineering. Build with codebase mapping, symbol extraction, and many kinds of code search.☆640Updated 2 weeks ago
- Sister project to OpenLLMetry, but in Typescript. Open-source observability for your LLM application, based on OpenTelemetry☆359Updated last week
- Get structured, fully typed, and validated JSON outputs from OpenAI and Anthropic models.☆626Updated last year
- AgentKit: Build multi-agent networks in TypeScript with deterministic routing and rich tooling via MCP.☆664Updated last week
- Fully typed & consistent chat APIs for OpenAI, Anthropic, Groq, and Azure's chat models for browser, edge, and node environments.☆169Updated last year
- The pretty much "official" DSPy framework for Typescript☆2,198Updated this week
- Python SDK for running evaluations on LLM generated responses☆292Updated 4 months ago
- ☆188Updated 3 weeks ago
- A fuzzy key value store based on semantic similarity rather lexical equality.☆285Updated 11 months ago
- Kura is a simple reproduction of the CLIO paper which uses language models to label user behaviour before clustering them based on embedd…☆342Updated last month
- Optimize prompts, code, and more with AI-powered Reflective Text Evolution☆1,323Updated 2 weeks ago
- ☆375Updated last week
- Reasoning Augmented Generation☆889Updated 3 months ago
- Automatically reformat any JSON into any schema with AI☆335Updated 7 months ago
- Evaluate your LLM-powered apps with TypeScript☆1,009Updated last week
- Add natural language control to your React app, with MCP and generative UX☆786Updated this week
- ☆172Updated this week
- Provider-agnostic, open-source evaluation infrastructure for language models☆628Updated this week
- Chat with your PostHog data☆161Updated last year
- A fully customizable and self-hosted sandboxing solution for AI agent code execution and computer use. It features out-of-the-box support…☆646Updated 4 months ago
- Natural language search for complex JSON arrays, with AI Quickstart.☆411Updated last year
- A tool kit for generating high quality prompts using DSPy GEPA optimizer☆278Updated last week
- A Markdown-like syntax for writing prompts. Includes an in-editor playground.☆128Updated 2 years ago
- ☆39Updated 2 weeks ago