Alternatives and similar repositories for autoevals

Users that are interested in autoevals are comparing it to the libraries listed below

• 567-labs / instructor-js
  structured extraction for llms
  ☆758Updated 9 months ago
• braintrustdata / braintrust-sdk
  ☆101Updated last week
• zenbase-ai / core
  Prompt engineering, automated.
  ☆348Updated 6 months ago
• hack-dance / island-ai
  ☆155Updated 5 months ago
• statelyai / agent
  Create state-machine-powered LLM agents using XState
  ☆320Updated 5 months ago
• traceloop / openllmetry-js
  Sister project to OpenLLMetry, but in Typescript. Open-source observability for your LLM application, based on OpenTelemetry
  ☆362Updated last week
• varunshenoy / super-json-mode
  Low latency JSON generation using LLMs ⚡️
  ☆397Updated last year
• inngest / agent-kit
  AgentKit: Build multi-agent networks in TypeScript with deterministic routing and rich tooling via MCP.
  ☆688Updated last week
• evalkit / evalkit
  The TypeScript LLM Evaluation Library
  ☆148Updated this week
• dzhng / zod-gpt
  Get structured, fully typed, and validated JSON outputs from OpenAI and Anthropic models.
  ☆628Updated last year
• upstash / semantic-cache
  A fuzzy key value store based on semantic similarity rather lexical equality.
  ☆286Updated 11 months ago
• athina-ai / athina-evals
  Python SDK for running evaluations on LLM generated responses
  ☆293Updated 5 months ago
• ax-llm / ax
  The pretty much "official" DSPy framework for Typescript
  ☆2,247Updated last week
• 567-labs / kura
  Kura is a simple reproduction of the CLIO paper which uses language models to label user behaviour before clustering them based on embedd…
  ☆362Updated 2 months ago
• cased / kit
  The toolkit for AI devtools context engineering. Build with codebase mapping, symbol extraction, and many kinds of code search.
  ☆640Updated 2 weeks ago
• mattpocock / evalite
  Evaluate your LLM-powered apps with TypeScript
  ☆1,139Updated this week
• gepa-ai / gepa
  Optimize prompts, code, and more with AI-powered Reflective Text Evolution
  ☆1,526Updated this week
• tambo-ai / tambo
  Add natural language control to your React app, with MCP and generative UX
  ☆810Updated this week
• braintrustdata / braintrust-proxy
  ☆379Updated this week
• superagent-ai / reag
  Reasoning Augmented Generation
  ☆889Updated 4 months ago
• RhysSullivan / hogchat
  Chat with your PostHog data
  ☆161Updated last year
• 567-labs / systematically-improving-rag
  ☆192Updated last month
• zenbase-ai / llml
  Compose data structures, serialize them to prompts.
  ☆68Updated 4 months ago
• dzhng / llm-api
  Fully typed & consistent chat APIs for OpenAI, Anthropic, Groq, and Azure's chat models for browser, edge, and node environments.
  ☆169Updated last year
• AgentOps-AI / Jaiqu
  Automatically reformat any JSON into any schema with AI
  ☆338Updated 8 months ago
• vercel / mcp-handler
  Easily spin up an MCP Server on Next.js, Nuxt, Svelte, and more
  ☆472Updated last month
• braintrustdata / braintrust-cookbook
  ☆43Updated last week
• chonkie-inc / chonkiejs
  🦛 CHONK your texts with Chonkie ✨ Type-friendly, light-weight, fast and super-simple chunking library
  ☆291Updated 3 weeks ago
• symphony-hq / symphony
  Write programs you can talk to.
  ☆378Updated last year
• AI-Northstar-Tech / vector-io
  Comprehensive Vector Data Tooling. The universal interface for all vector database, datasets and RAG platforms. Easily export, import, ba…
  ☆264Updated last week