Alternatives and similar repositories for autoevals:

Users that are interested in autoevals are comparing it to the libraries listed below

• 567-labs / instructor-js
  structured extraction for llms
  ☆711Updated 3 months ago
• hack-dance / island-ai
  ☆149Updated 3 months ago
• dzhng / llm-api
  Fully typed & consistent chat APIs for OpenAI, Anthropic, Groq, and Azure's chat models for browser, edge, and node environments.
  ☆170Updated 11 months ago
• varunshenoy / super-json-mode
  Low latency JSON generation using LLMs ⚡️
  ☆400Updated last year
• zenbase-ai / core
  Prompt engineering, automated.
  ☆308Updated 2 weeks ago
• statelyai / agent
  Create state-machine-powered LLM agents using XState
  ☆283Updated 2 weeks ago
• athina-ai / athina-evals
  Python SDK for running evaluations on LLM generated responses
  ☆278Updated last week
• braintrustdata / braintrust-cookbook
  ☆32Updated last month
• 567-labs / systematically-improving-rag
  ☆120Updated this week
• cased / kit
  🛠️ The toolkit for codebase mapping, symbol extraction, and many kinds of code search. Build AI-powered devtools!
  ☆238Updated this week
• jxnl / n-levels-of-rag
  ☆195Updated last year
• relari-ai / continuous-eval
  Data-Driven Evaluation for LLM-Powered Applications
  ☆492Updated 3 months ago
• superagent-ai / super-rag
  Super performant RAG pipelines for AI apps. Summarization, Retrieve/Rerank and Code Interpreters in one simple API.
  ☆372Updated last year
• traceloop / openllmetry-js
  Sister project to OpenLLMetry, but in Typescript. Open-source observability for your LLM application, based on OpenTelemetry
  ☆313Updated last week
• hrishioa / mandark
  Simple AI coder that can do most of my work for me, including working on himself.
  ☆235Updated last month
• jamesmurdza / gitwit-agent
  Create repos and commits with AI.
  ☆293Updated last year
• FanaHOVA / smol-podcaster
  smol-podcaster is your podcast production agent 🎙️
  ☆342Updated 7 months ago
• AI-Northstar-Tech / vector-io
  Comprehensive Vector Data Tooling. The universal interface for all vector database, datasets and RAG platforms. Easily export, import, ba…
  ☆239Updated this week
• upstash / semantic-cache
  A fuzzy key value store based on semantic similarity rather lexical equality.
  ☆273Updated 5 months ago
• hrishioa / wishful-search
  Natural language search for complex JSON arrays, with AI Quickstart.
  ☆396Updated 11 months ago
• villagecomputing / superopenai
  Logging and caching superpowers for the openai sdk
  ☆105Updated last year
• openai / build-hours
  Build hours code to share.
  ☆226Updated 4 months ago
• irthomasthomas / llm-consortium
  llm-consortium orchestrates mulitple LLMs, iteratively refines & achieves consensus.
  ☆248Updated last week
• AgentOps-AI / Jaiqu
  Automatically reformat any JSON into any schema with AI
  ☆328Updated last month
• haizelabs / verdict
  Verdict is a library for scaling judge-time compute.
  ☆209Updated last week
• braintrustdata / braintrust-sdk
  ☆60Updated this week
• teknium1 / Prompt-Engineering-Toolkit
  ☆401Updated 8 months ago
• ax-llm / ax
  The "official" unofficial DSPy framework. Build LLM powered agents and other workflows, based on the Stanford DSP paper.
  ☆1,459Updated last week
• inngest / agent-kit
  AgentKit: Build multi-agent networks in TypeScript with deterministic routing and rich tooling via MCP.
  ☆433Updated 2 weeks ago
• langchain-ai / openevals
  Readymade evaluators for your LLM apps
  ☆371Updated this week