Alternatives and similar repositories for autoevals:

Users that are interested in autoevals are comparing it to the libraries listed below

• hack-dance / island-ai
  ☆145Updated last month
• varunshenoy / super-json-mode
  Low latency JSON generation using LLMs ⚡️
  ☆396Updated last year
• zenbase-ai / core
  Prompt engineering, automated.
  ☆288Updated 3 months ago
• athina-ai / athina-evals
  Python SDK for running evaluations on LLM generated responses
  ☆272Updated this week
• jxnl / n-levels-of-rag
  ☆195Updated 10 months ago
• dzhng / llm-api
  Fully typed & consistent chat APIs for OpenAI, Anthropic, Groq, and Azure's chat models for browser, edge, and node environments.
  ☆168Updated 9 months ago
• traceloop / openllmetry-js
  Sister project to OpenLLMetry, but in Typescript. Open-source observability for your LLM application, based on OpenTelemetry
  ☆299Updated this week
• instructor-ai / instructor-js
  structured extraction for llms
  ☆691Updated last month
• AI-Northstar-Tech / vector-io
  Comprehensive Vector Data Tooling. The universal interface for all vector database, datasets and RAG platforms. Easily export, import, ba…
  ☆230Updated this week
• inngest / agent-kit
  AgentKit: Build multi-agent networks in TypeScript with deterministic routing and rich tooling via MCP.
  ☆312Updated this week
• 567-labs / systematically-improving-rag
  ☆108Updated last week
• superagent-ai / super-rag
  Super performant RAG pipelines for AI apps. Summarization, Retrieve/Rerank and Code Interpreters in one simple API.
  ☆363Updated 10 months ago
• AgentOps-AI / Jaiqu
  Automatically reformat any JSON into any schema with AI
  ☆327Updated last week
• cfahlgren1 / observers
  A Lightweight Library for AI Observability
  ☆237Updated last month
• statelyai / agent
  Create state-machine-powered LLM agents using XState
  ☆260Updated last week
• langchain-ai / agent-protocol
  ☆273Updated last week
• stripe / agent-toolkit
  Python and TypeScript library for integrating the Stripe API into agentic workflows
  ☆551Updated this week
• Not-Diamond / RoRF
  Routing on Random Forest (RoRF)
  ☆135Updated 5 months ago
• irthomasthomas / llm-consortium
  llm-consortium orchestrates mulitple LLMs, iteratively refines & achieves consensus.
  ☆178Updated last week
• FanaHOVA / smol-podcaster
  smol-podcaster is your podcast production agent 🎙️
  ☆332Updated 6 months ago
• Arize-ai / openinference
  OpenTelemetry Instrumentation for AI Observability
  ☆334Updated this week
• cohere-ai / cohere-terrarium
  A simple Python sandbox for helpful LLM data agents
  ☆235Updated 9 months ago
• teknium1 / Prompt-Engineering-Toolkit
  ☆398Updated 7 months ago
• relari-ai / continuous-eval
  Data-Driven Evaluation for LLM-Powered Applications
  ☆484Updated last month
• hide-org / hide
  🤖 Headless IDE for AI agents
  ☆172Updated 3 weeks ago
• hrishioa / mandark
  Simple AI coder that can do most of my work for me, including working on himself.
  ☆235Updated last month