Alternatives and similar repositories for autoevals

Users that are interested in autoevals are comparing it to the libraries listed below

• 567-labs / instructor-js
  structured extraction for llms
  ☆720Updated 4 months ago
• traceloop / openllmetry-js
  Sister project to OpenLLMetry, but in Typescript. Open-source observability for your LLM application, based on OpenTelemetry
  ☆319Updated last month
• hack-dance / island-ai
  ☆151Updated 4 months ago
• zenbase-ai / core
  Prompt engineering, automated.
  ☆321Updated last month
• villagecomputing / superopenai
  Logging and caching superpowers for the openai sdk
  ☆105Updated last year
• athina-ai / athina-evals
  Python SDK for running evaluations on LLM generated responses
  ☆280Updated 2 weeks ago
• braintrustdata / braintrust-cookbook
  ☆33Updated last week
• braintrustdata / braintrust-proxy
  ☆348Updated this week
• jxnl / n-levels-of-rag
  ☆194Updated last year
• dzhng / llm-api
  Fully typed & consistent chat APIs for OpenAI, Anthropic, Groq, and Azure's chat models for browser, edge, and node environments.
  ☆170Updated last year
• 567-labs / systematically-improving-rag
  ☆130Updated this week
• varunshenoy / super-json-mode
  Low latency JSON generation using LLMs ⚡️
  ☆399Updated last year
• braintrustdata / braintrust-sdk
  ☆63Updated this week
• inngest / agent-kit
  AgentKit: Build multi-agent networks in TypeScript with deterministic routing and rich tooling via MCP.
  ☆454Updated last week
• AgentOps-AI / Jaiqu
  Automatically reformat any JSON into any schema with AI
  ☆330Updated 2 months ago
• transitive-bullshit / openai-realtime-api
  TypeScript client for OpenAI's realtime voice API.
  ☆348Updated 7 months ago
• AI-Northstar-Tech / vector-io
  Comprehensive Vector Data Tooling. The universal interface for all vector database, datasets and RAG platforms. Easily export, import, ba…
  ☆242Updated last week
• teknium1 / Prompt-Engineering-Toolkit
  ☆405Updated 9 months ago
• mendableai / data-connectors
  LLM-ready data connectors
  ☆81Updated last year
• anyscale / llm-router
  Tutorial for building LLM router
  ☆206Updated 10 months ago
• langchain-ai / openevals
  Readymade evaluators for your LLM apps
  ☆538Updated last week
• Arize-ai / openinference
  OpenTelemetry Instrumentation for AI Observability
  ☆442Updated this week
• langchain-ai / agent-protocol
  ☆355Updated 2 weeks ago
• statelyai / agent
  Create state-machine-powered LLM agents using XState
  ☆291Updated last week
• cased / kit
  The toolkit for codebase mapping, symbol extraction, and many kinds of code search. Build AI-powered devtools
  ☆443Updated this week
• jxnl / blog
  ☆135Updated this week
• superagent-ai / reag
  Reasoning Augmented Generation
  ☆845Updated 3 months ago
• upstash / semantic-cache
  A fuzzy key value store based on semantic similarity rather lexical equality.
  ☆276Updated 6 months ago
• ax-llm / ax
  The "official" unofficial DSPy framework. Build LLM powered agents and other workflows, based on the Stanford DSP paper.
  ☆1,499Updated this week
• humanlayer / humanlayer
  HumanLayer enables AI agents to communicate with humans in tool-based and async workflows. Guarantee human oversight of high-stakes funct…
  ☆806Updated this week