Alternatives and similar repositories for evals

Users that are interested in evals are comparing it to the libraries listed below

• truffle-ai / truffle-ai-sdk
  ☆58Updated 5 months ago
• asteroidai / cookbook
  Recipes for AI agents that use Asteroid to be safe and reliable. Want yours featured? Submit a PR!
  ☆49Updated 3 months ago
• agentin-ai / agentin
  AI Agents for Enterprise Software Automation
  ☆45Updated 7 months ago
• a1baseai / a1framework
  A1Base NextJS template
  ☆65Updated 2 months ago
• karoo-ca / taskiq-pg
  Taskiq plugin for postgres broker and results backend
  ☆46Updated this week
• zeroentropy-ai / zchunk
  A new chunking strategy developed by ZeroEntropy for general semantic chunking using Llama-70B.
  ☆197Updated 6 months ago
• sublingual-ai / sublingual-monitoring
  🐍 Sublingual helps you log and analyze all of your LLM calls, including the prompt template, call parameters, responses, tool calls, and…
  ☆52Updated 5 months ago
• freestyle-sh / cloudstate
  Cloudstate is a JavaScript database runtime.
  ☆191Updated last month
• flowglad / flowglad
  Open source payments + billing infrastructure
  ☆302Updated this week
• openfoundry-ai / model_manager
  Model Manager is a Python package that simplifies the process of deploying an open source AI model to your own cloud.
  ☆325Updated last year
• Mentra-Community / MentraOS
  Smart glasses OS, with dozens of built-in apps. Users get AI assistant, notifications, translation, screen mirror, captions, and more. De…
  ☆669Updated this week
• tambo-ai / tambo
  Add generative UI components to your AI assistant, copilot, or agent.
  ☆583Updated this week
• zenbase-ai / core
  Prompt engineering, automated.
  ☆336Updated 3 months ago
• stackwiseai / stackwise
  The open source AI app collection
  ☆182Updated last year
• reworkd / bananalyzer
  Open source AI Agent evaluation framework for web tasks 🐒🍌
  ☆303Updated 7 months ago
• agentic-labs / lsproxy
  Multi-language code navigation API in a container
  ☆84Updated last month
• openintegrations / openint
  OpenInt is the fastest way to add native product integrations to your app.
  ☆187Updated last week
• superglue-ai / superglue
  superglue integrates & orchestrates APIs from natural language. Agents use it to build deterministic workflows across apps, APIs and data…
  ☆1,880Updated this week
• abshkbh / arrakis
  A fully customizable and self-hosted sandboxing solution for AI agent code execution and computer use. It features out-of-the-box support…
  ☆558Updated 2 months ago
• truffle-ai / dexto
  A lightweight runtime for creating and running AI agents that turn natural language into real-world actions.
  ☆188Updated this week
• traceloop / openllmetry-js
  Sister project to OpenLLMetry, but in Typescript. Open-source observability for your LLM application, based on OpenTelemetry
  ☆345Updated this week
• Extensible-AI / DAGent
  Build AI Agents with Your Existing Python Code!
  ☆63Updated 9 months ago
• buster-so / buster
  Buster is an open-source platform for deploying AI data analysts
  ☆429Updated this week
• cased / kit
  The toolkit for AI devtools context engineering. Build with codebase mapping, symbol extraction, and many kinds of code search.
  ☆586Updated this week
• Helicone / ai-gateway
  The fastest, lightest, and easiest-to-integrate AI gateway on the market. Fully open-sourced.
  ☆377Updated last week
• TrySummon / summon-app
  Postman for MCP servers
  ☆118Updated this week
• pig-dot-dev / muscle-mem
  A cache for AI agents to learn and replay complex behaviors.
  ☆732Updated last month
• pig-dot-dev / piglet
  ☆143Updated 5 months ago
• relari-ai / continuous-eval
  Data-Driven Evaluation for LLM-Powered Applications
  ☆501Updated 6 months ago
• phospho-app / text-analytics-legacy
  Legacy project
  ☆438Updated 3 weeks ago