Alternatives and similar repositories for evals

Users that are interested in evals are comparing it to the libraries listed below

• asteroidai / cookbook
  Recipes for AI agents that use Asteroid to be safe and reliable. Want yours featured? Submit a PR!
  ☆49Updated 5 months ago
• truffle-ai / truffle-ai-sdk
  ☆57Updated 7 months ago
• agentin-ai / agentin
  AI Agents for Enterprise Software Automation
  ☆45Updated 9 months ago
• a1baseai / a1framework
  A1Base NextJS template
  ☆65Updated 4 months ago
• karoo-ca / taskiq-pg
  Taskiq plugin for postgres broker and results backend
  ☆49Updated this week
• zeroentropy-ai / zchunk
  A new chunking strategy developed by ZeroEntropy for general semantic chunking using Llama-70B.
  ☆216Updated 8 months ago
• sublingual-ai / sublingual-monitoring
  🐍 Sublingual helps you log and analyze all of your LLM calls, including the prompt template, call parameters, responses, tool calls, and…
  ☆52Updated 7 months ago
• freestyle-sh / cloudstate
  Cloudstate is a JavaScript database runtime.
  ☆202Updated 3 months ago
• zenbase-ai / core
  Prompt engineering, automated.
  ☆342Updated 5 months ago
• outerbase / ezql
  EZQL ask your database questions using natural language.
  ☆134Updated 8 months ago
• openfoundry-ai / model_manager
  Model Manager is a Python package that simplifies the process of deploying an open source AI model to your own cloud.
  ☆329Updated last year
• flowglad / flowglad
  Open source payments + billing infrastructure
  ☆414Updated this week
• lmnr-ai / lmnr-python
  ☆52Updated last week
• truffle-ai / dexto
  The Orchestration Layer for AI agents. Connect your models, tools, and data into a smart interface to create agentic apps that can think,…
  ☆241Updated this week
• shlokkhemani / openpoke
  Open source implementation of Poke
  ☆307Updated 2 weeks ago
• Scrapybara / scrapybara-cookbook
  Example code and guides for building with Scrapybara
  ☆137Updated 6 months ago
• willccbb / mcp-client-server
  An MCP Server that's also an MCP Client. Useful for letting Claude develop and test MCPs without needing to reset the application.
  ☆124Updated 7 months ago
• Extensible-AI / DAGent
  Build AI Agents with Your Existing Python Code!
  ☆66Updated 11 months ago
• pig-dot-dev / piglet
  ☆142Updated 7 months ago
• TwillAI / summon-app
  Postman for MCP servers
  ☆122Updated 2 months ago
• stackwiseai / stackwise
  The open source AI app collection
  ☆181Updated last year
• reworkd / bananalyzer
  Open source AI Agent evaluation framework for web tasks 🐒🍌
  ☆310Updated 9 months ago
• p2p-industries / hyveos
  Robot communication and coordination network.
  ☆67Updated 4 months ago
• The-LLM-Data-Company / doteval
  doteval
  ☆20Updated 5 months ago
• Skyvern-AI / wyvern
  ☆76Updated last year
• unternet-co / web-applets
  The home of the Web Applets spec, demo and SDK
  ☆218Updated 3 months ago
• tensorpool / tensorpool
  A CLI for GPUs
  ☆112Updated last week
• superglue-ai / superglue
  superglue integrates & orchestrates APIs from natural language. Agents use it to build deterministic workflows across apps, APIs and data…
  ☆1,909Updated this week
• abshkbh / arrakis
  A fully customizable and self-hosted sandboxing solution for AI agent code execution and computer use. It features out-of-the-box support…
  ☆624Updated 4 months ago
• freestyle-sh / freestyle-astro-template
  Deploy Astro.js to freestyle.sh with cloudstate javascript object persistence.
  ☆48Updated 8 months ago