Alternatives and similar repositories for evals

Users that are interested in evals are comparing it to the libraries listed below

• truffle-ai / truffle-ai-sdk
  ☆58Updated 4 months ago
• agentin-ai / agentin
  AI Agents for Enterprise Software Automation
  ☆45Updated 6 months ago
• asteroidai / cookbook
  Recipes for AI agents that use Asteroid to be safe and reliable. Want yours featured? Submit a PR!
  ☆47Updated 3 months ago
• a1baseai / a1framework
  A1Base NextJS template
  ☆63Updated last month
• karoo-ca / taskiq-pg
  Taskiq plugin for postgres broker and results backend
  ☆45Updated 3 weeks ago
• Bindwell / PLAPT
  Codebase and CLI for PLAPT: A state-of-the-art protein-ligand binding affinity model for drug discovery
  ☆102Updated 3 months ago
• zeroentropy-ai / zchunk
  A new chunking strategy developed by ZeroEntropy for general semantic chunking using Llama-70B.
  ☆188Updated 5 months ago
• freestyle-sh / cloudstate
  Cloudstate is a JavaScript database runtime.
  ☆185Updated 3 weeks ago
• sublingual-ai / sublingual-monitoring
  🐍 Sublingual helps you log and analyze all of your LLM calls, including the prompt template, call parameters, responses, tool calls, and…
  ☆51Updated 4 months ago
• zenbase-ai / core
  Prompt engineering, automated.
  ☆331Updated 2 months ago
• TrySummon / summon-app
  Postman for MCP servers
  ☆95Updated this week
• abshkbh / arrakis
  A fully customizable and self-hosted sandboxing solution for AI agent code execution and computer use. It features out-of-the-box support…
  ☆520Updated last month
• flowglad / flowglad
  Open source payments + billing infrastructure
  ☆239Updated this week
• inngest / agent-kit
  AgentKit: Build multi-agent networks in TypeScript with deterministic routing and rich tooling via MCP.
  ☆523Updated 2 weeks ago
• truffle-ai / saiki
  A lightweight runtime for creating and running AI agents that turn natural language into real-world actions.
  ☆179Updated this week
• superglue-ai / superglue
  superglue integrates & orchestrates APIs from natural language. Agents use it to build deterministic workflows across apps, APIs and data…
  ☆1,847Updated this week
• Mentra-Community / MentraOS
  Smart glasses OS, with dozens of built-in apps. Users get AI assistant, notifications, translation, screen mirror, captions, and more. De…
  ☆636Updated this week
• mainframecomputer / orchestra
  Cognitive Architectures for Multi-Agent Teams
  ☆700Updated 2 months ago
• mckaywrigley / r1-automated-pr-example
  ☆182Updated 5 months ago
• hellovai / ai-that-works
  🦄 ai that works - every tuesday 10 AM PST
  ☆166Updated this week
• tambo-ai / tambo
  Add React components to your AI assistant, copilot, or agent.
  ☆478Updated this week
• willccbb / mcp-client-server
  An MCP Server that's also an MCP Client. Useful for letting Claude develop and test MCPs without needing to reset the application.
  ☆121Updated 4 months ago
• ArcadeAI / arcade-ai
  Arcade Python SDK, CLI, and toolkits
  ☆513Updated this week
• Helicone / ai-gateway
  The fastest, lightest, and easiest-to-integrate AI gateway on the market. Fully open-sourced.
  ☆341Updated this week
• cased / kit
  The toolkit for AI devtools context engineering. Build with codebase mapping, symbol extraction, and many kinds of code search.
  ☆557Updated this week
• cuse-dev / cuse
  Framework for implementing computer use for AI agents
  ☆87Updated 4 months ago
• atla-ai / atla-sdk-python
  The official Python library for the Atla API
  ☆15Updated 2 weeks ago
• stripe / agent-toolkit
  Python and TypeScript library for integrating the Stripe API into agentic workflows
  ☆894Updated last week
• smithery-ai / sdk
  Smithery helps AI agents access external services via a unified gateway.
  ☆249Updated last week
• openfoundry-ai / model_manager
  Model Manager is a Python package that simplifies the process of deploying an open source AI model to your own cloud.
  ☆325Updated last year