Alternatives and similar repositories for evals

Users that are interested in evals are comparing it to the libraries listed below

• truffle-ai / truffle-ai-sdk
  ☆57Updated 6 months ago
• asteroidai / cookbook
  Recipes for AI agents that use Asteroid to be safe and reliable. Want yours featured? Submit a PR!
  ☆49Updated 5 months ago
• agentin-ai / agentin
  AI Agents for Enterprise Software Automation
  ☆45Updated 8 months ago
• a1baseai / a1framework
  A1Base NextJS template
  ☆65Updated 3 months ago
• karoo-ca / taskiq-pg
  Taskiq plugin for postgres broker and results backend
  ☆49Updated last week
• zeroentropy-ai / zchunk
  A new chunking strategy developed by ZeroEntropy for general semantic chunking using Llama-70B.
  ☆211Updated 7 months ago
• freestyle-sh / cloudstate
  Cloudstate is a JavaScript database runtime.
  ☆200Updated 2 months ago
• TwillAI / summon-app
  Postman for MCP servers
  ☆122Updated last month
• zenbase-ai / core
  Prompt engineering, automated.
  ☆340Updated 4 months ago
• sublingual-ai / sublingual-monitoring
  🐍 Sublingual helps you log and analyze all of your LLM calls, including the prompt template, call parameters, responses, tool calls, and…
  ☆52Updated 6 months ago
• flowglad / flowglad
  Open source payments + billing infrastructure
  ☆396Updated this week
• p2p-industries / hyveos
  Robot communication and coordination network.
  ☆67Updated 4 months ago
• lmnr-ai / lmnr-python
  ☆52Updated this week
• openintegrations / openint
  OpenInt is the fastest way to add native product integrations to your app.
  ☆196Updated 2 weeks ago
• inngest / agent-kit
  AgentKit: Build multi-agent networks in TypeScript with deterministic routing and rich tooling via MCP.
  ☆598Updated this week
• tambo-ai / tambo
  Add generative UI components to your AI assistant, copilot, or agent.
  ☆739Updated this week
• pig-dot-dev / piglet
  ☆143Updated 6 months ago
• airtop-ai / airtop-node-sdk
  Airtop SDK for Node.js
  ☆15Updated last week
• truffle-ai / dexto
  The Orchestration Layer for AI agents. Connect your models, tools, and data into a smart interface to create agentic apps that can think,…
  ☆222Updated this week
• abshkbh / arrakis
  A fully customizable and self-hosted sandboxing solution for AI agent code execution and computer use. It features out-of-the-box support…
  ☆570Updated 3 months ago
• getlilac / lilac
  Lilac is an open-source tool that ensures your data scientists always have enough gpus for their work. We seamlessly connect compute from…
  ☆110Updated 2 weeks ago
• genesis-xyz / ai
  Enable users to securely sign in with their own OpenAI API key.
  ☆24Updated last year
• zenbase-ai / llml
  Compose data structures, serialize them to prompts.
  ☆67Updated 2 months ago
• inkeep / agents
  Platform for creating Agents in a No-Code Visual Builder or TypeScript Agents SDK
  ☆148Updated this week
• cuse-dev / cuse
  Framework for implementing computer use for AI agents
  ☆87Updated 6 months ago
• gabrielpetersson / chat-llm
  Poweruser UI for ChatGPT. 100% local, split screen, ask multiple questions at the same time, create chat configs that can be opened with …
  ☆46Updated 6 months ago
• reworkd / bananalyzer
  Open source AI Agent evaluation framework for web tasks 🐒🍌
  ☆308Updated 8 months ago
• winfunc / blockoli
  Blockoli is a high-performance tool for code indexing, embedding generation and semantic search tool for use with LLMs.
  ☆147Updated last year
• AgentOps-AI / Jaiqu
  Automatically reformat any JSON into any schema with AI
  ☆335Updated 6 months ago
• cased / kit
  The toolkit for AI devtools context engineering. Build with codebase mapping, symbol extraction, and many kinds of code search.
  ☆612Updated this week