Alternatives and similar repositories for evals

Users that are interested in evals are comparing it to the libraries listed below

• truffle-ai / truffle-ai-sdk
  ☆58Updated 5 months ago
• agentin-ai / agentin
  AI Agents for Enterprise Software Automation
  ☆45Updated 7 months ago
• asteroidai / cookbook
  Recipes for AI agents that use Asteroid to be safe and reliable. Want yours featured? Submit a PR!
  ☆49Updated 4 months ago
• a1baseai / a1framework
  A1Base NextJS template
  ☆65Updated 2 months ago
• karoo-ca / taskiq-pg
  Taskiq plugin for postgres broker and results backend
  ☆48Updated 2 weeks ago
• zeroentropy-ai / zchunk
  A new chunking strategy developed by ZeroEntropy for general semantic chunking using Llama-70B.
  ☆206Updated 7 months ago
• sublingual-ai / sublingual-monitoring
  🐍 Sublingual helps you log and analyze all of your LLM calls, including the prompt template, call parameters, responses, tool calls, and…
  ☆52Updated 5 months ago
• freestyle-sh / cloudstate
  Cloudstate is a JavaScript database runtime.
  ☆198Updated 2 months ago
• openintegrations / openint
  OpenInt is the fastest way to add native product integrations to your app.
  ☆192Updated last week
• stackwiseai / stackwise
  The open source AI app collection
  ☆184Updated last year
• pig-dot-dev / piglet
  ☆143Updated 6 months ago
• zenbase-ai / core
  Prompt engineering, automated.
  ☆338Updated 4 months ago
• freestyle-sh / freestyle-astro-template
  Deploy Astro.js to freestyle.sh with cloudstate javascript object persistence.
  ☆49Updated 6 months ago
• Mentra-Community / MentraOS
  Smart glasses OS, with dozens of built-in apps. Users get AI assistant, notifications, translation, screen mirror, captions, and more. De…
  ☆701Updated this week
• truffle-ai / dexto
  A lightweight runtime for creating and running AI agents that turn natural language into real-world actions.
  ☆192Updated this week
• flowglad / flowglad
  Open source payments + billing infrastructure
  ☆366Updated this week
• reworkd / bananalyzer
  Open source AI Agent evaluation framework for web tasks 🐒🍌
  ☆305Updated 7 months ago
• traceloop / openllmetry-js
  Sister project to OpenLLMetry, but in Typescript. Open-source observability for your LLM application, based on OpenTelemetry
  ☆350Updated last week
• p2p-industries / hyveos
  Robot communication and coordination network.
  ☆67Updated 3 months ago
• openfoundry-ai / model_manager
  Model Manager is a Python package that simplifies the process of deploying an open source AI model to your own cloud.
  ☆327Updated last year
• CedarCopilot / cedar-OS
  The open-source framework for building AI-native frontends
  ☆31Updated this week
• tambo-ai / tambo
  Add generative UI components to your AI assistant, copilot, or agent.
  ☆623Updated this week
• nuanced-dev / nuanced
  Enriched Python function call graphs for agents and coding assistants
  ☆113Updated 2 months ago
• getlilac / lilac
  Lilac is an open-source tool that ensures your data scientists always have enough gpus for their work. We seamlessly connect compute from…
  ☆105Updated this week
• Darius-Labs / pydantic-to-typescript2
  CLI Tool for converting pydantic models into typescript definitions
  ☆35Updated 10 months ago
• airtop-ai / airtop-node-sdk
  Airtop SDK for Node.js
  ☆14Updated 2 months ago
• cased / kit
  The toolkit for AI devtools context engineering. Build with codebase mapping, symbol extraction, and many kinds of code search.
  ☆603Updated this week
• Helicone / ai-gateway
  The fastest, lightest, and easiest-to-integrate AI gateway on the market. Fully open-sourced.
  ☆399Updated last month
• relari-ai / continuous-eval
  Data-Driven Evaluation for LLM-Powered Applications
  ☆503Updated 7 months ago
• TwillAI / summon-app
  Postman for MCP servers
  ☆121Updated 3 weeks ago