Alternatives and similar repositories for evals

Users that are interested in evals are comparing it to the libraries listed below

• agentin-ai / agentin
  AI Agents for Enterprise Software Automation
  ☆44Updated last year
• asteroidai / cookbook
  Recipes for AI agents that use Asteroid to be safe and reliable. Want yours featured? Submit a PR!
  ☆49Updated 9 months ago
• truffle-ai / truffle-ai-sdk
  ☆58Updated 10 months ago
• a1baseai / a1framework
  A1Base NextJS template
  ☆66Updated last week
• karoo-ca / taskiq-pg
  Taskiq plugin for postgres broker and results backend
  ☆52Updated last month
• zeroentropy-ai / zchunk
  A new chunking strategy developed by ZeroEntropy for general semantic chunking using Llama-70B.
  ☆250Updated last year
• freestyle-sh / cloudstate
  Cloudstate is a JavaScript database runtime.
  ☆207Updated 7 months ago
• sublingual-ai / sublingual-monitoring
  🐍 Sublingual helps you log and analyze all of your LLM calls, including the prompt template, call parameters, responses, tool calls, and…
  ☆52Updated 11 months ago
• pig-dot-dev / piglet
  ☆140Updated 11 months ago
• lmnr-ai / lmnr-python
  ☆53Updated last week
• zenbase-ai / core
  Prompt engineering, automated.
  ☆352Updated 9 months ago
• TwillAI / summon-app
  Postman for MCP servers
  ☆124Updated 6 months ago
• Simplifine-gamedev / Simplifine
  🚀 Easy, open-source LLM finetuning with one-line commands, seamless cloud integration, and popular optimization frameworks. ✨
  ☆95Updated last year
• stackwiseai / stackwise
  The open source AI app collection
  ☆184Updated last year
• proxis-dev / vscode-triton
  vscode extension to convert computationally intensive pytorch kernels to triton
  ☆21Updated last year
• p2p-industries / hyveos
  Robot communication and coordination network.
  ☆70Updated last month
• The-LLM-Data-Company / rubric
  A Python library for LLM-based evaluation using weighted rubrics.
  ☆47Updated this week
• airtop-ai / airtop-node-sdk
  Airtop SDK for Node.js
  ☆16Updated 3 months ago
• kernel / kernel-images
  Browsers-as-a-service for automations and web agents
  ☆644Updated this week
• inngest / agent-kit
  AgentKit: Build multi-agent networks in TypeScript with deterministic routing and rich tooling via MCP.
  ☆779Updated last week
• browserbase / slack-operator
  ☆103Updated 2 months ago
• Cloud-Code-AI / kaizen
  Automate the tedious development tasks with AI
  ☆299Updated last year
• getlilac / lilac
  Lilac is an open-source tool that ensures your data scientists always have enough gpus for their work. We seamlessly connect compute from…
  ☆118Updated 5 months ago
• Darius-Labs / pydantic-to-typescript2
  CLI Tool for converting pydantic models into typescript definitions
  ☆36Updated last year
• openfoundry-ai / model_manager
  Model Manager is a Python package that simplifies the process of deploying an open source AI model to your own cloud.
  ☆335Updated last year
• synth-laboratories / synth-ai
  Prompt Optimization
  ☆73Updated this week
• shlokkhemani / openpoke
  Open source implementation of Poke
  ☆442Updated 4 months ago
• 567-labs / instructor-js
  structured extraction for llms
  ☆765Updated last year
• nuanced-dev / nuanced-py
  Enriched Python function call graphs for agents and coding assistants
  ☆126Updated 7 months ago
• traceloop / openllmetry-js
  Sister project to OpenLLMetry, but in Typescript. Open-source observability for your LLM application, based on OpenTelemetry
  ☆383Updated this week