Alternatives and similar repositories for evals

Users that are interested in evals are comparing it to the libraries listed below

• truffle-ai / truffle-ai-sdk
  ☆58Updated 10 months ago
• asteroidai / cookbook
  Recipes for AI agents that use Asteroid to be safe and reliable. Want yours featured? Submit a PR!
  ☆49Updated 9 months ago
• agentin-ai / agentin
  AI Agents for Enterprise Software Automation
  ☆44Updated last year
• a1baseai / a1framework
  A1Base NextJS template
  ☆66Updated last month
• karoo-ca / taskiq-pg
  Taskiq plugin for postgres broker and results backend
  ☆52Updated last month
• zeroentropy-ai / zchunk
  A new chunking strategy developed by ZeroEntropy for general semantic chunking using Llama-70B.
  ☆249Updated last year
• freestyle-sh / cloudstate
  Cloudstate is a JavaScript database runtime.
  ☆207Updated 7 months ago
• sublingual-ai / sublingual-monitoring
  🐍 Sublingual helps you log and analyze all of your LLM calls, including the prompt template, call parameters, responses, tool calls, and…
  ☆52Updated 10 months ago
• lmnr-ai / lmnr-python
  ☆53Updated this week
• kernel / kernel-images
  Browsers-as-a-service for automations and web agents
  ☆616Updated this week
• TwillAI / summon-app
  Postman for MCP servers
  ☆124Updated 5 months ago
• zenbase-ai / core
  Prompt engineering, automated.
  ☆352Updated 9 months ago
• p2p-industries / hyveos
  Robot communication and coordination network.
  ☆70Updated 3 weeks ago
• proxis-dev / vscode-triton
  vscode extension to convert computationally intensive pytorch kernels to triton
  ☆21Updated last year
• superglue-ai / superglue
  superglue (YC W25) builds integrations and tools from natural language. Get production-grade tools for long tail and enterprise systems.
  ☆1,974Updated this week
• pig-dot-dev / piglet
  ☆139Updated 11 months ago
• synth-laboratories / synth-ai
  Serverless Posttraining
  ☆68Updated this week
• The-LLM-Data-Company / rubric
  A Python library for LLM-based evaluation using weighted rubrics.
  ☆45Updated this week
• openfoundry-ai / model_manager
  Model Manager is a Python package that simplifies the process of deploying an open source AI model to your own cloud.
  ☆335Updated last year
• Skyvern-AI / wyvern
  ☆78Updated 2 years ago
• traceloop / openllmetry-js
  Sister project to OpenLLMetry, but in Typescript. Open-source observability for your LLM application, based on OpenTelemetry
  ☆381Updated last week
• pretzelai / lumen
  Ship billing in minutes, not weeks
  ☆27Updated 4 months ago
• freestyle-sh / freestyle-auth
  Open Source Auth Built on Freestyle: own your auth + data https://docs.freestyle.dev/guides/authentication/
  ☆23Updated last year
• airtop-ai / airtop-node-sdk
  Airtop SDK for Node.js
  ☆16Updated 2 months ago
• relari-ai / continuous-eval
  Data-Driven Evaluation for LLM-Powered Applications
  ☆515Updated last year
• Darius-Labs / pydantic-to-typescript2
  CLI Tool for converting pydantic models into typescript definitions
  ☆36Updated last year
• Simplifine-gamedev / Simplifine
  🚀 Easy, open-source LLM finetuning with one-line commands, seamless cloud integration, and popular optimization frameworks. ✨
  ☆95Updated last year
• wild-card-ai / agents-json
  ☆1,290Updated 5 months ago
• Trainy-ai / llm-atc
  Fine-tuning and serving LLMs on any cloud
  ☆90Updated 2 years ago
• Helicone / ai-gateway
  The fastest, lightest, and easiest-to-integrate AI gateway on the market. Fully open-sourced.
  ☆504Updated 2 months ago