Alternatives and similar repositories for evals

Users that are interested in evals are comparing it to the libraries listed below

• agentin-ai / agentin
  AI Agents for Enterprise Software Automation
  ☆45Updated 10 months ago
• truffle-ai / truffle-ai-sdk
  ☆57Updated 8 months ago
• asteroidai / cookbook
  Recipes for AI agents that use Asteroid to be safe and reliable. Want yours featured? Submit a PR!
  ☆49Updated 7 months ago
• a1baseai / a1framework
  A1Base NextJS template
  ☆67Updated 5 months ago
• karoo-ca / taskiq-pg
  Taskiq plugin for postgres broker and results backend
  ☆52Updated 3 weeks ago
• zeroentropy-ai / zchunk
  A new chunking strategy developed by ZeroEntropy for general semantic chunking using Llama-70B.
  ☆242Updated 9 months ago
• freestyle-sh / cloudstate
  Cloudstate is a JavaScript database runtime.
  ☆204Updated 4 months ago
• Bindwell / PLAPT
  Codebase and CLI for PLAPT: A state-of-the-art protein-ligand binding affinity model for drug discovery
  ☆110Updated 7 months ago
• zenbase-ai / core
  Prompt engineering, automated.
  ☆348Updated 7 months ago
• lmnr-ai / lmnr-python
  ☆52Updated this week
• sublingual-ai / sublingual-monitoring
  🐍 Sublingual helps you log and analyze all of your LLM calls, including the prompt template, call parameters, responses, tool calls, and…
  ☆52Updated 8 months ago
• flowglad / flowglad
  Open source payments + billing infrastructure
  ☆457Updated this week
• freestyle-sh / freestyle-astro-template
  Deploy Astro.js to freestyle.sh with cloudstate javascript object persistence.
  ☆48Updated 9 months ago
• Skyvern-AI / wyvern
  ☆77Updated 2 years ago
• TwillAI / summon-app
  Postman for MCP servers
  ☆123Updated 3 months ago
• stackwiseai / stackwise
  The open source AI app collection
  ☆182Updated last year
• Darius-Labs / pydantic-to-typescript2
  CLI Tool for converting pydantic models into typescript definitions
  ☆35Updated last year
• shlokkhemani / openpoke
  Open source implementation of Poke
  ☆384Updated 2 months ago
• viksit / selvedge
  Weaving prompts and code into structured, resilient patterns that won't unravel under pressure.
  ☆31Updated 6 months ago
• proxis-dev / vscode-triton
  vscode extension to convert computationally intensive pytorch kernels to triton
  ☆22Updated last year
• pig-dot-dev / piglet
  ☆142Updated 8 months ago
• reworkd / bananalyzer
  Open source AI Agent evaluation framework for web tasks 🐒🍌
  ☆312Updated 10 months ago
• freestyle-sh / freestyle-auth
  Open Source Auth Built on Freestyle: own your auth + data https://docs.freestyle.dev/guides/authentication/
  ☆23Updated last year
• Simplifine-gamedev / Simplifine
  🚀 Easy, open-source LLM finetuning with one-line commands, seamless cloud integration, and popular optimization frameworks. ✨
  ☆95Updated last year
• p2p-industries / hyveos
  Robot communication and coordination network.
  ☆69Updated 6 months ago
• cerulion-inc / cerulion
  ☆80Updated last year
• Trainy-ai / llm-atc
  Fine-tuning and serving LLMs on any cloud
  ☆90Updated last year
• outerbase / ezql
  EZQL ask your database questions using natural language.
  ☆135Updated 10 months ago
• onkernel / kernel-images
  Browsers-as-a-service for automations and web agents
  ☆573Updated last week
• KestrelAI / Kestrel-Operator
  An operator for streaming Kubernetes resource metadata, logs, events, and network traffic telemetry over mTLS to Kestrel Cloud.
  ☆28Updated last week