Alternatives and similar repositories for evals

Users that are interested in evals are comparing it to the libraries listed below

• asteroidai / cookbook
  Recipes for AI agents that use Asteroid to be safe and reliable. Want yours featured? Submit a PR!
  ☆49Updated 8 months ago
• truffle-ai / truffle-ai-sdk
  ☆58Updated 9 months ago
• agentin-ai / agentin
  AI Agents for Enterprise Software Automation
  ☆44Updated 11 months ago
• a1baseai / a1framework
  A1Base NextJS template
  ☆66Updated 2 weeks ago
• zeroentropy-ai / zchunk
  A new chunking strategy developed by ZeroEntropy for general semantic chunking using Llama-70B.
  ☆248Updated 11 months ago
• sublingual-ai / sublingual-monitoring
  🐍 Sublingual helps you log and analyze all of your LLM calls, including the prompt template, call parameters, responses, tool calls, and…
  ☆52Updated 10 months ago
• freestyle-sh / cloudstate
  Cloudstate is a JavaScript database runtime.
  ☆205Updated 6 months ago
• TwillAI / summon-app
  Postman for MCP servers
  ☆123Updated 5 months ago
• zenbase-ai / core
  Prompt engineering, automated.
  ☆350Updated 8 months ago
• pig-dot-dev / piglet
  ☆139Updated 10 months ago
• getlilac / lilac
  Lilac is an open-source tool that ensures your data scientists always have enough gpus for their work. We seamlessly connect compute from…
  ☆116Updated 4 months ago
• lmnr-ai / lmnr-python
  ☆52Updated last week
• stackwiseai / stackwise
  The open source AI app collection
  ☆184Updated last year
• onkernel / kernel-images
  Browsers-as-a-service for automations and web agents
  ☆585Updated this week
• shlokkhemani / openpoke
  Open source implementation of Poke
  ☆421Updated 3 months ago
• Darius-Labs / pydantic-to-typescript2
  CLI Tool for converting pydantic models into typescript definitions
  ☆36Updated last year
• freestyle-sh / freestyle-astro-template
  Deploy Astro.js to freestyle.sh with cloudstate javascript object persistence.
  ☆48Updated 10 months ago
• KestrelAI / Kestrel-Operator
  An operator for streaming Kubernetes resource metadata, logs, events, and network traffic telemetry over mTLS to Kestrel Cloud.
  ☆29Updated 3 weeks ago
• openfoundry-ai / model_manager
  Model Manager is a Python package that simplifies the process of deploying an open source AI model to your own cloud.
  ☆335Updated last year
• pretzelai / lumen
  Ship billing in minutes, not weeks
  ☆24Updated 3 months ago
• p2p-industries / hyveos
  Robot communication and coordination network.
  ☆70Updated 7 months ago
• Trainy-ai / llm-atc
  Fine-tuning and serving LLMs on any cloud
  ☆90Updated 2 years ago
• aditya-nadkarni / spongecake
  Spongecake is the easiest way to launch computer use agents.
  ☆162Updated 8 months ago
• Skyvern-AI / wyvern
  ☆78Updated 2 years ago
• proxis-dev / vscode-triton
  vscode extension to convert computationally intensive pytorch kernels to triton
  ☆21Updated last year
• airtop-ai / airtop-node-sdk
  Airtop SDK for Node.js
  ☆16Updated 2 months ago
• synth-laboratories / synth-ai
  Serverless Posttraining
  ☆67Updated this week
• The-LLM-Data-Company / rubric
  A Python library for LLM-based evaluation using weighted rubrics.
  ☆43Updated last week
• abshkbh / arrakis
  A fully customizable and self-hosted sandboxing solution for AI agent code execution and computer use. It features out-of-the-box support…
  ☆739Updated 7 months ago
• overeasy-sh / overeasy
  Orchestrate zero-shot computer vision models
  ☆392Updated last year