Open Source Data Collection and Evaluation Framework
☆62Jul 23, 2025Updated last year
Alternatives and similar repositories for evals
Users that are interested in evals are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- AI Agents for Enterprise Software Automation☆46Jan 10, 2025Updated last year
- Taskiq plugin for postgres broker and results backend☆54Sep 21, 2026Updated 2 weeks ago
- A1Base NextJS template☆66Apr 13, 2026Updated 5 months ago
- POC of building React UI for FreeCAD☆15Jan 5, 2023Updated 3 years ago
- Prompt based agentic developer primitives☆35Jun 17, 2025Updated last year
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- superglue (YC W25) builds integrations and tools from natural language. Get production-grade tools for long tail and enterprise systems.☆2,066Aug 19, 2026Updated last month
- The open-source React.js Autonomous LLM Agent☆1,654Apr 12, 2024Updated 2 years ago
- Network inspector for your backend☆3,099Jan 28, 2026Updated 8 months ago
- Automate your linkedin networking using an AI agent☆19Jan 21, 2025Updated last year
- ☆15Apr 29, 2025Updated last year
- A performance insights and knowledge assistant agent built on top of Chrome DevTools internals, Mastra, AI SDK and NextJS☆24Apr 22, 2026Updated 5 months ago
- custom implementation of Karpathy's nanochat. Configured to deploy on Modal apps with a live webview. Will be a personal sandbox for twea…☆17Oct 26, 2025Updated 11 months ago
- Agent harness and tookit for building AI agents and agentic applications. CLI and SDKs included☆650Sep 30, 2026Updated last week
- Cartography is a Python tool that pulls infrastructure assets and their relationships into a Neo4j graph database.☆4,126Updated this week
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- AI-powered, open source IDE for Databases☆18Sep 24, 2026Updated 2 weeks ago
- ☆1,314Aug 21, 2025Updated last year
- Memory engine for AI agents — time axis (3-layer decay/promotion) + space axis (self-organizing topic tree). Hybrid search, LLM consolida…☆27Mar 3, 2026Updated 7 months ago
- MLX-based QA pair generator and LLM finetuning tool in Streamlit☆42Oct 18, 2025Updated 11 months ago
- A multi-agent Mastra workflow that reviews pull requests on Github☆21Aug 7, 2025Updated last year
- Scraper of ResetEra threads and posts to get them into a format suitable for feeding them into GPT-2.☆15Jun 20, 2019Updated 7 years ago
- Python application for finding apo and holo structures for user-defined protein-ligand interactions☆10Feb 7, 2023Updated 3 years ago
- Tree-based markdown text splitter☆65Oct 1, 2026Updated last week
- Chrome extension that helps you analyze and summarize web content☆27Mar 27, 2026Updated 6 months ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- A system to build Python wheel PyPI packages for OCP.☆15Oct 2, 2026Updated last week
- The Cloudflare Email Kit is a powerful toolkit designed to handle both incoming and outgoing emails with ease on Cloudflare Workers, prov…☆36Oct 2, 2026Updated last week
- ☆144Feb 26, 2025Updated last year
- ☆12Dec 2, 2024Updated last year
- Substrate TypeScript SDK☆10Sep 20, 2024Updated 2 years ago
- Utilities for programmatic analysis of Cartography data.☆40Jun 22, 2026Updated 3 months ago
- ☆17Mar 14, 2024Updated 2 years ago
- Send text messages to family & friends using your personalized Teachable Machine speech recognizer. Exhibits the power of anyone's voice …☆12Apr 18, 2024Updated 2 years ago
- Data Version Control, or DVC, is a data and ML experiment management tool that takes advantage of the existing engineering toolset that w…☆10Jun 23, 2021Updated 5 years ago
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- convert svg to polylines☆19Mar 7, 2023Updated 3 years ago
- The open-source framework for building AI-native frontends☆172Oct 6, 2025Updated last year
- An example personal assistant built with Mastra + MCP☆81Jun 18, 2025Updated last year
- ☆10Apr 12, 2024Updated 2 years ago
- An AI Agent that is able to use RAG to load the HTML data from any given website☆22Jul 14, 2025Updated last year
- Official agent skills for coding agents working with the Mastra AI framework☆95Updated this week
- ☆12May 30, 2025Updated last year