A curated list of resources, projects, and products to help implement Eval-Driven-Development (EDD) for LLM-backed apps.
☆39Oct 11, 2023Updated 2 years ago
Alternatives and similar repositories for awesome-eval-driven-development
Users that are interested in awesome-eval-driven-development are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- A langchain app to visualise a debate using Tree-of-Thought reasoning☆62Feb 25, 2024Updated 2 years ago
- Fast model deployment on AWS EC2☆14Feb 25, 2024Updated 2 years ago
- Simple Haystack in-memory document store alternative that performs incremental indexing and supports SentencePiece tokenizer.☆19May 2, 2024Updated 2 years ago
- A tiny easily hackable implementation of a feature dashboard.☆17Oct 21, 2025Updated 10 months ago
- Intentional is an open-source framework to build reliable LLM chatbots that actually talk and behave as you expect.☆12Dec 31, 2024Updated last year
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Rust agent orchestration library for tool-using, long-horizon, traceable AI systems.☆14Updated this week
- Skill to annotate and create ai judges from agent logs☆17Oct 28, 2025Updated 10 months ago
- Repository of an Archi plugin that enables Knowledge Graph based anaylsis of ArchiMate models.☆20Jul 13, 2026Updated last month
- Fast model deployment on AWS Sagemaker☆16Feb 25, 2024Updated 2 years ago
- PyTorch and NNsight implementation of AtP* (Kramar et al 2024, DeepMind)☆21Jan 19, 2025Updated last year
- Hasura GraphQL Engine on Render☆15Aug 28, 2023Updated 3 years ago
- ☆17May 19, 2026Updated 3 months ago
- SampleDatabases☆10May 15, 2023Updated 3 years ago
- A starter kit for building chatbots using AWS Lex and Lambda.☆11Jun 1, 2020Updated 6 years ago
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- Demo showing how to sync data with ElectricSQL from Postgres to Cloudflare's Workers KV☆17Aug 20, 2024Updated 2 years ago
- ☆19Sep 12, 2024Updated last year
- The Lambdalabs provider for Terraform☆18Updated this week
- An Open Source SLM Trained for MCP☆23May 18, 2025Updated last year
- Entropy Based Sampling and Parallel CoT Decoding☆17Oct 9, 2024Updated last year
- Einsum with einops style variable names☆19May 16, 2024Updated 2 years ago
- Python package to crawl the publicly available forms filed with the Securities and Exchange Commission (SEC) under the new Electronic Dat…☆16Aug 2, 2013Updated 13 years ago
- Research notes and extra resources for all the work at explodinggradients.com☆27Mar 11, 2025Updated last year
- Materials for the LLM Evals Workshop from Weights & BIases☆15Feb 24, 2025Updated last year
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- ☆13May 7, 2020Updated 6 years ago
- MD-Click is a command line tool for creating `.md` files for any python's click CLI projects☆12May 17, 2024Updated 2 years ago
- Showing how to mock data for Posts and Authors example from graphql-tools docs☆14Dec 14, 2017Updated 8 years ago
- Demo Project for Live Stream public facing demo.☆11Dec 6, 2023Updated 2 years ago
- ☆19May 5, 2026Updated 4 months ago
- SCIPE is a powerful tool for evaluating and diagnosing LLM (Large Language Model) graphs or chains.☆25Nov 5, 2024Updated last year
- train entropix like a champ!☆20Oct 10, 2024Updated last year
- An Open-source Virtual HQ Presence Server by Geo-Distributed Cloud Architecture.☆17Mar 13, 2023Updated 3 years ago
- Manipulate getUserMedia and enumerateDevices with an extension☆15Sep 11, 2025Updated 11 months ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- OpenTelemetry wrapper for Claude Code CLI that logs tool calls, token usage, costs, and execution traces to Logfire, Sentry, Honeycomb, o…☆31Oct 24, 2025Updated 10 months ago
- Jupyter Notebook Utility☆24Oct 28, 2019Updated 6 years ago
- ☆14Jan 4, 2023Updated 3 years ago
- Rate limiter for LLM clients☆22Jan 30, 2025Updated last year
- Not the official LangGraph Rust implementation, but good enough.☆15Apr 13, 2026Updated 4 months ago
- ☆14Apr 2, 2021Updated 5 years ago
- ☆24Feb 26, 2026Updated 6 months ago