A curated list of resources, projects, and products to help implement Eval-Driven-Development (EDD) for LLM-backed apps.
☆39Oct 11, 2023Updated 2 years ago
Alternatives and similar repositories for awesome-eval-driven-development
Users that are interested in awesome-eval-driven-development are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- A langchain app to visualise a debate using Tree-of-Thought reasoning☆62Feb 25, 2024Updated 2 years ago
- Fast model deployment on AWS EC2☆14Feb 25, 2024Updated 2 years ago
- Debate interface, experiments, etc.☆12Mar 12, 2024Updated 2 years ago
- Simple Haystack in-memory document store alternative that performs incremental indexing and supports SentencePiece tokenizer.☆19May 2, 2024Updated 2 years ago
- A tiny easily hackable implementation of a feature dashboard.☆18Oct 21, 2025Updated 11 months ago
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- ☆10Jan 4, 2019Updated 7 years ago
- Course materials for Text as Data Lab, Spring 2018☆13Feb 1, 2019Updated 7 years ago
- ☆18Oct 5, 2025Updated 11 months ago
- Repository of an Archi plugin that enables Knowledge Graph based anaylsis of ArchiMate models.☆21Jul 13, 2026Updated 2 months ago
- https://facetimeanyone.com/☆10Nov 9, 2023Updated 2 years ago
- Production eval framework for Claude Agent SDK — implements Anthropic's published eval patterns with native SDK hooks, a 50-case golden d…☆22Jun 1, 2026Updated 3 months ago
- 🐳 Build OCI images for Bentos in k8s☆18Jul 14, 2026Updated 2 months ago
- An Open Source SLM Trained for MCP☆23May 18, 2025Updated last year
- 🚀 [ICLR '25] RocketEval: Efficient Automated LLM Evaluation via Grading Checklist☆18Aug 21, 2025Updated last year
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- Entropy Based Sampling and Parallel CoT Decoding☆17Oct 9, 2024Updated last year
- Ideas, concepts, tools and examples of sketch programming☆23Dec 20, 2025Updated 9 months ago
- 🌟BuroTonic: Revolutionizing Sales and Marketing with AI-Driven Business Intelligence - An adaptive team of virtual agents for precise cl…☆22Jul 19, 2025Updated last year
- Einsum with einops style variable names☆19May 16, 2024Updated 2 years ago
- Datasets from titledrops.net☆20Mar 5, 2024Updated 2 years ago
- Python package to crawl the publicly available forms filed with the Securities and Exchange Commission (SEC) under the new Electronic Dat…☆16Aug 2, 2013Updated 13 years ago
- Research notes and extra resources for all the work at explodinggradients.com☆28Mar 11, 2025Updated last year
- Materials for the LLM Evals Workshop from Weights & BIases☆15Feb 24, 2025Updated last year
- A curated reading list for researchers in the Philosophy of Interpretability☆19Aug 17, 2025Updated last year
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- A command line tool to execute simple file conversions, image/video manipulations and folder changes.☆16Jul 8, 2024Updated 2 years ago
- MD-Click is a command line tool for creating `.md` files for any python's click CLI projects☆12May 17, 2024Updated 2 years ago
- Showing how to mock data for Posts and Authors example from graphql-tools docs☆14Dec 14, 2017Updated 8 years ago
- ☆10Feb 10, 2019Updated 7 years ago
- Manipulate getUserMedia and enumerateDevices with an extension☆15Sep 11, 2025Updated last year
- ☆14Jan 4, 2023Updated 3 years ago
- ☆24Feb 26, 2026Updated 7 months ago
- BigBertha is an architecture design that demonstrates how automated LLMOps (Large Language Models Operations) can be achieved on any Kube…☆28Oct 27, 2023Updated 2 years ago
- Notes from "Introducing Python"☆22Aug 21, 2016Updated 10 years ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- Collections of powerful RL architectures with brief introductions.☆12Nov 20, 2020Updated 5 years ago
- ☆16Oct 4, 2025Updated 11 months ago
- Repository for ITP Camp 2019☆15Aug 14, 2019Updated 7 years ago
- code + instructions on how to build your own API☆17Dec 11, 2022Updated 3 years ago
- ☆17Apr 30, 2025Updated last year
- covid question answering datasets and fine tuned models☆18Apr 27, 2021Updated 5 years ago
- ☆29Jan 18, 2023Updated 3 years ago