symflower / eval-dev-qualityLinks
DevQualityEval: An evaluation benchmark 📈 and framework to compare and evolve the quality of code generation of LLMs.
☆185Updated 8 months ago
Alternatives and similar repositories for eval-dev-quality
Users that are interested in eval-dev-quality are comparing it to the libraries listed below
Sorting:
- Tutorial for building LLM router☆244Updated last year
- Simple examples using Argilla tools to build AI☆57Updated last year
- 🤖 Headless IDE for AI agents☆200Updated 3 months ago
- Public repository containing METR's DVC pipeline for eval data analysis☆189Updated last week
- Conduct in-depth research with AI-driven insights : DeepDive is a command-line tool that leverages web searches and AI models to generate…☆44Updated last year
- Harness used to benchmark aider against SWE Bench benchmarks☆79Updated last year
- Just a bunch of benchmark logs for different LLMs☆119Updated last year
- Official homepage for "Self-Harmonized Chain of Thought" (NAACL 2025)☆92Updated last year
- ☆107Updated 3 months ago
- A system that tries to resolve all issues on a github repo with OpenHands.☆117Updated last year
- Coding problems used in aider's polyglot benchmark☆199Updated last year
- ReDel is a toolkit for researchers and developers to build, iterate on, and analyze recursive multi-agent systems. (EMNLP 2024 Demo)☆90Updated last month
- ☆119Updated last year
- Function Calling Benchmark & Testing☆92Updated last year
- Experimental Code for StructuredRAG: JSON Response Formatting with Large Language Models☆115Updated 9 months ago
- Multi-Agent Step Race Benchmark: Assessing LLM Collaboration and Deception Under Pressure. A multi-player “step-race” that challenges LLM…☆85Updated last month
- Contains the prompts we use to talk to various LLMs for different utilities inside the editor☆84Updated 2 years ago
- ☆177Updated 11 months ago
- Client Code Examples, Use Cases and Benchmarks for Enterprise h2oGPTe RAG-Based GenAI Platform☆90Updated 4 months ago
- Routing on Random Forest (RoRF)☆239Updated last year
- ☆106Updated last year
- Finetune Llama-3-8b on the MathInstruct dataset☆115Updated last year
- A DSPy-based implementation of the tree of thoughts method (Yao et al., 2023) for generating persuasive arguments☆99Updated 4 months ago
- Aider's refactoring benchmark exercises based on popular python repos☆78Updated last year
- A user interface for DSPy☆210Updated 4 months ago
- ☆166Updated 6 months ago
- ☆59Updated last year
- Letting Claude Code develop his own MCP tools :)☆123Updated 10 months ago
- Foyle is a copilot to help developers deploy and operate their applications.☆133Updated 10 months ago
- A Text-Based Environment for Interactive Debugging☆293Updated this week