symflower / eval-dev-qualityLinks
DevQualityEval: An evaluation benchmark 📈 and framework to compare and evolve the quality of code generation of LLMs.
☆184Updated 8 months ago
Alternatives and similar repositories for eval-dev-quality
Users that are interested in eval-dev-quality are comparing it to the libraries listed below
Sorting:
- Simple examples using Argilla tools to build AI☆57Updated last year
- Tutorial for building LLM router☆242Updated last year
- ReDel is a toolkit for researchers and developers to build, iterate on, and analyze recursive multi-agent systems. (EMNLP 2024 Demo)☆90Updated last month
- Client Code Examples, Use Cases and Benchmarks for Enterprise h2oGPTe RAG-Based GenAI Platform☆90Updated 4 months ago
- 🤖 Headless IDE for AI agents☆199Updated 3 months ago
- ☆57Updated 11 months ago
- Coding problems used in aider's polyglot benchmark☆199Updated last year
- ☆236Updated last month
- Just a bunch of benchmark logs for different LLMs☆119Updated last year
- A system that tries to resolve all issues on a github repo with OpenHands.☆117Updated last year
- Harness used to benchmark aider against SWE Bench benchmarks☆78Updated last year
- A better way of testing, inspecting, and analyzing AI Agent traces.☆40Updated this week
- ☆107Updated 2 months ago
- Routing on Random Forest (RoRF)☆238Updated last year
- Experimental Code for StructuredRAG: JSON Response Formatting with Large Language Models☆114Updated 9 months ago
- A DSPy-based implementation of the tree of thoughts method (Yao et al., 2023) for generating persuasive arguments☆96Updated 3 months ago
- ☆106Updated last year
- Conduct in-depth research with AI-driven insights : DeepDive is a command-line tool that leverages web searches and AI models to generate…☆44Updated last year
- Official homepage for "Self-Harmonized Chain of Thought" (NAACL 2025)☆91Updated 11 months ago
- Code for evaluating with Flow-Judge-v0.1 - an open-source, lightweight (3.8B) language model optimized for LLM system evaluations. Crafte…☆81Updated last year
- A Ruby on Rails style framework for the DSPy (Demonstrate, Search, Predict) project for Language Models like GPT, BERT, and LLama.☆132Updated last year
- ☆119Updated last year
- An automated tool for discovering insights from research papaer corpora☆138Updated last year
- Public repository containing METR's DVC pipeline for eval data analysis☆178Updated 9 months ago
- ☆189Updated last year
- A simple Python sandbox for helpful LLM data agents☆302Updated last year
- ☆68Updated last year
- Ongoing research training transformer models at scale☆38Updated last year
- ☆159Updated last year
- LangEvals aggregates various language model evaluators into a single platform, providing a standard interface for a multitude of scores a…☆70Updated last week