symflower / eval-dev-quality
DevQualityEval: An evaluation benchmark 📈 and framework to compare and evolve the quality of code generation of LLMs.
☆143Updated this week
Alternatives and similar repositories for eval-dev-quality:
Users that are interested in eval-dev-quality are comparing it to the libraries listed below
- Just a bunch of benchmark logs for different LLMs☆119Updated 6 months ago
- Simple examples using Argilla tools to build AI☆53Updated 3 months ago
- Tutorial for building LLM router☆182Updated 7 months ago
- Mixing Language Models with Self-Verification and Meta-Verification☆101Updated 2 months ago
- ☆86Updated 5 months ago
- A better way of testing, inspecting, and analyzing AI Agent traces.☆28Updated this week
- Contains the prompts we use to talk to various LLMs for different utilities inside the editor☆73Updated last year
- Official homepage for "Self-Harmonized Chain of Thought" (NAACL 2025)☆89Updated 3 weeks ago
- An automated tool for discovering insights from research papaer corpora☆136Updated 8 months ago
- ☆111Updated 2 months ago
- Client Code Examples, Use Cases and Benchmarks for Enterprise h2oGPTe RAG-Based GenAI Platform☆82Updated last week
- Routing on Random Forest (RoRF)☆114Updated 4 months ago
- Doing simple retrieval from LLM models at various context lengths to measure accuracy☆100Updated 10 months ago
- Function Calling Benchmark & Testing☆82Updated 7 months ago
- Aider's refactoring benchmark exercises based on popular python repos☆57Updated 4 months ago
- Leveraging DSPy for AI-driven task understanding and solution generation, the Self-Discover Framework automates problem-solving through r…☆58Updated 7 months ago
- ☆152Updated 7 months ago
- ☆65Updated 8 months ago
- Sphynx Hallucination Induction☆52Updated 3 weeks ago
- Improve your questions! The AI for Inquiry - QuestionImprover Agent is an LLM-driven “tool for thought” designed to enhance the depth and…☆141Updated this week
- 🤖 Headless IDE for AI agents☆163Updated last week
- A Ruby on Rails style framework for the DSPy (Demonstrate, Search, Predict) project for Language Models like GPT, BERT, and LLama.☆119Updated 4 months ago
- ☆48Updated last year
- Simple Graph Memory for AI applications☆81Updated 6 months ago
- GraphRAG database - hybrid graph / vector db☆118Updated 5 months ago
- ☆61Updated 3 months ago
- Lean implementation of various multi-agent LLM methods, including Iteration of Thought (IoT)☆101Updated last week
- A system that tries to resolve all issues on a github repo with OpenHands.☆100Updated 3 months ago
- ☆74Updated last year