symflower / eval-dev-quality
DevQualityEval: An evaluation benchmark 📈 and framework to compare and evolve the quality of code generation of LLMs.
☆163Updated last week
Alternatives and similar repositories for eval-dev-quality:
Users that are interested in eval-dev-quality are comparing it to the libraries listed below
- Tutorial for building LLM router☆192Updated 8 months ago
- Simple examples using Argilla tools to build AI☆52Updated 4 months ago
- CursorCore: Assist Programming through Aligning Anything☆117Updated last month
- Letting Claude Code develop his own MCP tools :)☆96Updated last month
- ☆154Updated 7 months ago
- 🤖 Headless IDE for AI agents☆179Updated last month
- Code for Husky, an open-source language agent that solves complex, multi-step reasoning tasks. Husky v1 addresses numerical, tabular and …☆340Updated 9 months ago
- Beating the GAIA benchmark with Transformers Agents. 🚀☆104Updated last month
- Sandboxed code execution for AI agents, locally or on the cloud. Massively parallel, easy to extend. Powering SWE-agent and more.☆145Updated this week
- Function Calling Benchmark & Testing☆85Updated 9 months ago
- A better way of testing, inspecting, and analyzing AI Agent traces.☆31Updated this week
- ☆63Updated last month
- Just a bunch of benchmark logs for different LLMs☆119Updated 8 months ago
- Train your own SOTA deductive reasoning model☆83Updated last month
- ☆66Updated 10 months ago
- Moxin is a family of fully open-source and reproducible LLMs☆85Updated 3 weeks ago
- Verdict is a library for scaling judge-time compute.☆193Updated 3 weeks ago
- ☆144Updated last month
- Client Code Examples, Use Cases and Benchmarks for Enterprise h2oGPTe RAG-Based GenAI Platform☆86Updated 3 weeks ago
- ⚖️ Awesome LLM Judges ⚖️☆88Updated last month
- ReDel is a toolkit for researchers and developers to build, iterate on, and analyze recursive multi-agent systems. (EMNLP 2024 Demo)☆74Updated 3 weeks ago
- ☆112Updated 3 months ago
- ☆153Updated 8 months ago
- Contains the prompts we use to talk to various LLMs for different utilities inside the editor☆76Updated last year
- A user interface for DSPy☆142Updated 5 months ago
- Research repository on interfacing LLMs with Weaviate APIs. Inspired by the Berkeley Gorilla LLM.☆120Updated last month
- ☆91Updated 6 months ago
- ☆74Updated 5 months ago
- OpenCoconut implements a latent reasoning paradigm where we generate thoughts before decoding.☆170Updated 2 months ago
- 🤗 Benchmark Large Language Models Reliably On Your Data☆153Updated this week