symflower / eval-dev-quality
DevQualityEval: An evaluation benchmark 📈 and framework to compare and evolve the quality of code generation of LLMs.
☆141Updated this week
Alternatives and similar repositories for eval-dev-quality:
Users that are interested in eval-dev-quality are comparing it to the libraries listed below
- 🤖 Headless IDE for AI agents☆151Updated last month
- Tutorial for building LLM router☆170Updated 6 months ago
- Simple examples using Argilla tools to build AI☆52Updated 2 months ago
- ☆108Updated last month
- Instantly calculate the maximum size of quantized language models that can fit in your available RAM, helping you optimize your models fo…☆121Updated last month
- A user interface for DSPy☆134Updated 2 months ago
- ☆121Updated this week
- Synthetic Data for LLM Fine-Tuning☆107Updated last year
- WIP - Allows you to create DSPy pipelines using ComfyUI☆184Updated last month
- ☆135Updated last month
- Synthetic Data curation for post-training and structured data extraction☆351Updated this week
- LangChain chat model abstractions for dynamic failover, load balancing, chaos engineering, and more!☆79Updated 11 months ago
- Mixing Language Models with Self-Verification and Meta-Verification☆100Updated last month
- Official homepage for "Self-Harmonized Chain of Thought"☆88Updated last month
- ☆140Updated 2 months ago
- ReDel is a toolkit for researchers and developers to build, iterate on, and analyze recursive multi-agent systems. (EMNLP 2024 Demo)☆68Updated 3 weeks ago
- A comprehensive repository of reasoning tasks for LLMs (and beyond)☆298Updated 3 months ago
- ☆152Updated 4 months ago
- A Ruby on Rails style framework for the DSPy (Demonstrate, Search, Predict) project for Language Models like GPT, BERT, and LLama.☆117Updated 3 months ago
- Leveraging DSPy for AI-driven task understanding and solution generation, the Self-Discover Framework automates problem-solving through r…☆58Updated 6 months ago
- A prompting library☆150Updated 3 months ago
- ☆38Updated 10 months ago
- ☆65Updated 7 months ago
- ☆151Updated 6 months ago
- ☆80Updated this week
- Create a Python MCP server☆133Updated last month
- Flexible and powerful multi-agent AI framework☆336Updated this week
- Solving data for LLMs - Create quality synthetic datasets!☆143Updated 3 months ago
- Build datasets using natural language☆272Updated this week
- Generate Synthetic Data Using OpenAI, MistralAI or AnthropicAI☆222Updated 8 months ago