symflower / eval-dev-quality
DevQualityEval: An evaluation benchmark 📈 and framework to compare and evolve the quality of code generation of LLMs.
☆133Updated 2 weeks ago
Related projects ⓘ
Alternatives and complementary repositories for eval-dev-quality
- 🤖 Headless IDE for AI agents☆129Updated this week
- Routing on Random Forest (RoRF)☆83Updated last month
- Just a bunch of benchmark logs for different LLMs☆114Updated 3 months ago
- Simple examples using Argilla tools to build AI☆38Updated this week
- WIP - Allows you to create DSPy pipelines using ComfyUI☆179Updated 3 months ago
- Fast parallel LLM inference for MLX☆146Updated 4 months ago
- Mixing Language Models with Self-Verification and Meta-Verification☆97Updated last year
- look how they massacred my boy☆54Updated 3 weeks ago
- ☆103Updated 7 months ago
- ☆72Updated last year
- A python package for serving LLM on OpenAI-compatible API endpoints with prompt caching using MLX.☆52Updated last week
- ☆110Updated 2 weeks ago
- Tutorial for building LLM router☆157Updated 3 months ago
- ReDel is a toolkit for researchers and developers to build, iterate on, and analyze recursive multi-agent systems. (EMNLP 2024 Demo)☆62Updated this week
- A toolkit for building multimodal AI agents☆107Updated 2 weeks ago
- Steer LLM outputs towards a certain topic/subject and enhance response capabilities using activation engineering by adding steering vecto…☆201Updated 5 months ago
- Distributed Inference for mlx LLm☆68Updated 3 months ago
- GRDN.AI app for garden optimization☆69Updated 9 months ago
- ☆38Updated 7 months ago
- Official homepage for "Self-Harmonized Chain of Thought"☆83Updated last month
- GPT-4 Level Conversational QA Trained In a Few Hours☆55Updated 2 months ago
- Generate Synthetic Data Using OpenAI, MistralAI or AnthropicAI☆222Updated 6 months ago
- Code for evaluating with Flow-Judge-v0.1 - an open-source, lightweight (3.8B) language model optimized for LLM system evaluations. Crafte…☆52Updated last week
- Function Calling Benchmark & Testing☆74Updated 4 months ago
- A simple Python sandbox for helpful LLM data agents☆162Updated 4 months ago
- Python SDK for experimenting, testing, evaluating & monitoring LLM-powered applications - Parea AI (YC S23)☆74Updated last month
- Solving data for LLMs - Create quality synthetic datasets!☆136Updated 3 weeks ago
- ☆93Updated 2 months ago
- ☆49Updated 2 weeks ago
- an implementation of Self-Extend, to expand the context window via grouped attention☆118Updated 10 months ago
- A new benchmark for measuring LLM's capability to detect bugs in large codebase.☆27Updated 5 months ago