Alternatives and similar repositories for eval-dev-quality

Users that are interested in eval-dev-quality are comparing it to the libraries listed below

• anyscale / llm-router
  Tutorial for building LLM router
  ☆235Updated last year
• Aider-AI / polyglot-benchmark
  Coding problems used in aider's polyglot benchmark
  ☆190Updated 10 months ago
• All-Hands-AI / openhands-resolver
  A system that tries to resolve all issues on a github repo with OpenHands.
  ☆115Updated 11 months ago
• argilla-io / argilla-cookbook
  Simple examples using Argilla tools to build AI
  ☆56Updated 11 months ago
• simple-bench / SimpleBench
  ☆171Updated 10 months ago
• SWE-agent / SWE-ReX
  Sandboxed code execution for AI agents, locally or on the cloud. Massively parallel, easy to extend. Powering SWE-agent and more.
  ☆358Updated last week
• hide-org / hide
  🤖 Headless IDE for AI agents
  ☆201Updated last month
• TechxGenus / CursorCore
  CursorCore: Assist Programming through Aligning Anything
  ☆132Updated 9 months ago
• QuixiAI / dolphin-logger
  ☆107Updated 2 weeks ago
• ScalingIntelligence / codemonkeys
  ☆59Updated 9 months ago
• Not-Diamond / RoRF
  Routing on Random Forest (RoRF)
  ☆220Updated last year
• METR / eval-analysis-public
  Public repository containing METR's DVC pipeline for eval data analysis
  ☆129Updated 7 months ago
• agora-protocol / paper-demo
  ☆172Updated 8 months ago
• aymeric-roucher / GAIA
  Beating the GAIA benchmark with Transformers Agents. 🚀
  ☆138Updated 8 months ago
• Aider-AI / aider-swe-bench
  Harness used to benchmark aider against SWE Bench benchmarks
  ☆77Updated last year
• d0rc / deepdive
  Conduct in-depth research with AI-driven insights : DeepDive is a command-line tool that leverages web searches and AI models to generate…
  ☆42Updated last year
• h2oai / enterprise-h2ogpte
  Client Code Examples, Use Cases and Benchmarks for Enterprise h2oGPTe RAG-Based GenAI Platform
  ☆91Updated 2 months ago
• codestoryai / prompts
  Contains the prompts we use to talk to various LLMs for different utilities inside the editor
  ☆83Updated last year
• weaviate / structured-rag
  Experimental Code for StructuredRAG: JSON Response Formatting with Large Language Models
  ☆111Updated 7 months ago
• pseudotensor / open-strawberry
  Building open version of OpenAI o1 via reasoning traces (Groq, ollama, Anthropic, Gemini, OpenAI, Azure supported) Demo: https://hugging…
  ☆184Updated last year
• vaughanlove / PromptBreeder
  Google Deepmind's PromptBreeder for automated prompt engineering implemented in langchain expression language.
  ☆154Updated last year
• OpenPipe / deductive-reasoning
  Train your own SOTA deductive reasoning model
  ☆108Updated 8 months ago
• parea-ai / parea-sdk-py
  Python SDK for experimenting, testing, evaluating & monitoring LLM-powered applications - Parea AI (YC S23)
  ☆80Updated 9 months ago
• haizelabs / Awesome-LLM-Judges
  ⚖️ Awesome LLM Judges ⚖️
  ☆133Updated 6 months ago
• Xalp / ECHO
  Official homepage for "Self-Harmonized Chain of Thought" (NAACL 2025)
  ☆91Updated 9 months ago
• lechmazur / confabulations
  Hallucinations (Confabulations) Document-Based Benchmark for RAG. Includes human-verified questions and answers.
  ☆231Updated 3 months ago
• cohere-ai / cohere-terrarium
  A simple Python sandbox for helpful LLM data agents
  ☆292Updated last year
• teknium1 / LLM-Benchmark-Logs
  Just a bunch of benchmark logs for different LLMs
  ☆118Updated last year
• DeepSoftwareAnalytics / Awesome-Agent4SE
  ☆101Updated last year
• scaleapi / SWE-bench_Pro-os
  SWE-Bench Pro: Can AI Agents Solve Long-Horizon Software Engineering Tasks?
  ☆212Updated last week