Alternatives and similar repositories for eval-dev-quality

Users that are interested in eval-dev-quality are comparing it to the libraries listed below

• argilla-io / argilla-cookbook
  Simple examples using Argilla tools to build AI
  ☆57Updated last year
• METR / eval-analysis-public
  Public repository containing METR's DVC pipeline for eval data analysis
  ☆199Updated last week
• anyscale / llm-router
  Tutorial for building LLM router
  ☆244Updated last year
• All-Hands-AI / openhands-resolver
  A system that tries to resolve all issues on a github repo with OpenHands.
  ☆117Updated last year
• hide-org / hide
  🤖 Headless IDE for AI agents
  ☆200Updated 3 months ago
• Aider-AI / aider-swe-bench
  Harness used to benchmark aider against SWE Bench benchmarks
  ☆79Updated last year
• zhudotexe / redel
  ReDel is a toolkit for researchers and developers to build, iterate on, and analyze recursive multi-agent systems. (EMNLP 2024 Demo)
  ☆90Updated last month
• agora-protocol / paper-demo
  ☆177Updated 11 months ago
• teknium1 / LLM-Benchmark-Logs
  Just a bunch of benchmark logs for different LLMs
  ☆119Updated last year
• Xalp / ECHO
  Official homepage for "Self-Harmonized Chain of Thought" (NAACL 2025)
  ☆92Updated last year
• jlewi / foyle
  Foyle is a copilot to help developers deploy and operate their applications.
  ☆133Updated 10 months ago
• QuixiAI / dolphin-logger
  ☆107Updated 3 months ago
• h2oai / enterprise-h2ogpte
  Client Code Examples, Use Cases and Benchmarks for Enterprise h2oGPTe RAG-Based GenAI Platform
  ☆90Updated 4 months ago
• google / lmeval
  ☆237Updated 2 months ago
• DeepSoftwareAnalytics / Awesome-Agent4SE
  ☆106Updated last year
• redotvideo / pluto
  Synthetic Data for LLM Fine-Tuning
  ☆120Updated 2 years ago
• d0rc / deepdive
  Conduct in-depth research with AI-driven insights : DeepDive is a command-line tool that leverages web searches and AI models to generate…
  ☆44Updated last year
• NL2Code / CodeR
  ☆159Updated last year
• LLMSELECTOR / LLMSELECTOR
  ☆80Updated 4 months ago
• Mihaiii / backtrack_sampler
  An easy-to-understand framework for LLM samplers that rewind and revise generated tokens
  ☆150Updated last month
• teknium1 / ShareGPT-Builder
  ☆119Updated last year
• Not-Diamond / RoRF
  Routing on Random Forest (RoRF)
  ☆239Updated last year
• ScalingIntelligence / codemonkeys
  ☆59Updated last year
• codestoryai / prompts
  Contains the prompts we use to talk to various LLMs for different utilities inside the editor
  ☆84Updated 2 years ago
• Aider-AI / polyglot-benchmark
  Coding problems used in aider's polyglot benchmark
  ☆199Updated last year
• QuixiAI / OpenChatML
  ☆166Updated 6 months ago
• weaviate / structured-rag
  Experimental Code for StructuredRAG: JSON Response Formatting with Large Language Models
  ☆115Updated 9 months ago
• OpenPipe / deductive-reasoning
  Train your own SOTA deductive reasoning model
  ☆107Updated 11 months ago
• simple-bench / SimpleBench
  ☆190Updated last year
• adobe-research / dynasaur
  Official repository for "DynaSaur: Large Language Agents Beyond Predefined Actions"
  ☆355Updated last year