Alternatives and similar repositories for eval-dev-quality

Users that are interested in eval-dev-quality are comparing it to the libraries listed below

• anyscale / llm-router
  Tutorial for building LLM router
  ☆239Updated last year
• argilla-io / argilla-cookbook
  Simple examples using Argilla tools to build AI
  ☆57Updated last year
• hide-org / hide
  🤖 Headless IDE for AI agents
  ☆200Updated 2 months ago
• simple-bench / SimpleBench
  ☆189Updated last year
• gradion-ai / freeact
  An AI agent library using Python as the common language to define executable actions and tool interfaces.
  ☆115Updated last month
• All-Hands-AI / openhands-resolver
  A system that tries to resolve all issues on a github repo with OpenHands.
  ☆117Updated last year
• codestoryai / prompts
  Contains the prompts we use to talk to various LLMs for different utilities inside the editor
  ☆83Updated last year
• google / lmeval
  ☆235Updated last month
• h2oai / enterprise-h2ogpte
  Client Code Examples, Use Cases and Benchmarks for Enterprise h2oGPTe RAG-Based GenAI Platform
  ☆91Updated 3 months ago
• Aider-AI / polyglot-benchmark
  Coding problems used in aider's polyglot benchmark
  ☆199Updated last year
• TechxGenus / CursorCore
  CursorCore: Assist Programming through Aligning Anything
  ☆133Updated 10 months ago
• QuixiAI / dolphin-logger
  ☆107Updated last month
• zhudotexe / redel
  ReDel is a toolkit for researchers and developers to build, iterate on, and analyze recursive multi-agent systems. (EMNLP 2024 Demo)
  ☆89Updated 2 weeks ago
• d0rc / deepdive
  Conduct in-depth research with AI-driven insights : DeepDive is a command-line tool that leverages web searches and AI models to generate…
  ☆43Updated last year
• Not-Diamond / RoRF
  Routing on Random Forest (RoRF)
  ☆235Updated last year
• nath1295 / MLX-Textgen
  A python package for serving LLM on OpenAI-compatible API endpoints with prompt caching using MLX.
  ☆99Updated 5 months ago
• Xalp / ECHO
  Official homepage for "Self-Harmonized Chain of Thought" (NAACL 2025)
  ☆91Updated 11 months ago
• weaviate / structured-rag
  Experimental Code for StructuredRAG: JSON Response Formatting with Large Language Models
  ☆115Updated 8 months ago
• pseudotensor / open-strawberry
  Building open version of OpenAI o1 via reasoning traces (Groq, ollama, Anthropic, Gemini, OpenAI, Azure supported) Demo: https://hugging…
  ☆187Updated last year
• flowaicom / flow-judge
  Code for evaluating with Flow-Judge-v0.1 - an open-source, lightweight (3.8B) language model optimized for LLM system evaluations. Crafte…
  ☆78Updated last year
• cohere-ai / cohere-terrarium
  A simple Python sandbox for helpful LLM data agents
  ☆299Updated last year
• METR / eval-analysis-public
  Public repository containing METR's DVC pipeline for eval data analysis
  ☆164Updated 8 months ago
• llllvvuu / instant_apply
  proof-of-concept of Cursor's Instant Apply feature
  ☆87Updated last year
• ScalingIntelligence / codemonkeys
  ☆59Updated 11 months ago
• teknium1 / LLM-Benchmark-Logs
  Just a bunch of benchmark logs for different LLMs
  ☆119Updated last year
• hammer-mt / DSPyUI
  A user interface for DSPy
  ☆204Updated 2 months ago
• SWE-agent / SWE-ReX
  Sandboxed code execution for AI agents, locally or on the cloud. Massively parallel, easy to extend. Powering SWE-agent and more.
  ☆396Updated this week
• invariantlabs-ai / explorer
  A better way of testing, inspecting, and analyzing AI Agent traces.
  ☆40Updated 2 months ago
• lechmazur / confabulations
  Hallucinations (Confabulations) Document-Based Benchmark for RAG. Includes human-verified questions and answers.
  ☆240Updated 4 months ago
• vaughanlove / PromptBreeder
  Google Deepmind's PromptBreeder for automated prompt engineering implemented in langchain expression language.
  ☆161Updated last year