Alternatives and similar repositories for eval-dev-quality

Users that are interested in eval-dev-quality are comparing it to the libraries listed below

• anyscale / llm-router
  Tutorial for building LLM router
  ☆231Updated last year
• argilla-io / argilla-cookbook
  Simple examples using Argilla tools to build AI
  ☆56Updated 11 months ago
• METR / eval-analysis-public
  Public repository containing METR's DVC pipeline for eval data analysis
  ☆124Updated 6 months ago
• Aider-AI / polyglot-benchmark
  Coding problems used in aider's polyglot benchmark
  ☆184Updated 10 months ago
• teknium1 / LLM-Benchmark-Logs
  Just a bunch of benchmark logs for different LLMs
  ☆118Updated last year
• simple-bench / SimpleBench
  ☆170Updated 10 months ago
• hide-org / hide
  🤖 Headless IDE for AI agents
  ☆200Updated 2 weeks ago
• scaleapi / SWE-bench_Pro-os
  SWE-Bench Pro: Can AI Agents Solve Long-Horizon Software Engineering Tasks?
  ☆202Updated this week
• cohere-ai / cohere-terrarium
  A simple Python sandbox for helpful LLM data agents
  ☆285Updated last year
• QuixiAI / OpenChatML
  ☆162Updated 2 months ago
• h2oai / enterprise-h2ogpte
  Client Code Examples, Use Cases and Benchmarks for Enterprise h2oGPTe RAG-Based GenAI Platform
  ☆90Updated last month
• All-Hands-AI / openhands-resolver
  A system that tries to resolve all issues on a github repo with OpenHands.
  ☆114Updated 11 months ago
• Not-Diamond / RoRF
  Routing on Random Forest (RoRF)
  ☆214Updated last year
• gradion-ai / freeact
  An AI agent library using Python as the common language to define executable actions and tool interfaces.
  ☆85Updated 2 months ago
• zbambergerNLP / strategic-debate-tot
  A DSPy-based implementation of the tree of thoughts method (Yao et al., 2023) for generating persuasive arguments
  ☆90Updated 3 weeks ago
• NL2Code / CodeR
  ☆160Updated last year
• SWE-agent / SWE-ReX
  Sandboxed code execution for AI agents, locally or on the cloud. Massively parallel, easy to extend. Powering SWE-agent and more.
  ☆349Updated this week
• Aider-AI / aider-swe-bench
  Harness used to benchmark aider against SWE Bench benchmarks
  ☆76Updated last year
• invariantlabs-ai / explorer
  A better way of testing, inspecting, and analyzing AI Agent traces.
  ☆40Updated last week
• TechxGenus / CursorCore
  CursorCore: Assist Programming through Aligning Anything
  ☆131Updated 8 months ago
• QuixiAI / dolphin-logger
  ☆104Updated 4 months ago
• willccbb / mlx_parallm
  Fast parallel LLM inference for MLX
  ☆224Updated last year
• DeepSoftwareAnalytics / Awesome-Agent4SE
  ☆101Updated last year
• codestoryai / prompts
  Contains the prompts we use to talk to various LLMs for different utilities inside the editor
  ☆83Updated last year
• vaughanlove / PromptBreeder
  Google Deepmind's PromptBreeder for automated prompt engineering implemented in langchain expression language.
  ☆151Updated last year
• NousResearch / Open-Reasoning-Tasks
  A comprehensive repository of reasoning tasks for LLMs (and beyond)
  ☆450Updated last year
• llllvvuu / instant_apply
  proof-of-concept of Cursor's Instant Apply feature
  ☆83Updated last year
• Xalp / ECHO
  Official homepage for "Self-Harmonized Chain of Thought" (NAACL 2025)
  ☆91Updated 9 months ago
• aymeric-roucher / GAIA
  Beating the GAIA benchmark with Transformers Agents. 🚀
  ☆138Updated 8 months ago
• amazon-science / CodeSage
  CodeSage: Code Representation Learning At Scale (ICLR 2024)
  ☆113Updated last year