Alternatives and similar repositories for benchflow

Users that are interested in benchflow are comparing it to the libraries listed below

• hud-evals / hud-python
  OSS RL environment + evals toolkit
  ☆202Updated this week
• MoonshotAI / K2-Vendor-Verifier
  Verify Precision of all Kimi K2 API Vendor
  ☆433Updated last week
• lmarena / p2l
  Prompt-to-Leaderboard
  ☆261Updated 6 months ago
• haizelabs / Awesome-LLM-Judges
  ⚖️ Awesome LLM Judges ⚖️
  ☆133Updated 7 months ago
• PrimeIntellect-ai / prime-environments
  Training-Ready RL Environments + Evals
  ☆177Updated last week
• convergence-ai / webgames
  Challenges for general-purpose web-browsing AI agents
  ☆67Updated 5 months ago
• MoonshotAI / kosong
  The LLM abstraction layer for modern AI agent applications.
  ☆464Updated this week
• agora-protocol / paper-demo
  ☆172Updated 8 months ago
• willccbb / claude-code-mcp
  Letting Claude Code develop his own MCP tools :)
  ☆123Updated 8 months ago
• SWE-agent / SWE-ReX
  Sandboxed code execution for AI agents, locally or on the cloud. Massively parallel, easy to extend. Powering SWE-agent and more.
  ☆376Updated this week
• All-Hands-AI / openhands-aci
  Agent computer interface for AI software engineer.
  ☆114Updated 2 months ago
• scaleapi / SWE-bench_Pro-os
  SWE-Bench Pro: Can AI Agents Solve Long-Horizon Software Engineering Tasks?
  ☆217Updated last week
• SWE-bench / SWE-smith
  [NeurIPS 2025 D&B Spotlight] Scaling Data for SWE-agents
  ☆463Updated last week
• zorazrw / agent-workflow-memory
  AWM: Agent Workflow Memory
  ☆359Updated 9 months ago
• OpenHands / software-agent-sdk
  A clean, modular SDK for building AI agents with OpenHands V1.
  ☆199Updated this week
• sierra-research / tau2-bench
  τ²-Bench: Evaluating Conversational Agents in a Dual-Control Environment
  ☆475Updated this week
• commit-0 / commit0
  Commit0: Library Generation from Scratch
  ☆171Updated 6 months ago
• obalcells / hallucination_probes
  Real-Time Detection of Hallucinated Entities in Long-Form Generation
  ☆268Updated last week
• Aider-AI / polyglot-benchmark
  Coding problems used in aider's polyglot benchmark
  ☆192Updated 11 months ago
• alexzhang13 / rlm
  Super basic implementation (gist-like) of RLMs with REPL environments.
  ☆255Updated last month
• willccbb / claude-deep-research
  Claude Deep Research config for Claude Code.
  ☆224Updated 8 months ago
• grapeot / deep_research_agent
  An Agentic Deep Research Assistant similar to Gemini and OpenAI Deep Research
  ☆125Updated 9 months ago
• Not-Diamond / RoRF
  Routing on Random Forest (RoRF)
  ☆222Updated last year
• PathOnAIOrg / LiteWebAgent
  [NAACL2025] LiteWebAgent: The Open-Source Suite for VLM-Based Web-Agent Applications
  ☆129Updated 4 months ago
• google-deepmind / latent-multi-hop-reasoning
  [ACL 2024] Do Large Language Models Latently Perform Multi-Hop Reasoning?
  ☆84Updated 8 months ago
• brendanhogan / picoDeepResearch
  ☆68Updated 6 months ago
• google / lmeval
  ☆234Updated 4 months ago
• zenbase-ai / py-priompt
  Prompt design in Python
  ☆63Updated last year
• camel-ai / crab
  🦀️ CRAB: Cross-environment Agent Benchmark for Multimodal Language Model Agents. https://crab.camel-ai.org/
  ☆382Updated this week
• xiaowu0162 / LongMemEval
  Benchmarking Chat Assistants on Long-Term Interactive Memory (ICLR 2025)
  ☆288Updated last month