Alternatives and similar repositories for benchflow

Users that are interested in benchflow are comparing it to the libraries listed below

• hud-evals / hud-python
  OSS RL environment + evals toolkit
  ☆198Updated this week
• MoonshotAI / K2-Vendor-Verifier
  Verify Precision of all Kimi K2 API Vendor
  ☆340Updated last week
• SWE-agent / SWE-ReX
  Sandboxed code execution for AI agents, locally or on the cloud. Massively parallel, easy to extend. Powering SWE-agent and more.
  ☆352Updated this week
• haizelabs / Awesome-LLM-Judges
  ⚖️ Awesome LLM Judges ⚖️
  ☆132Updated 6 months ago
• lmarena / p2l
  Prompt-to-Leaderboard
  ☆260Updated 6 months ago
• All-Hands-AI / openhands-aci
  Agent computer interface for AI software engineer.
  ☆110Updated last month
• convergence-ai / webgames
  Challenges for general-purpose web-browsing AI agents
  ☆66Updated 5 months ago
• agora-protocol / paper-demo
  ☆170Updated 8 months ago
• llllvvuu / instant_apply
  proof-of-concept of Cursor's Instant Apply feature
  ☆84Updated last year
• willccbb / claude-code-mcp
  Letting Claude Code develop his own MCP tools :)
  ☆123Updated 8 months ago
• SWE-bench / SWE-smith
  [NeurIPS 2025 D&B Spotlight] Scaling Data for SWE-agents
  ☆442Updated this week
• togethercomputer / open_deep_research
  Together Open Deep Research
  ☆353Updated 6 months ago
• grapeot / deep_research_agent
  An Agentic Deep Research Assistant similar to Gemini and OpenAI Deep Research
  ☆125Updated 8 months ago
• commit-0 / commit0
  Commit0: Library Generation from Scratch
  ☆171Updated 6 months ago
• alexzhang13 / rlm
  Super basic implementation (gist-like) of RLMs with REPL environments.
  ☆242Updated 3 weeks ago
• Not-Diamond / RoRF
  Routing on Random Forest (RoRF)
  ☆218Updated last year
• aymeric-roucher / GAIA
  Beating the GAIA benchmark with Transformers Agents. 🚀
  ☆138Updated 8 months ago
• google / lmeval
  ☆231Updated 4 months ago
• ServiceNow / TapeAgents
  TapeAgents is a framework that facilitates all stages of the LLM Agent development lifecycle
  ☆299Updated this week
• google-deepmind / latent-multi-hop-reasoning
  [ACL 2024] Do Large Language Models Latently Perform Multi-Hop Reasoning?
  ☆80Updated 7 months ago
• zorazrw / agent-workflow-memory
  AWM: Agent Workflow Memory
  ☆343Updated 9 months ago
• sierra-research / tau2-bench
  τ²-Bench: Evaluating Conversational Agents in a Dual-Control Environment
  ☆394Updated this week
• obalcells / hallucination_probes
  Real-Time Detection of Hallucinated Entities in Long-Form Generation
  ☆264Updated 3 weeks ago
• willccbb / claude-deep-research
  Claude Deep Research config for Claude Code.
  ☆223Updated 7 months ago
• All-Hands-AI / openhands-resolver
  A system that tries to resolve all issues on a github repo with OpenHands.
  ☆114Updated 11 months ago
• zenbase-ai / py-priompt
  Prompt design in Python
  ☆63Updated 11 months ago
• collinear-ai / spider
  craft post-training data recipes
  ☆26Updated last week
• BhabhaAI / dataformer
  Solving data for LLMs - Create quality synthetic datasets!
  ☆150Updated 9 months ago
• PathOnAIOrg / LiteWebAgent
  [NAACL2025] LiteWebAgent: The Open-Source Suite for VLM-Based Web-Agent Applications
  ☆127Updated 3 months ago
• Nutlope / open-deep-research
  The Open Deep Research app – generate reports with OSS LLMs
  ☆303Updated this week