Alternatives and similar repositories for benchflow

Users that are interested in benchflow are comparing it to the libraries listed below

• hud-evals / hud-python
  OSS RL environment + evals toolkit
  ☆189Updated this week
• SWE-agent / SWE-ReX
  Sandboxed code execution for AI agents, locally or on the cloud. Massively parallel, easy to extend. Powering SWE-agent and more.
  ☆331Updated 2 weeks ago
• haizelabs / Awesome-LLM-Judges
  ⚖️ Awesome LLM Judges ⚖️
  ☆131Updated 5 months ago
• agora-protocol / paper-demo
  ☆170Updated 7 months ago
• MoonshotAI / K2-Vendor-Verifier
  Verify Precision of all Kimi K2 API Vendor
  ☆258Updated last week
• commit-0 / commit0
  Commit0: Library Generation from Scratch
  ☆169Updated 5 months ago
• SWE-bench / SWE-smith
  [NeurIPS 2025 D&B Spotlight] Scaling Data for SWE-agents
  ☆429Updated last week
• aymeric-roucher / GAIA
  Beating the GAIA benchmark with Transformers Agents. 🚀
  ☆138Updated 8 months ago
• ServiceNow / TapeAgents
  TapeAgents is a framework that facilitates all stages of the LLM Agent development lifecycle
  ☆298Updated this week
• convergence-ai / webgames
  Challenges for general-purpose web-browsing AI agents
  ☆64Updated 4 months ago
• GenseeAI / cognify
  Multi-Faceted AI Agent and Workflow Autotuning. Automatically optimizes LangChain, LangGraph, DSPy programs for better quality, lower exe…
  ☆258Updated 5 months ago
• Aider-AI / polyglot-benchmark
  Coding problems used in aider's polyglot benchmark
  ☆183Updated 9 months ago
• togethercomputer / open_deep_research
  Together Open Deep Research
  ☆351Updated 6 months ago
• BhabhaAI / dataformer
  Solving data for LLMs - Create quality synthetic datasets!
  ☆151Updated 9 months ago
• zorazrw / agent-workflow-memory
  AWM: Agent Workflow Memory
  ☆332Updated 8 months ago
• All-Hands-AI / openhands-aci
  Agent computer interface for AI software engineer.
  ☆111Updated last month
• SouthBridgeAI / diagen
  ☆246Updated last year
• obalcells / hallucination_probes
  Real-Time Detection of Hallucinated Entities in Long-Form Generation
  ☆258Updated last month
• willccbb / claude-code-mcp
  Letting Claude Code develop his own MCP tools :)
  ☆123Updated 7 months ago
• google-deepmind / latent-multi-hop-reasoning
  [ACL 2024] Do Large Language Models Latently Perform Multi-Hop Reasoning?
  ☆77Updated 7 months ago
• lmarena / p2l
  Prompt-to-Leaderboard
  ☆259Updated 5 months ago
• PrimeIntellect-ai / prime-environments
  Training-Ready RL Environments + Evals
  ☆128Updated this week
• TechxGenus / CursorCore
  CursorCore: Assist Programming through Aligning Anything
  ☆131Updated 8 months ago
• google / lmeval
  ☆232Updated 3 months ago
• camel-ai / crab
  🦀️ CRAB: Cross-environment Agent Benchmark for Multimodal Language Model Agents. https://crab.camel-ai.org/
  ☆376Updated 3 months ago
• dottxt-ai / prompts
  A prompting library
  ☆182Updated 3 months ago
• substratusai / sandboxai
  Run AI generated code in isolated sandboxes
  ☆112Updated 8 months ago
• Nutlope / open-deep-research
  The Open Deep Research app – generate reports with OSS LLMs
  ☆302Updated 3 months ago
• brendanhogan / picoDeepResearch
  ☆68Updated 4 months ago
• TheAgentCompany / TheAgentCompany
  An agent benchmark with tasks in a simulated software company.
  ☆564Updated last week