Alternatives and similar repositories for benchflow

Users that are interested in benchflow are comparing it to the libraries listed below

• haizelabs / Awesome-LLM-Judges
  ⚖️ Awesome LLM Judges ⚖️
  ☆128Updated 4 months ago
• hud-evals / hud-python
  OSS RL environment + evals toolkit
  ☆181Updated this week
• eval-sys / mcpmark
  MCPMark is a comprehensive, stress-testing MCP benchmark designed to evaluate model and agent capabilities in real-world MCP use.
  ☆154Updated last week
• convergence-ai / webgames
  Challenges for general-purpose web-browsing AI agents
  ☆65Updated 3 months ago
• agora-protocol / paper-demo
  ☆171Updated 6 months ago
• lmarena / p2l
  Prompt-to-Leaderboard
  ☆254Updated 4 months ago
• All-Hands-AI / openhands-aci
  Agent computer interface for AI software engineer.
  ☆111Updated last week
• SWE-agent / SWE-ReX
  Sandboxed code execution for AI agents, locally or on the cloud. Massively parallel, easy to extend. Powering SWE-agent and more.
  ☆321Updated this week
• willccbb / claude-code-mcp
  Letting Claude Code develop his own MCP tools :)
  ☆121Updated 6 months ago
• zorazrw / agent-workflow-memory
  AWM: Agent Workflow Memory
  ☆325Updated 7 months ago
• Not-Diamond / RoRF
  Routing on Random Forest (RoRF)
  ☆206Updated last year
• MoonshotAI / K2-Vendor-Verfier
  Verify Precision of all Kimi K2 API Vendor
  ☆139Updated this week
• grapeot / deep_research_agent
  An Agentic Deep Research Assistant similar to Gemini and OpenAI Deep Research
  ☆123Updated 7 months ago
• commit-0 / commit0
  Commit0: Library Generation from Scratch
  ☆167Updated 4 months ago
• sierra-research / tau2-bench
  τ²-Bench: Evaluating Conversational Agents in a Dual-Control Environment
  ☆318Updated last month
• SWE-bench / SWE-smith
  [NeurIPS 2025 D&B Spotlight] Scaling Data for SWE-agents
  ☆407Updated this week
• google / lmeval
  ☆231Updated 2 months ago
• BhabhaAI / dataformer
  Solving data for LLMs - Create quality synthetic datasets!
  ☆150Updated 8 months ago
• OpenPipe / open_deep_research_training
  Training setup for Langchain's Open Deep Research
  ☆58Updated 3 weeks ago
• PrimeIntellect-ai / prime-environments
  Training-Ready RL Environments + Evals
  ☆111Updated this week
• togethercomputer / open_deep_research
  Together Open Deep Research
  ☆349Updated 5 months ago
• xiaowu0162 / LongMemEval
  Benchmarking Chat Assistants on Long-Term Interactive Memory (ICLR 2025)
  ☆213Updated last week
• aymeric-roucher / GAIA
  Beating the GAIA benchmark with Transformers Agents. 🚀
  ☆136Updated 7 months ago
• ServiceNow / TapeAgents
  TapeAgents is a framework that facilitates all stages of the LLM Agent development lifecycle
  ☆296Updated this week
• zenbase-ai / py-priompt
  Prompt design in Python
  ☆62Updated 10 months ago
• camel-ai / crab
  🦀️ CRAB: Cross-environment Agent Benchmark for Multimodal Language Model Agents. https://crab.camel-ai.org/
  ☆374Updated 2 months ago
• agent-infra / sandbox
  All-in-One Sandbox for AI Agents that combines Browser, Shell, File, MCP and VSCode Server in a single Docker container.
  ☆141Updated this week
• scaleapi / SWE-bench_Pro-os
  SWE-Bench Pro: Can AI Agents Solve Long-Horizon Software Engineering Tasks?
  ☆107Updated this week
• tokenbender / avataRL
  rl from zero pretrain, can it be done? yes.
  ☆269Updated this week
• GenseeAI / cognify
  Multi-Faceted AI Agent and Workflow Autotuning. Automatically optimizes LangChain, LangGraph, DSPy programs for better quality, lower exe…
  ☆253Updated 4 months ago