Alternatives and similar repositories for benchflow

Users that are interested in benchflow are comparing it to the libraries listed below

• MoonshotAI / kosong
  The LLM abstraction layer for modern AI agent applications.
  ☆499Updated last week
• All-Hands-AI / openhands-aci
  Agent computer interface for AI software engineer.
  ☆114Updated last month
• convergence-ai / webgames
  Challenges for general-purpose web-browsing AI agents
  ☆67Updated 7 months ago
• haizelabs / Awesome-LLM-Judges
  ⚖️ Awesome LLM Judges ⚖️
  ☆148Updated 8 months ago
• commit-0 / commit0
  Commit0: Library Generation from Scratch
  ☆174Updated 8 months ago
• SWE-agent / SWE-ReX
  Sandboxed code execution for AI agents, locally or on the cloud. Massively parallel, easy to extend. Powering SWE-agent and more.
  ☆402Updated last week
• SWE-bench / SWE-smith
  [NeurIPS 2025 D&B Spotlight] Scaling Data for SWE-agents
  ☆509Updated this week
• agora-protocol / paper-demo
  ☆175Updated 10 months ago
• zorazrw / agent-workflow-memory
  AWM: Agent Workflow Memory
  ☆376Updated 2 weeks ago
• PrimeIntellect-ai / prime-environments
  Curated collection of community environments
  ☆200Updated this week
• google-deepmind / latent-multi-hop-reasoning
  [ACL 2024] Do Large Language Models Latently Perform Multi-Hop Reasoning?
  ☆85Updated 9 months ago
• laude-institute / harbor
  Harbor is a framework for running agent evaluations and creating and using RL environments.
  ☆306Updated this week
• aymeric-roucher / GAIA
  Beating the GAIA benchmark with Transformers Agents. 🚀
  ☆144Updated 10 months ago
• OpenHands / software-agent-sdk
  A clean, modular SDK for building AI agents with OpenHands V1.
  ☆391Updated this week
• xlang-ai / computer-agent-arena
  Computer Agent Arena: Test & compare AI agents in real desktop apps & web environments. Code/data coming soon!
  ☆51Updated 9 months ago
• facebookresearch / meta-agents-research-environments
  Meta Agents Research Environments is a comprehensive platform designed to evaluate AI agents in dynamic, realistic scenarios. Unlike stat…
  ☆411Updated last month
• scaleapi / SWE-bench_Pro-os
  SWE-Bench Pro: Can AI Agents Solve Long-Horizon Software Engineering Tasks?
  ☆240Updated this week
• zenbase-ai / py-priompt
  Prompt design in Python
  ☆63Updated last year
• lmarena / p2l
  Prompt-to-Leaderboard
  ☆270Updated 8 months ago
• Danau5tin / terminal-bench-rl
  GRPO training code which scales to 32xH100s for long horizon terminal/coding tasks. Base agent is now the top Qwen3 agent on Stanford's T…
  ☆323Updated 4 months ago
• yueqis / API-Based-Agent
  ☆63Updated 6 months ago
• Aider-AI / polyglot-benchmark
  Coding problems used in aider's polyglot benchmark
  ☆199Updated last year
• aorwall / moatless-tree-search
  ☆128Updated 7 months ago
• sierra-research / tau2-bench
  τ²-Bench: Evaluating Conversational Agents in a Dual-Control Environment
  ☆598Updated 3 weeks ago
• PathOnAIOrg / LiteWebAgent
  [NAACL2025] LiteWebAgent: The Open-Source Suite for VLM-Based Web-Agent Applications
  ☆141Updated 6 months ago
• SALT-NLP / collaborative-gym
  Framework and toolkits for building and evaluating collaborative agents that can work together with humans.
  ☆117Updated last month
• benchflow-ai / skillsbench
  SkillsBench evaluates how well skills work and how effective agents are at using them
  ☆166Updated this week
• camel-ai / crab
  🦀️ CRAB: Cross-environment Agent Benchmark for Multimodal Language Model Agents. https://crab.camel-ai.org/
  ☆388Updated last week
• brendanhogan / picoDeepResearch
  ☆68Updated 7 months ago
• InternLM / SWE-Fixer
  ☆130Updated 8 months ago