benchflow-ai / benchflowLinks
AI benchmark runtime framework that allows you to integrate and evaluate AI tasks using Docker-based benchmarks.
☆180Updated last month
Alternatives and similar repositories for benchflow
Users that are interested in benchflow are comparing it to the libraries listed below
Sorting:
- Agent computer interface for AI software engineer.☆116Updated 2 months ago
- Challenges for general-purpose web-browsing AI agents☆67Updated 8 months ago
- Sandboxed code execution for AI agents, locally or on the cloud. Massively parallel, easy to extend. Powering SWE-agent and more.☆430Updated this week
- The LLM abstraction layer for modern AI agent applications.☆504Updated this week
- AWM: Agent Workflow Memory☆389Updated last month
- Harbor is a framework for running agent evaluations and creating and using RL environments.☆542Updated this week
- SWE-Bench Pro: Can AI Agents Solve Long-Horizon Software Engineering Tasks?☆259Updated last month
- [NeurIPS 2025 D&B Spotlight] Scaling Data for SWE-agents☆538Updated this week
- ☆177Updated 11 months ago
- Prompt-to-Leaderboard☆271Updated 8 months ago
- [ACL 2024] Do Large Language Models Latently Perform Multi-Hop Reasoning?☆90Updated 10 months ago
- Commit0: Library Generation from Scratch☆177Updated 9 months ago
- Meta Agents Research Environments is a comprehensive platform designed to evaluate AI agents in dynamic, realistic scenarios. Unlike stat…☆427Updated 2 weeks ago
- A clean, modular SDK for building AI agents with OpenHands V1.☆476Updated last week
- τ²-Bench: Evaluating Conversational Agents in a Dual-Control Environment☆717Updated this week
- Beating the GAIA benchmark with Transformers Agents. 🚀☆146Updated 11 months ago
- ⚖️ Awesome LLM Judges ⚖️☆161Updated 9 months ago
- Lightly-reviewed collection of community environments☆210Updated last week
- Multi-Faceted AI Agent and Workflow Autotuning. Automatically optimizes LangChain, LangGraph, DSPy programs for better quality, lower exe…☆269Updated 8 months ago
- Real-Time Detection of Hallucinated Entities in Long-Form Generation☆278Updated 2 months ago
- Train your own SOTA deductive reasoning model☆107Updated 11 months ago
- An Agentic Deep Research Assistant similar to Gemini and OpenAI Deep Research☆134Updated 11 months ago
- Training setup for Langchain's Open Deep Research☆74Updated 5 months ago
- ☆237Updated 2 months ago
- Coding problems used in aider's polyglot benchmark☆199Updated last year
- [NAACL2025] LiteWebAgent: The Open-Source Suite for VLM-Based Web-Agent Applications☆143Updated 6 months ago
- Multimodal computer agent data collection program☆161Updated 2 months ago
- GRPO training code which scales to 32xH100s for long horizon terminal/coding tasks. Base agent is now the top Qwen3 agent on Stanford's T…☆344Updated 5 months ago
- Verify Precision of all Kimi K2 API Vendor☆507Updated last week
- ☆67Updated 8 months ago