benchflow-ai / benchflowLinks
AI benchmark runtime framework that allows you to integrate and evaluate AI tasks using Docker-based benchmarks.
☆168Updated last week
Alternatives and similar repositories for benchflow
Users that are interested in benchflow are comparing it to the libraries listed below
Sorting:
- ⚖️ Awesome LLM Judges ⚖️☆146Updated 7 months ago
- A clean, modular SDK for building AI agents with OpenHands V1.☆337Updated this week
- Challenges for general-purpose web-browsing AI agents☆67Updated 6 months ago
- The LLM abstraction layer for modern AI agent applications.☆496Updated this week
- Curated collection of community environments☆195Updated this week
- ☆173Updated 9 months ago
- Agent computer interface for AI software engineer.☆115Updated last week
- Real-Time Detection of Hallucinated Entities in Long-Form Generation☆271Updated last month
- Solving data for LLMs - Create quality synthetic datasets!☆150Updated 11 months ago
- Commit0: Library Generation from Scratch☆173Updated 7 months ago
- Letting Claude Code develop his own MCP tools :)☆122Updated 9 months ago
- Prompt-to-Leaderboard☆267Updated 7 months ago
- ☆68Updated 6 months ago
- SWE-Bench Pro: Can AI Agents Solve Long-Horizon Software Engineering Tasks?☆228Updated last month
- Coding problems used in aider's polyglot benchmark☆198Updated 11 months ago
- Claude Deep Research config for Claude Code.☆222Updated 9 months ago
- Sandboxed code execution for AI agents, locally or on the cloud. Massively parallel, easy to extend. Powering SWE-agent and more.☆391Updated this week
- [ACL 2024] Do Large Language Models Latently Perform Multi-Hop Reasoning?☆84Updated 9 months ago
- τ²-Bench: Evaluating Conversational Agents in a Dual-Control Environment☆549Updated this week
- Prompt design in Python☆63Updated last year
- Verify Precision of all Kimi K2 API Vendor☆489Updated last month
- Training setup for Langchain's Open Deep Research☆73Updated 3 months ago
- ☆235Updated 3 weeks ago
- AWM: Agent Workflow Memory☆372Updated 10 months ago
- [NAACL2025] LiteWebAgent: The Open-Source Suite for VLM-Based Web-Agent Applications☆134Updated 5 months ago
- Together Open Deep Research☆355Updated 8 months ago
- Super basic implementation (gist-like) of RLMs with REPL environments.☆286Updated 2 months ago
- [NeurIPS 2025 D&B Spotlight] Scaling Data for SWE-agents☆487Updated this week
- Train your own SOTA deductive reasoning model☆107Updated 9 months ago
- ☆128Updated 6 months ago