Alternatives and similar repositories for benchflow:

Users that are interested in benchflow are comparing it to the libraries listed below

• BhabhaAI / dataformer
  Solving data for LLMs - Create quality synthetic datasets!
  ☆146Updated 3 months ago
• allenai / codescientist
  CodeScientist: An automated scientific discovery system for code-based experiments
  ☆237Updated last month
• commit-0 / commit0
  Commit0: Library Generation from Scratch
  ☆144Updated 3 weeks ago
• ivanleomk / kura
  Kura is a simple reproduction of the CLIO paper which uses language models to label user behaviour before clustering them based on embedd…
  ☆102Updated 3 weeks ago
• haizelabs / Awesome-LLM-Judges
  ⚖️ Awesome LLM Judges ⚖️
  ☆94Updated last week
• agora-protocol / paper-demo
  ☆147Updated 2 months ago
• dottxt-ai / prompts
  A prompting library
  ☆163Updated 7 months ago
• camel-ai / crab
  🦀️ CRAB: Cross-environment Agent Benchmark for Multimodal Language Model Agents. https://crab.camel-ai.org/
  ☆337Updated this week
• Intelligent-Internet / ii-researcher
  II-Researcher: a new open-source framework designed to aid building search / research agents
  ☆246Updated last week
• zorazrw / agent-workflow-memory
  AWM: Agent Workflow Memory
  ☆268Updated 3 months ago
• facebookresearch / swe-rl
  Official codebase for "SWE-RL: Advancing LLM Reasoning via Reinforcement Learning on Open Software Evolution"
  ☆512Updated last month
• google-deepmind / latent-multi-hop-reasoning
  [ACL 2024] Do Large Language Models Latently Perform Multi-Hop Reasoning?
  ☆65Updated last month
• multi-agent-systems-failure-taxonomy / MAST
  ☆164Updated last week
• willccbb / claude-code-mcp
  Letting Claude Code develop his own MCP tools :)
  ☆98Updated last month
• willccbb / claude-deep-research
  Claude Deep Research config for Claude Code.
  ☆170Updated last month
• haizelabs / verdict
  Verdict is a library for scaling judge-time compute.
  ☆202Updated this week
• SWE-Gym / SWE-Gym
  Code for Paper: Training Software Engineering Agents and Verifiers with SWE-Gym
  ☆448Updated last month
• aorwall / moatless-tree-search
  ☆79Updated 2 weeks ago
• browser-use / awesome-projects
  List of Open Source projects built on Browser Use
  ☆57Updated this week
• SWE-agent / SWE-ReX
  Sandboxed code execution for AI agents, locally or on the cloud. Massively parallel, easy to extend. Powering SWE-agent and more.
  ☆170Updated this week
• exa-labs / exa-hallucination-detector
  Hallucination Detector is a free and open-source tool that helps you verify the accuracy of your LLM generated content instantly.
  ☆204Updated 3 months ago
• AK391 / dailypapersHN
  ☆85Updated 7 months ago
• zenbase-ai / py-priompt
  Prompt design in Python
  ☆57Updated 5 months ago
• appl-team / appl
  🍎APPL: A Prompt Programming Language. Seamlessly integrate LLMs with programs.
  ☆247Updated 2 months ago
• All-Hands-AI / openhands-aci
  Agent computer interface for AI software engineer.
  ☆68Updated this week
• zenbase-ai / core
  Prompt engineering, automated.
  ☆304Updated 2 weeks ago
• TheAgentCompany / TheAgentCompany
  An agent benchmark with tasks in a simulated software company.
  ☆320Updated 3 weeks ago
• qixucen / atom
  Atom of Thoughts for Markov LLM Test-Time Scaling
  ☆560Updated last week
• aymeric-roucher / GAIA
  Beating the GAIA benchmark with Transformers Agents. 🚀
  ☆113Updated 2 months ago
• NousResearch / atropos
  Atropos is a Language Model Reinforcement Learning Environments framework for collecting and evaluating LLM trajectories through diverse …
  ☆171Updated this week