Alternatives and similar repositories for agent-as-a-judge

Users that are interested in agent-as-a-judge are comparing it to the libraries listed below

• TheAgentCompany / TheAgentCompany
  An agent benchmark with tasks in a simulated software company.
  ☆635Updated 2 months ago
• camel-ai / crab
  🦀️ CRAB: Cross-environment Agent Benchmark for Multimodal Language Model Agents. https://crab.camel-ai.org/
  ☆394Updated this week
• CharlesQ9 / Alita
  ☆871Updated 5 months ago
• OpenBMB / IoA
  An open-source framework for collaborative AI agents, enabling diverse, distributed agents to team up and tackle complex tasks through in…
  ☆796Updated 4 months ago
• human-re / Agentic-Reasoning
  Integrating Tool Use into LLM Reasoning
  ☆712Updated 11 months ago
• SalesforceAIResearch / xLAM
  xLAM: A Family of Large Action Models to Empower AI Agent Systems
  ☆599Updated 5 months ago
• agiresearch / A-mem
  A-MEM: Agentic Memory for LLM Agents
  ☆814Updated last month
• Ayanami0730 / deep_research_bench
  DeepResearch Bench: A Comprehensive Benchmark for Deep Research Agents
  ☆564Updated 2 months ago
• facebookresearch / swe-rl
  [NeurIPS'25] Official codebase for "SWE-RL: Advancing LLM Reasoning via Reinforcement Learning on Open Software Evolution"
  ☆673Updated 10 months ago
• xingyaoww / code-act
  Official Repo for ICML 2024 paper "Executable Code Actions Elicit Better LLM Agents" by Xingyao Wang, Yangyi Chen, Lifan Yuan, Yizhe Zhan…
  ☆1,573Updated last year
• modelscope / MCPBench
  The evaluation benchmark on MCP servers
  ☆236Updated 5 months ago
• RUC-NLPIR / Search-o1
  🔍 Search-o1: Agentic Search-Enhanced Large Reasoning Models [EMNLP 2025]
  ☆1,159Updated 2 months ago
• YangLing0818 / buffer-of-thought-llm
  [NeurIPS 2024 Spotlight] Buffer of Thoughts: Thought-Augmented Reasoning with Large Language Models
  ☆676Updated 7 months ago
• ranpox / awesome-computer-use
  This is a collection of resources for computer-use GUI agents, including videos, blogs, papers, and projects.
  ☆487Updated 2 months ago
• SalesforceAIResearch / AgentLite
  ☆641Updated 2 months ago
• zorazrw / agent-workflow-memory
  AWM: Agent Workflow Memory
  ☆387Updated last month
• DavidZWZ / Awesome-Deep-Research
  [Up-to-date] Awesome Agentic Deep Research Resources
  ☆622Updated 2 weeks ago
• multi-agent-systems-failure-taxonomy / MAST
  ☆328Updated 6 months ago
• OPPO-PersonalAI / Agent-KB
  Agent KB: Leveraging Cross-Domain Experience for Agentic Problem Solving
  ☆415Updated 5 months ago
• ServiceNow / AgentLab
  AgentLab: An open-source framework for developing, testing, and benchmarking web agents on diverse tasks, designed for scalability and re…
  ☆507Updated 2 weeks ago
• BytedTsinghua-SIA / MemAgent
  A MemAgent framework that can be extrapolated to 3.5M, along with a training framework for RL training of any agent workflow.
  ☆875Updated 6 months ago
• WooooDyy / AgentGym
  Code and implementations for the ACL 2025 paper "AgentGym: Evolving Large Language Model-based Agents across Diverse Environments" by Zhi…
  ☆704Updated 4 months ago
• qixucen / atom
  [NeurIPS 2025] Atom of Thoughts for Markov LLM Test-Time Scaling
  ☆640Updated 2 months ago
• sierra-research / tau-bench
  Code and Data for Tau-Bench
  ☆1,079Updated 5 months ago
• fate-ubw / RAGLAB
  [EMNLP 2024: Demo Oral] RAGLAB: A Modular and Research-Oriented Unified Framework for Retrieval-Augmented Generation
  ☆310Updated last year
• WecoAI / aideml
  AIDE: AI-Driven Exploration in the Space of Code. The machine Learning engineering agent that automates AI R&D.
  ☆1,123Updated 2 months ago
• langchain-ai / langgraph-codeact
  ☆708Updated 8 months ago
• hkust-nlp / CodeIO
  [ICML 2025 Oral] CodeI/O: Condensing Reasoning Patterns via Code Input-Output Prediction
  ☆566Updated 8 months ago
• xlang-ai / OpenCUA
  OpenCUA: Open Foundations for Computer-Use Agents
  ☆661Updated 2 weeks ago
• ServiceNow / TapeAgents
  TapeAgents is a framework that facilitates all stages of the LLM Agent development lifecycle
  ☆302Updated last month