Alternatives and similar repositories for agent-as-a-judge

Users that are interested in agent-as-a-judge are comparing it to the libraries listed below

• camel-ai / crab
  🦀️ CRAB: Cross-environment Agent Benchmark for Multimodal Language Model Agents. https://crab.camel-ai.org/
  ☆366Updated last month
• OpenBMB / IoA
  An open-source framework for collaborative AI agents, enabling diverse, distributed agents to team up and tackle complex tasks through in…
  ☆749Updated 10 months ago
• theworldofagents / Agentic-Reasoning
  free and open OpenAI Deep Research
  ☆663Updated 6 months ago
• CharlesQ9 / Alita
  ☆784Updated 2 months ago
• microsoft / agent-lightning
  The absolute trainer to light up AI agents.
  ☆953Updated last week
• facebookresearch / swe-rl
  Official codebase for "SWE-RL: Advancing LLM Reasoning via Reinforcement Learning on Open Software Evolution"
  ☆591Updated 5 months ago
• xingyaoww / code-act
  Official Repo for ICML 2024 paper "Executable Code Actions Elicit Better LLM Agents" by Xingyao Wang, Yangyi Chen, Lifan Yuan, Yizhe Zhan…
  ☆1,343Updated last year
• zorazrw / agent-workflow-memory
  AWM: Agent Workflow Memory
  ☆300Updated 6 months ago
• SalesforceAIResearch / xLAM
  xLAM: A Family of Large Action Models to Empower AI Agent Systems
  ☆537Updated this week
• sunnynexus / Search-o1
  🔍 Search-o1: Agentic Search-Enhanced Large Reasoning Models [EMNLP 2025]
  ☆1,016Updated this week
• TheAgentCompany / TheAgentCompany
  An agent benchmark with tasks in a simulated software company.
  ☆528Updated 2 weeks ago
• qixucen / atom
  Atom of Thoughts for Markov LLM Test-Time Scaling
  ☆583Updated 2 months ago
• multi-agent-systems-failure-taxonomy / MAST
  ☆259Updated last month
• agiresearch / A-mem
  A-MEM: Agentic Memory for LLM Agents
  ☆534Updated last month
• gersteinlab / LocAgent
  [ACL 2025] Graph-guided agentic framework for code localization https://arxiv.org/abs/2503.09089
  ☆495Updated last week
• BytedTsinghua-SIA / MemAgent
  A MemAgent framework that can be extrapolated to 3.5M, along with a training framework for RL training of any agent workflow.
  ☆605Updated 3 weeks ago
• microsoft / WindowsAgentArena
  Windows Agent Arena (WAA) 🪟 is a scalable OS platform for testing and benchmarking of multi-modal AI agents.
  ☆750Updated 3 months ago
• langchain-ai / langgraph-codeact
  ☆586Updated 3 months ago
• YangLing0818 / buffer-of-thought-llm
  [NeurIPS 2024 Spotlight] Buffer of Thoughts: Thought-Augmented Reasoning with Large Language Models
  ☆655Updated last month
• allenai / codescientist
  CodeScientist: An automated scientific discovery system for code-based experiments
  ☆289Updated 2 months ago
• GAIR-NLP / OpenResearcher
  OpenResearcher, an advanced Scientific Research Assistant
  ☆455Updated 10 months ago
• zjunlp / OmniThink
  [EMNLP 2025] OmniThink: Expanding Knowledge Boundaries in Machine Writing through Thinking
  ☆456Updated 4 months ago
• ranpox / awesome-computer-use
  This is a collection of resources for computer-use GUI agents, including videos, blogs, papers, and projects.
  ☆425Updated 2 months ago
• agent-husky / Husky-v1
  Code for Husky, an open-source language agent that solves complex, multi-step reasoning tasks. Husky v1 addresses numerical, tabular and …
  ☆345Updated last year
• ServiceNow / AgentLab
  AgentLab: An open-source framework for developing, testing, and benchmarking web agents on diverse tasks, designed for scalability and re…
  ☆386Updated this week
• principia-ai / WriteHERE
  An Open-Source AI Writing Project.
  ☆347Updated last month
• ByteDance-Seed / m3-agent
  ☆507Updated this week
• SalesforceAIResearch / AgentLite
  ☆624Updated 7 months ago
• DavidZWZ / Awesome-Deep-Research
  [Up-to-date] Awesome Agentic Deep Research Resources
  ☆397Updated last month
• WecoAI / aideml
  AIDE: AI-Driven Exploration in the Space of Code. The machine Learning engineering agent that automates AI R&D.
  ☆996Updated 2 weeks ago