Alternatives and similar repositories for LLM-Agent-Benchmark-List

Users that are interested in LLM-Agent-Benchmark-List are comparing it to the libraries listed below

• hkust-nlp / AgentBoard
  An Analytical Evaluation Board of Multi-turn LLM Agents [NeurIPS 2024 Oral]
  ☆320Updated last year
• GAIR-NLP / ToRL
  ☆198Updated last week
• zjunlp / WKM
  [NeurIPS 2024] Agent Planning with World Knowledge Model
  ☆136Updated 5 months ago
• zorazrw / awesome-tool-llm
  ☆229Updated 9 months ago
• jwhj / OREO
  ☆113Updated 4 months ago
• StonyBrookNLP / appworld
  🌍 Repository for "AppWorld: A Controllable World of Apps and People for Benchmarking Interactive Coding Agent", ACL'24 Best Resource Pap…
  ☆206Updated 3 weeks ago
• kyegomez / Lets-Verify-Step-by-Step
  "Improving Mathematical Reasoning with Process Supervision" by OPENAI
  ☆107Updated 2 weeks ago
• xingyaoww / mint-bench
  Official Repo for ICLR 2024 paper MINT: Evaluating LLMs in Multi-turn Interaction with Tools and Language Feedback by Xingyao Wang*, Ziha…
  ☆124Updated last year
• facebookresearch / sweet_rl
  Benchmark and research code for the paper SWEET-RL Training Multi-Turn LLM Agents onCollaborative Reasoning Tasks
  ☆207Updated last month
• SALT-NLP / DyLAN
  Official Implementation of Dynamic LLM-Agent Network: An LLM-agent Collaboration Framework with Agent Team Optimization
  ☆146Updated last year
• rxlqn / awesome-llm-self-reflection
  augmented LLM with self reflection
  ☆124Updated last year
• PRIME-RL / ImplicitPRM
  Repo of paper "Free Process Rewards without Process Labels"
  ☆149Updated 2 months ago
• THUNLP-MT / StableToolBench
  A new tool learning benchmark aiming at well-balanced stability and reality, based on ToolBench.
  ☆149Updated last month
• thunlp / Optima
  Code for paper "Optima: Optimizing Effectiveness and Efficiency for LLM-Based Multi-Agent System"
  ☆58Updated 6 months ago
• Yifan-Song793 / ETO
  Trial and Error: Exploration-Based Trajectory Optimization of LLM Agents (ACL 2024 Main Conference)
  ☆141Updated 7 months ago
• QwenLM / ProcessBench
  Official repository for ACL 2025 paper "ProcessBench: Identifying Process Errors in Mathematical Reasoning"
  ☆155Updated 2 weeks ago
• kanishkg / cognitive-behaviors
  ☆173Updated 2 months ago
• zjunlp / WorfBench
  [ICLR 2025] Benchmarking Agentic Workflow Generation
  ☆94Updated 3 months ago
• sail-sg / CPO
  [NeurIPS 2024] The official implementation of paper: Chain of Preference Optimization: Improving Chain-of-Thought Reasoning in LLMs.
  ☆123Updated 2 months ago
• SuperBruceJia / Awesome-LLM-Self-Consistency
  Awesome LLM Self-Consistency: a curated list of Self-consistency in Large Language Models
  ☆97Updated 9 months ago
• cmu-l3 / l1
  L1: Controlling How Long A Reasoning Model Thinks With Reinforcement Learning
  ☆213Updated 3 weeks ago
• Yu-Fangxu / FoR
  [ICML 2025] Flow of Reasoning: Training LLMs for Divergent Reasoning with Minimal Examples
  ☆88Updated last week
• NumberChiffre / mcts-llm
  ☆94Updated 5 months ago
• ganler / code-r1
  Reproducing R1 for Code with Reliable Rewards
  ☆201Updated last month
• zjunlp / AutoAct
  [ACL 2024] AutoAct: Automatic Agent Learning from Scratch for QA via Self-Planning
  ☆226Updated 4 months ago
• anchen1011 / FireAct
  FireAct: Toward Language Agent Fine-tuning
  ☆278Updated last year
• eddycmu / demystify-long-cot
  ☆293Updated this week
• tongyx361 / Awesome-LLM4Math
  Curation of resources for LLM mathematical reasoning, most of which are screened by @tongyx361 to ensure high quality and accompanied wit…
  ☆129Updated 10 months ago
• LCLM-Horizon / A-Comprehensive-Survey-For-Long-Context-Language-Modeling
  A Comprehensive Survey on Long Context Language Modeling
  ☆147Updated 2 weeks ago
• kohjingyu / search-agents
  Code for the paper 🌳 Tree Search for Language Model Agents
  ☆199Updated 10 months ago