Alternatives and similar repositories for CMAT:

Users that are interested in CMAT are comparing it to the libraries listed below

• yongchao98 / PROMST
  Automatic prompt optimization framework for multi-step agent tasks.
  ☆27Updated 3 months ago
• OSU-NLP-Group / llm-planning-eval
  [ACL'24] Code and data of paper "When is Tree Search Useful for LLM Planning? It Depends on the Discriminator"
  ☆54Updated 11 months ago
• noewangjy / SP-CoT
  The GitHub repository for the paper "Self-prompted Chain-of-Thought on Large Language Models for Open-domain Multi-hop Reasoning" accepte…
  ☆18Updated 11 months ago
• ernie-research / Tool-Augmented-Reward-Model
  [ICLR'24 spotlight] Tool-Augmented Reward Modeling
  ☆44Updated last month
• lifan-yuan / CRAFT
  Code for ICLR 2024 paper "CRAFT: Customizing LLMs by Creating and Retrieving from Specialized Toolsets"
  ☆51Updated 8 months ago
• jiangjiechen / auction-arena
  Source code for our paper: "Put Your Money Where Your Mouth Is: Evaluating Strategic Planning and Execution of LLM Agents in an Auction A…
  ☆43Updated last year
• icip-cas / SelfRetrieval
  ☆27Updated 3 months ago
• thu-coai / SPaR
  ☆42Updated 2 months ago
• abhika-m / FAVA
  ☆66Updated last year
• Yifan-Song793 / ETO
  Trial and Error: Exploration-Based Trajectory Optimization of LLM Agents (ACL 2024 Main Conference)
  ☆116Updated 3 months ago
• fairyshine / Seal-Tools
  The source code and dataset mentioned in the paper Seal-Tools: Self-Instruct Tool Learning Dataset for Agent Tuning and Detailed Benchmar…
  ☆42Updated 3 months ago
• RUCKBReasoning / CoT-based-Synthesizer
  The code of arxiv paper: "CoT-based Synthesizer: Enhancing LLM Performance through Answer Synthesis"
  ☆21Updated last month
• OpenMatch / ActiveRAG
  This is the code repo for our paper "Autonomously Knowledge Assimilation and Accommodation through Retrieval-Augmented Agents".
  ☆102Updated 3 months ago
• weizhepei / InstructRAG
  [ICLR 2025] InstructRAG: Instructing Retrieval-Augmented Generation via Self-Synthesized Rationales
  ☆72Updated 2 weeks ago
• MadeAgents / Hammer
  Hammer: Robust Function-Calling for On-Device Language Models via Function Masking
  ☆58Updated this week
• dinobby / MAgICoRE
  ☆23Updated 5 months ago
• JoeYing1019 / UltraTool
  [ACL2024] Planning, Creation, Usage: Benchmarking LLMs for Comprehensive Tool Utilization in Real-World Complex Scenarios
  ☆52Updated 10 months ago
• siyuyuan / evoagent
  Resources for our paper: "EvoAgent: Towards Automatic Multi-Agent Generation via Evolutionary Algorithms"
  ☆82Updated 4 months ago
• WeiminXiong / IPR
  Watch Every Step! LLM Agent Learning via Iterative Step-level Process Refinement (EMNLP 2024 Main Conference)
  ☆52Updated 4 months ago
• RuochenZhao / Verify-and-Edit
  A framework for editing the CoTs for better factuality
  ☆48Updated last year
• Junjie-Ye / ToolEyes
  [COLING 2025] ToolEyes: Fine-Grained Evaluation for Tool Learning Capabilities of Large Language Models in Real-world Scenarios
  ☆65Updated 2 months ago
• ZitongYang / Synthetic_Continued_Pretraining
  Code implementation of synthetic continued pretraining
  ☆88Updated last month
• zjunlp / WorfBench
  [ICLR 2025] Benchmarking Agentic Workflow Generation
  ☆47Updated this week
• xlang-ai / BRIGHT
  BRIGHT: A Realistic and Challenging Benchmark for Reasoning-Intensive Retrieval
  ☆75Updated last week
• OpenMatch / RAG-DDR
  [ICLR 2025] This is the code repo for our ICLR’25 paper "RAG-DDR: Optimizing Retrieval-Augmented Generation Using Differentiable Data Rew…
  ☆23Updated last week
• zjunlp / TRICE
  [NAACL 2024] Making Language Models Better Tool Learners with Execution Feedback
  ☆40Updated 11 months ago
• Reason-Wang / NAT
  The official implementation of paper "Learning From Failure: Integrating Negative Examples when Fine-tuning Large Language Models as Agen…
  ☆23Updated 11 months ago
• GAIR-NLP / scaleeval
  Scalable Meta-Evaluation of LLMs as Evaluators
  ☆43Updated last year
• GAIR-NLP / OPO
  ☆48Updated 11 months ago