SALT-NLP / collaborative-gym
Framework and toolkits for building and evaluating collaborative agents that can work together with humans.
☆74Updated last month
Alternatives and similar repositories for collaborative-gym:
Users that are interested in collaborative-gym are comparing it to the libraries listed below
- Resources for our paper: "EvoAgent: Towards Automatic Multi-Agent Generation via Evolutionary Algorithms"☆96Updated 6 months ago
- Benchmark and research code for the paper SWEET-RL Training Multi-Turn LLM Agents onCollaborative Reasoning Tasks☆186Updated 3 weeks ago
- Code for Paper: Autonomous Evaluation and Refinement of Digital Agents [COLM 2024]☆135Updated 5 months ago
- [NeurIPS 2024] OlympicArena: Benchmarking Multi-discipline Cognitive Reasoning for Superintelligent AI☆101Updated 2 months ago
- official implementation of paper "Process Reward Model with Q-value Rankings"☆57Updated 3 months ago
- Agentic Reward Modeling: Integrating Human Preferences with Verifiable Correctness Signals for Reliable Reward Systems☆90Updated 2 months ago
- [ICML 2025] Flow of Reasoning: Training LLMs for Divergent Problem Solving with Minimal Examples☆85Updated last month
- "Is Your LLM Secretly a World Model of the Internet? Model-Based Planning for Web Agents"☆70Updated last month
- 🌍 Repository for "AppWorld: A Controllable World of Apps and People for Benchmarking Interactive Coding Agent", ACL'24 Best Resource Pap…☆187Updated this week
- Dynamic Cheatsheet: Test-Time Learning with Adaptive Memory☆56Updated 3 weeks ago
- ☆114Updated 2 months ago
- ☆92Updated 3 months ago
- Code for paper "Optima: Optimizing Effectiveness and Efficiency for LLM-Based Multi-Agent System"☆56Updated 5 months ago
- MPO: Boosting LLM Agents with Meta Plan Optimization☆50Updated 2 months ago
- Scalable Meta-Evaluation of LLMs as Evaluators☆42Updated last year
- Code for "Critique Fine-Tuning: Learning to Critique is More Effective than Learning to Imitate"☆141Updated 2 weeks ago
- [ACL'24] Code and data of paper "When is Tree Search Useful for LLM Planning? It Depends on the Discriminator"☆54Updated last year
- Critique-out-Loud Reward Models☆64Updated 6 months ago
- ☆63Updated last month
- ☆109Updated 3 months ago
- Systematic evaluation framework that automatically rates overthinking behavior in large language models.☆88Updated last month
- ☆121Updated this week
- ☆199Updated 2 months ago
- ☆120Updated 7 months ago
- Benchmarking LLMs with Challenging Tasks from Real Users☆221Updated 6 months ago
- ☆62Updated last month
- A banchmark list for evaluation of large language models.☆103Updated last week
- ☆25Updated 7 months ago
- [ICLR 2024] MetaTool Benchmark for Large Language Models: Deciding Whether to Use Tools and Which to Use☆86Updated last year
- ☆102Updated 5 months ago