THUNLP-MT / StableToolBenchLinks
A new tool learning benchmark aiming at well-balanced stability and reality, based on ToolBench.
☆165Updated 3 months ago
Alternatives and similar repositories for StableToolBench
Users that are interested in StableToolBench are comparing it to the libraries listed below
Sorting:
- [COLING 2025] ToolEyes: Fine-Grained Evaluation for Tool Learning Capabilities of Large Language Models in Real-world Scenarios☆68Updated 2 months ago
- ☆31Updated 2 months ago
- Data and Code for Program of Thoughts [TMLR 2023]☆280Updated last year
- ☆298Updated last year
- A version of verl to support tool use☆312Updated this week
- This is the repository that contains the source code for the Self-Evaluation Guided MCTS for online DPO.☆319Updated 11 months ago
- [ACL2024] Planning, Creation, Usage: Benchmarking LLMs for Comprehensive Tool Utilization in Real-World Complex Scenarios☆57Updated last year
- Official Repo for ICLR 2024 paper MINT: Evaluating LLMs in Multi-turn Interaction with Tools and Language Feedback by Xingyao Wang*, Ziha…☆128Updated last year
- Generative Judge for Evaluating Alignment☆244Updated last year
- Official repository for ACL 2025 paper "ProcessBench: Identifying Process Errors in Mathematical Reasoning"☆164Updated 2 months ago
- ☆251Updated 2 months ago
- An Analytical Evaluation Board of Multi-turn LLM Agents [NeurIPS 2024 Oral]☆332Updated last year
- Trial and Error: Exploration-Based Trajectory Optimization of LLM Agents (ACL 2024 Main Conference)☆146Updated 9 months ago
- ToolkenGPT: Augmenting Frozen Language Models with Massive Tools via Tool Embeddings - NeurIPS 2023 (oral)☆264Updated last year
- [ACL 2024] MT-Bench-101: A Fine-Grained Benchmark for Evaluating Large Language Models in Multi-Turn Dialogues☆101Updated last year
- The related works and background techniques about Openai o1☆223Updated 6 months ago
- SimpleDeepSearcher: Deep Information Seeking via Web-Powered Reasoning Trajectory Synthesis☆91Updated last month
- ☆293Updated last month
- ☆50Updated 4 months ago
- A large-scale, fine-grained, diverse preference dataset (and models).☆345Updated last year
- A Comprehensive Survey on Long Context Language Modeling☆166Updated 3 weeks ago
- ☆337Updated last month
- [ICLR 2024] MetaTool Benchmark for Large Language Models: Deciding Whether to Use Tools and Which to Use☆90Updated last year
- 🌍 Repository for "AppWorld: A Controllable World of Apps and People for Benchmarking Interactive Coding Agent", ACL'24 Best Resource Pap…☆231Updated 2 months ago
- ACL 2024 | LooGLE: Long Context Evaluation for Long-Context Language Models☆184Updated 9 months ago
- ☆150Updated 7 months ago
- [EMNLP 2024 (Oral)] Leave No Document Behind: Benchmarking Long-Context LLMs with Extended Multi-Doc QA☆139Updated 8 months ago
- InsTag: A Tool for Data Analysis in LLM Supervised Fine-tuning☆265Updated last year
- Codes and Data for Scaling Relationship on Learning Mathematical Reasoning with Large Language Models☆268Updated 10 months ago
- [NeurIPS 2024] The official implementation of paper: Chain of Preference Optimization: Improving Chain-of-Thought Reasoning in LLMs.☆125Updated 4 months ago