sambanova / toolbenchLinks
ToolBench, an evaluation suite for LLM tool manipulation capabilities.
☆154Updated last year
Alternatives and similar repositories for toolbench
Users that are interested in toolbench are comparing it to the libraries listed below
Sorting:
- Official Repo for ICLR 2024 paper MINT: Evaluating LLMs in Multi-turn Interaction with Tools and Language Feedback by Xingyao Wang*, Ziha…☆126Updated last year
- ToolQA, a new dataset to evaluate the capabilities of LLMs in answering challenging questions with external tools. It offers two levels …☆272Updated last year
- ☆183Updated 5 months ago
- [ICLR 2024] MetaTool Benchmark for Large Language Models: Deciding Whether to Use Tools and Which to Use☆89Updated last year
- Data and Code for Program of Thoughts [TMLR 2023]☆279Updated last year
- Official code for "MAmmoTH2: Scaling Instructions from the Web" [NeurIPS 2024]☆145Updated 8 months ago
- FireAct: Toward Language Agent Fine-tuning☆279Updated last year
- Self-Alignment with Principle-Following Reward Models☆162Updated 2 months ago
- ☆172Updated 2 years ago
- [COLING 2025] ToolEyes: Fine-Grained Evaluation for Tool Learning Capabilities of Large Language Models in Real-world Scenarios☆68Updated 2 months ago
- A dataset of LLM-generated chain-of-thought steps annotated with mistake location.☆81Updated 11 months ago
- [ICLR 2024] Evaluating Large Language Models at Evaluating Instruction Following☆127Updated last year
- [ACL'24] Code and data of paper "When is Tree Search Useful for LLM Planning? It Depends on the Discriminator"☆54Updated last year
- [NeurIPS 2023] This is the code for the paper `Large Language Model as Attributed Training Data Generator: A Tale of Diversity and Bias`.☆150Updated last year
- ☆121Updated last year
- Generative Judge for Evaluating Alignment☆244Updated last year
- Benchmarking LLMs with Challenging Tasks from Real Users☆228Updated 8 months ago
- Code and data accompanying our paper on arXiv "Faithful Chain-of-Thought Reasoning".☆161Updated last year
- 🌍 Repository for "AppWorld: A Controllable World of Apps and People for Benchmarking Interactive Coding Agent", ACL'24 Best Resource Pap…☆221Updated 2 months ago
- ☆234Updated 11 months ago
- augmented LLM with self reflection☆129Updated last year
- Scripts for generating synthetic finetuning data for reducing sycophancy.☆113Updated last year
- An Analytical Evaluation Board of Multi-turn LLM Agents [NeurIPS 2024 Oral]☆329Updated last year
- Code for Arxiv 2023: Improving Language Model Negociation with Self-Play and In-Context Learning from AI Feedback☆207Updated 2 years ago
- Code for paper "LEVER: Learning to Verifiy Language-to-Code Generation with Execution" (ICML'23)☆89Updated 2 years ago
- [NeurIPS 2023 D&B] Code repository for InterCode benchmark https://arxiv.org/abs/2306.14898☆221Updated last year
- Simple next-token-prediction for RLHF☆228Updated last year
- [EMNLP 2023] The CoT Collection: Improving Zero-shot and Few-shot Learning of Language Models via Chain-of-Thought Fine-Tuning☆244Updated last year
- Accepted by Transactions on Machine Learning Research (TMLR)☆129Updated 9 months ago
- ☆270Updated 2 years ago