Evaluating tool-augmented LLMs in conversation settings
☆89May 31, 2024Updated last year
Alternatives and similar repositories for ToolTalk
Users that are interested in ToolTalk are comparing it to the libraries listed below
Sorting:
- [ACL2024] T-Eval: Evaluating Tool Utilization Capability of Large Language Models Step by Step☆305Apr 3, 2024Updated last year
- Code of LeCoRE☆13Feb 15, 2023Updated 3 years ago
- Contains the model patches and the eval logs from the passing swe-bench-lite run.☆10Jun 28, 2024Updated last year
- A Data Source for Reasoning Embodied Agents☆19Sep 18, 2023Updated 2 years ago
- Code for our SIGIR 2022 accepted paper : P3 Ranker: Mitigating the Gaps between Pre-training and Ranking Fine-tuning with Prompt-based L…☆18Sep 24, 2023Updated 2 years ago
- [ICLR'24] MetaTool Benchmark for Large Language Models: Deciding Whether to Use Tools and Which to Use☆109Mar 21, 2024Updated 2 years ago
- ☆918Jul 24, 2024Updated last year
- KuaiSearch PERKS☆12Nov 16, 2021Updated 4 years ago
- ☆21May 22, 2023Updated 2 years ago
- The implementation for CIKM 2024: Towards Completeness-Oriented Tool Retrieval for Large Language Models.☆24Nov 6, 2024Updated last year
- A new tool learning benchmark aiming at well-balanced stability and reality, based on ToolBench.☆221Apr 15, 2025Updated 11 months ago
- AI Agent Tools library for Graphlit Platform☆20Jan 14, 2025Updated last year
- public dataset for followup-query analysis, accepted by AAAI2019☆15Aug 22, 2019Updated 6 years ago
- ☆13Jul 25, 2024Updated last year
- The homepage for ConvSearch Dataset.☆14May 31, 2022Updated 3 years ago
- Hammer: Robust Function-Calling for On-Device Language Models via Function Masking☆114Jun 13, 2025Updated 9 months ago
- Official code for AAAI2023 paper`Confucius: Iterative Tool Learning from Introspection Feedback by Easy-to-Difficult Curriculum`☆45Feb 9, 2025Updated last year
- Code and data for "Lumos: Learning Agents with Unified Data, Modular Design, and Open-Source LLMs"☆474Mar 19, 2024Updated 2 years ago
- Script for downloading GitHub.☆13Sep 24, 2020Updated 5 years ago
- ToolkenGPT: Augmenting Frozen Language Models with Massive Tools via Tool Embeddings - NeurIPS 2023 (oral)☆270Apr 18, 2024Updated last year
- ☆22Jul 27, 2023Updated 2 years ago
- ☆18Jun 24, 2025Updated 8 months ago
- Source Code for DialogBERT: Discourse-Aware Response Generation via Learning to Recover and Rank Utterances (https://arxiv.org/pdf/2012.0…☆79Jan 2, 2022Updated 4 years ago
- Conversational Recommender System Evaluation via Simulation☆19Updated this week
- Open-source repository for the OOPSLA'24 paper "CYCLE: Learning to Self-Refine Code Generation"☆10Mar 8, 2024Updated 2 years ago
- A framework for Ranked List Truncation, including the implementation of multiple existing deep models, such as BiCut、Choopy and AttnCut. …☆14May 7, 2022Updated 3 years ago
- This repository contains the opensource version of the datasets were used for different parts of training and testing of models that grou…☆34Aug 20, 2020Updated 5 years ago
- ToolQA, a new dataset to evaluate the capabilities of LLMs in answering challenging questions with external tools. It offers two levels …☆285Aug 19, 2023Updated 2 years ago
- an implementation of paper"Retentive Network: A Successor to Transformer for Large Language Models" https://arxiv.org/pdf/2307.08621.pdf☆11Jul 25, 2023Updated 2 years ago
- Multi-Task Pre-Training for Plug-and-Play Task-Oriented Dialogue System (ACL 2022)☆162Dec 20, 2023Updated 2 years ago
- Small tools to enhance your AI app with little effort.☆12Jan 9, 2024Updated 2 years ago
- Code for the paper "The Impact of Positional Encoding on Length Generalization in Transformers", NeurIPS 2023☆138Apr 30, 2024Updated last year
- ☆21Sep 15, 2025Updated 6 months ago
- Learning to Select Knowledge for Response Generation in Dialog Systems☆42Dec 20, 2021Updated 4 years ago
- Repo of "Large Language Model-based Human-Agent Collaboration for Complex Task Solving(EMNLP2024 Findings)"☆34Sep 20, 2024Updated last year
- Hugging Face and Pyserini interoperability☆19May 18, 2023Updated 2 years ago
- Loads OpenSubtitles v2018 dataset without having to load everything into memory at once. Works well with pytorch.☆13Aug 26, 2020Updated 5 years ago
- ☆123Jun 6, 2024Updated last year
- Dataset from Tip of the Tongue Known-Item Retrieval (2021) paper.☆12Nov 4, 2021Updated 4 years ago