Evaluating tool-augmented LLMs in conversation settings
☆89May 31, 2024Updated last year
Alternatives and similar repositories for ToolTalk
Users that are interested in ToolTalk are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- [ACL2024] T-Eval: Evaluating Tool Utilization Capability of Large Language Models Step by Step☆305Apr 3, 2024Updated 2 years ago
- Code of LeCoRE☆13Feb 15, 2023Updated 3 years ago
- Contains the model patches and the eval logs from the passing swe-bench-lite run.☆10Jun 28, 2024Updated last year
- A Data Source for Reasoning Embodied Agents☆19Sep 18, 2023Updated 2 years ago
- Companion code to https://arxiv.org/abs/2402.15491☆22Sep 18, 2025Updated 7 months ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- [ICLR'24] MetaTool Benchmark for Large Language Models: Deciding Whether to Use Tools and Which to Use☆114Mar 21, 2024Updated 2 years ago
- m&ms: A Benchmark to Evaluate Tool-Use for multi-step multi-modal tasks☆46Sep 26, 2024Updated last year
- [ACL 2024] On the Multi-turn Instruction Following for Conversational Web Agents☆17Oct 12, 2024Updated last year
- KuaiSearch PERKS☆12Nov 16, 2021Updated 4 years ago
- ☆15Apr 15, 2024Updated 2 years ago
- [ACL2024] Planning, Creation, Usage: Benchmarking LLMs for Comprehensive Tool Utilization in Real-World Complex Scenarios☆71Aug 5, 2025Updated 8 months ago
- A new tool learning benchmark aiming at well-balanced stability and reality, based on ToolBench.☆229Apr 15, 2025Updated last year
- ☆644Nov 10, 2025Updated 5 months ago
- AI Agent Tools library for Graphlit Platform☆21Jan 14, 2025Updated last year
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- This repository contains the ToolSelect dataset which was used to fine-tune Llama-2 70B for tool selection.☆22Mar 11, 2024Updated 2 years ago
- ☆12Aug 15, 2023Updated 2 years ago
- Hammer: Robust Function-Calling for On-Device Language Models via Function Masking☆115Jun 13, 2025Updated 10 months ago
- A Conversational Information Seeking (CIS) Paper Reading List Maintained by Chuan Meng.☆29Sep 27, 2022Updated 3 years ago
- Code and data for "Lumos: Learning Agents with Unified Data, Modular Design, and Open-Source LLMs"☆477Mar 19, 2024Updated 2 years ago
- Script for downloading GitHub.☆13Sep 24, 2020Updated 5 years ago
- ToolkenGPT: Augmenting Frozen Language Models with Massive Tools via Tool Embeddings - NeurIPS 2023 (oral)☆271Apr 18, 2024Updated 2 years ago
- ☆23Jul 27, 2023Updated 2 years ago
- ☆11May 26, 2020Updated 5 years ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- ☆18Jun 24, 2025Updated 10 months ago
- Source Code for DialogBERT: Discourse-Aware Response Generation via Learning to Recover and Rank Utterances (https://arxiv.org/pdf/2012.0…☆79Jan 2, 2022Updated 4 years ago
- Open-source Large Language Models are Strong Zero-shot Query Likelihood Models for Document Ranking☆17Oct 26, 2023Updated 2 years ago
- Code for GenAug: Data Augmentation for Finetuning Text Generators.☆28Oct 8, 2021Updated 4 years ago
- Conversational Recommender System Evaluation via Simulation☆19Apr 21, 2026Updated last week
- A framework for Ranked List Truncation, including the implementation of multiple existing deep models, such as BiCut、Choopy and AttnCut. …☆14May 7, 2022Updated 3 years ago
- my dissertation!☆11Sep 6, 2022Updated 3 years ago
- This repository contains the opensource version of the datasets were used for different parts of training and testing of models that grou…☆34Aug 20, 2020Updated 5 years ago
- ☆189Jan 27, 2025Updated last year
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- ToolQA, a new dataset to evaluate the capabilities of LLMs in answering challenging questions with external tools. It offers two levels …☆285Aug 19, 2023Updated 2 years ago
- an implementation of paper"Retentive Network: A Successor to Transformer for Large Language Models" https://arxiv.org/pdf/2307.08621.pdf☆11Jul 25, 2023Updated 2 years ago
- Multi-Task Pre-Training for Plug-and-Play Task-Oriented Dialogue System (ACL 2022)☆162Dec 20, 2023Updated 2 years ago
- AIR retriever for Multi-Hop QA (ACL 2020 paper)☆30Jul 18, 2020Updated 5 years ago
- Multi-threading, Concurrency, Asynchrony, and various Execution Methods implemented in a Rust backend for bleeding edge performance.☆20Nov 11, 2024Updated last year
- A tool to build a graph from a codebase☆14Feb 19, 2025Updated last year
- Code for the paper "The Impact of Positional Encoding on Length Generalization in Transformers", NeurIPS 2023☆139Apr 30, 2024Updated 2 years ago