Evaluating tool-augmented LLMs in conversation settings
☆89May 31, 2024Updated 2 years ago
Alternatives and similar repositories for ToolTalk
Users that are interested in ToolTalk are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- [ACL2024] T-Eval: Evaluating Tool Utilization Capability of Large Language Models Step by Step☆313Apr 3, 2024Updated 2 years ago
- ☆923Jul 24, 2024Updated 2 years ago
- Code of LeCoRE☆14Feb 15, 2023Updated 3 years ago
- ☆22Nov 1, 2025Updated last year
- Repo of "Large Language Model-based Human-Agent Collaboration for Complex Task Solving(EMNLP2024 Findings)"☆34Sep 20, 2024Updated 2 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- CodeUltraFeedback: aligning large language models to coding preferences (TOSEM 2025)☆76Jun 25, 2024Updated 2 years ago
- [SIGIR '22] Code for our SIGIR 2022 accepted paper : P3 Ranker: Mitigating the Gaps between Pre-training and Ranking Fine-tuning with Pr…☆18Sep 24, 2023Updated 3 years ago
- [ACL 2024] On the Multi-turn Instruction Following for Conversational Web Agents☆17Oct 12, 2024Updated 2 years ago
- ☆21May 22, 2023Updated 3 years ago
- Conversations with Search Engines☆14Jun 12, 2023Updated 3 years ago
- A simple GPT-based evaluation tool for multi-aspect, interpretable assessment of LLMs.☆90Jan 29, 2024Updated 2 years ago
- [ICLR'24] MetaTool Benchmark for Large Language Models: Deciding Whether to Use Tools and Which to Use☆121Mar 21, 2024Updated 2 years ago
- [Official Codes] Synthetic Test Collections for Retrieval Evaluation (SIGIR 2024)☆12Jul 19, 2024Updated 2 years ago
- [ACL2024] Planning, Creation, Usage: Benchmarking LLMs for Comprehensive Tool Utilization in Real-World Complex Scenarios☆71Aug 5, 2025Updated last year
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- A new tool learning benchmark aiming at well-balanced stability and reality, based on ToolBench.☆243Apr 15, 2025Updated last year
- This repository contains the ToolSelect dataset which was used to fine-tune Llama-2 70B for tool selection.☆23Mar 11, 2024Updated 2 years ago
- Code for SIGIR-2021 full paper: Initiative-Aware Self-Supervised Learning for Knowledge-Grounded Conversations☆11Aug 3, 2021Updated 5 years ago
- ☆652Jun 2, 2026Updated 5 months ago
- Code and data for the paper "Can Large Language Models Understand Real-World Complex Instructions?"(AAAI2024)☆51Apr 19, 2024Updated 2 years ago
- Loop Nest - Linear algebra compiler and code generator.☆20Oct 22, 2022Updated 4 years ago
- ☆294Sep 11, 2026Updated 2 months ago
- Code and data for "Lumos: Learning Agents with Unified Data, Modular Design, and Open-Source LLMs"☆479Mar 19, 2024Updated 2 years ago
- The source code of "Merging Experts into One: Improving Computational Efficiency of Mixture of Experts (EMNLP 2023)":☆49Oct 2, 2026Updated last month
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- Dateset Reset Policy Optimization☆30Apr 12, 2024Updated 2 years ago
- Open-source repository for the OOPSLA'24 paper "CYCLE: Learning to Self-Refine Code Generation"☆10Mar 8, 2024Updated 2 years ago
- ☆13Nov 10, 2026Updated last week
- The implementation for CIKM 2024: Towards Completeness-Oriented Tool Retrieval for Large Language Models.☆27Nov 6, 2024Updated 2 years ago
- Open-source Large Language Models are Strong Zero-shot Query Likelihood Models for Document Ranking☆17Oct 26, 2023Updated 3 years ago
- ☆23Jul 27, 2023Updated 3 years ago
- ☆18Jun 24, 2025Updated last year
- ACL2015_code_Gated Recursive Neural Network for Chinese Word Segmentation☆28Dec 9, 2015Updated 10 years ago
- ☆194Jun 2, 2026Updated 5 months ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- ☆21Updated this week
- ☆10Mar 3, 2021Updated 5 years ago
- Testing the accelerate megatron integration☆10Nov 8, 2022Updated 4 years ago
- Official implementation of our paper "Benchmarking Language Model Creativity: A Case Study on Code Generation"☆14May 16, 2025Updated last year
- ToolQA, a new dataset to evaluate the capabilities of LLMs in answering challenging questions with external tools. It offers two levels …☆288Aug 19, 2023Updated 3 years ago
- A Data Source for Reasoning Embodied Agents☆20Sep 18, 2023Updated 3 years ago
- AbstainQA, ACL 2024☆30Feb 4, 2026Updated 9 months ago
Are these results useful?