MTU-Bench: A Multi-granularity Tool-Use Benchmark for Large Language Models
☆60Jul 24, 2025Updated 11 months ago
Alternatives and similar repositories for MTU-Bench
Users that are interested in MTU-Bench are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Modified LLaVA framework for MOSS2, and makes MOSS2 a multimodal model.☆13Sep 19, 2024Updated last year
- VehicleWorld is the first comprehensive multi-device environment for intelligent vehicle interaction that accurately models the complex, …☆24Sep 16, 2025Updated 9 months ago
- ☆14Dec 18, 2024Updated last year
- ☆13Mar 5, 2025Updated last year
- ☆86May 2, 2026Updated 2 months ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- ☆47Dec 12, 2024Updated last year
- Official repository for the paper "COAST: Enhancing the Code Debugging Ability of LLMs through Communicative Agent Based Data Synthesis".☆18Feb 19, 2025Updated last year
- Official Implementation of "ToolSafe: Enhancing Tool Invocation Safety of LLM-based Agents via Proactive Step-level Guardrail and Feedbac…☆69Mar 25, 2026Updated 3 months ago
- [COLING 2025] ToolEyes: Fine-Grained Evaluation for Tool Learning Capabilities of Large Language Models in Real-world Scenarios☆74May 13, 2025Updated last year
- 用预训练BERT实现序列标注模型。☆14Sep 29, 2020Updated 5 years ago
- ☆32Jun 12, 2024Updated 2 years ago
- From Accuracy to Robustness: A Study of Rule- and Model-based Verifiers in Mathematical Reasoning.☆24Oct 7, 2025Updated 9 months ago
- ☆60May 21, 2025Updated last year
- HelloBench: Evaluating Long Text Generation Capabilities of Large Language Models☆59Nov 26, 2024Updated last year
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- RAG-RewardBench: Benchmarking Reward Models in Retrieval Augmented Generation for Preference Alignment☆18Dec 19, 2024Updated last year
- This repository contains the code for the paper “Neuro-Symbolic Query Compiler”, accepted to the Findings of ACL 2025.☆17Oct 20, 2025Updated 8 months ago
- SWE-Debate: Competitive Multi-Agent Debate for Software Issue Resolution [ICSE 2026]☆33Nov 11, 2025Updated 7 months ago
- FamilyTool benchmark☆14Sep 10, 2025Updated 9 months ago
- Code and Data for Tau-Bench☆1,302Mar 18, 2026Updated 3 months ago
- Code repository for the paper "The Inherent Limits of Pretrained LLMs: The Unexpected Convergence of Instruction Tuning and In-Context Le…☆14Jan 16, 2025Updated last year
- ☆17Jul 9, 2021Updated 5 years ago
- This is the repository for the Tool Learning survey.☆485Aug 9, 2025Updated 11 months ago
- OneVOS: Unifying Video Object Segmentation with All-in-One Transformer Framework☆12Feb 27, 2025Updated last year
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Code and data for paper "Exploring Hallucination of Large Multimodal Models in Video Understanding: Benchmark, Analysis and Mitigation".☆25Oct 22, 2025Updated 8 months ago
- ☆187Oct 29, 2025Updated 8 months ago
- A Python implementation of the Sequential Thinking MCP server using the official Model Context Protocol (MCP) Python SDK. This server fac…☆25Jun 1, 2025Updated last year
- [ACL 2024 Findings] The official repo for "ConceptMath: A Bilingual Concept-wise Benchmark for Measuring Mathematical Reasoning of Large …☆26May 29, 2024Updated 2 years ago
- The official implementation of the paper "Self-Updatable Large Language Models by Integrating Context into Model Parameters"☆15May 18, 2025Updated last year
- A new tool learning benchmark aiming at well-balanced stability and reality, based on ToolBench.☆236Apr 15, 2025Updated last year
- Official repository for our paper "FullStack Bench: Evaluating LLMs as Full Stack Coders"☆121May 7, 2025Updated last year
- [AAAI 2024] History Matters: Temporal Knowledge Editing in Large Language Model☆13Dec 17, 2023Updated 2 years ago
- A scalable automated alignment method for large language models. Resources for "Aligning Large Language Models via Self-Steering Optimiza…☆20Nov 21, 2024Updated last year
- Deploy open-source AI quickly and easily - Special Bonus Offer • AdRunpod Hub is built for open source. One-click deployment and autoscaling endpoints without provisioning your own infrastructure.
- UnifiedToolHub is a comprehensive project supporting LLM-based tool use, designed to unify various tool-use dataset formats and provide t…☆22Jul 23, 2025Updated 11 months ago
- Official implementation of "Disentangled Knowledge Transfer for OOD Intent Discovery with Unified Contrastive Learning", ACL2022 main con…☆14Jul 23, 2022Updated 3 years ago
- ☆17Apr 9, 2025Updated last year
- ☆12Dec 19, 2023Updated 2 years ago
- [ACL 2024] MT-Bench-101: A Fine-Grained Benchmark for Evaluating Large Language Models in Multi-Turn Dialogues☆152Jul 24, 2024Updated last year
- ☆47Jun 11, 2025Updated last year
- [ICML'26] Scaling Long-Horizon LLM Agent via Context-Folding☆167May 18, 2026Updated last month