[NeurIPS 2024 D&B] GTA: A Benchmark for General Tool Agents & [arXiv 2026] GTA-2
☆147Apr 20, 2026Updated 3 months ago
Alternatives and similar repositories for GTA
Users that are interested in GTA are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- (ACL 2025) Divide-Then-Aggregate: An Efficient Tool Learning Method via Parallel Tool Invocation☆12May 21, 2025Updated last year
- [COLING 2025] NesTools: A Dataset for Evaluating Nested Tool Learning Abilities of Large Language Models☆18Jan 18, 2025Updated last year
- Codebase for paper ToolVQA: A Dataset for Multi-step Reasoning VQA with External Tools☆31Nov 3, 2025Updated 8 months ago
- A new tool learning benchmark aiming at well-balanced stability and reality, based on ToolBench.☆237Apr 15, 2025Updated last year
- This is the repository for the Tool Learning survey.☆485Aug 9, 2025Updated 11 months ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- ☆33Sep 27, 2024Updated last year
- Benchmark Test-Time Scaling of General LLM Agents☆20Apr 14, 2026Updated 3 months ago
- Code and implementations for the ACL 2025 paper "AgentGym: Evolving Large Language Model-based Agents across Diverse Environments" by Zhi…☆816May 30, 2026Updated last month
- [ACL2024] Planning, Creation, Usage: Benchmarking LLMs for Comprehensive Tool Utilization in Real-World Complex Scenarios☆71Aug 5, 2025Updated 11 months ago
- [ICLR'24] MetaTool Benchmark for Large Language Models: Deciding Whether to Use Tools and Which to Use☆115Mar 21, 2024Updated 2 years ago
- ☆36May 24, 2025Updated last year
- 🌍 AppWorld: A Controllable World of Apps and People for Benchmarking Function Calling and Interactive Coding Agent, ACL'24 Best Resource…☆468Feb 17, 2026Updated 5 months ago
- Code and Data for Tau-Bench☆1,342Mar 18, 2026Updated 4 months ago
- ☆248Aug 14, 2024Updated last year
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- ☆33Jul 11, 2024Updated 2 years ago
- An Analytical Evaluation Board of Multi-turn LLM Agents [NeurIPS 2024 Oral]☆427May 20, 2024Updated 2 years ago
- [ICLR 2025] Benchmarking Agentic Workflow Generation☆155Feb 19, 2025Updated last year
- A Framework for Decoupling and Assessing the Capabilities of VLMs☆44Jun 28, 2024Updated 2 years ago
- [ICLR 2025] Linear Combination of Saved Checkpoints Makes Consistency and Diffusion Models Better☆16Feb 15, 2025Updated last year
- [ICML'24 Spotlight] "TravelPlanner: A Benchmark for Real-World Planning with Language Agents"☆529May 24, 2026Updated last month
- Companion code to https://arxiv.org/abs/2402.15491☆22Sep 18, 2025Updated 10 months ago
- [ACL 2024 Findings] MathBench: A Comprehensive Multi-Level Difficulty Mathematics Evaluation Dataset☆115May 22, 2025Updated last year
- [ICCV 2023] Going Beyond Nouns With Vision & Language Models Using Synthetic Data☆13Sep 30, 2023Updated 2 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- ☆28Jun 2, 2026Updated last month
- The evaluation benchmark on MCP servers☆250Sep 3, 2025Updated 10 months ago
- Companion code to https://arxiv.org/abs/2409.03797v2☆19Sep 18, 2025Updated 10 months ago
- ☆60Feb 19, 2025Updated last year
- [NeurIPS 2022] 🛒WebShop: Towards Scalable Real-World Web Interaction with Grounded Language Agents☆572Sep 6, 2024Updated last year
- [ECCV’24] Official repository for "BEAF: Observing Before-AFter Changes to Evaluate Hallucination in Vision-language Models"☆22Mar 26, 2025Updated last year
- code for kdd feasibiiity☆12Jul 17, 2023Updated 3 years ago
- Both Text and Images Leaked! A Systematic Analysis of Data Contamination in Multimodal LLM | EMNLP 2025 Findings☆18Oct 17, 2025Updated 9 months ago
- [ICLR'24 spotlight] Tool-Augmented Reward Modeling☆54Jun 6, 2025Updated last year
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- A unified framework for vision-language environments with Gymnasium-compatible interface☆35Mar 17, 2026Updated 4 months ago
- A high-throughput and memory-efficient inference and serving engine for LLMs☆17Jun 3, 2024Updated 2 years ago
- [NAACL 2024] Making Language Models Better Tool Learners with Execution Feedback☆43Mar 14, 2024Updated 2 years ago
- ☆513Oct 16, 2025Updated 9 months ago
- A Comprehensive Benchmark to Evaluate LLMs as Agents (ICLR'24)☆3,597Feb 8, 2026Updated 5 months ago
- Building Open LLM Web Agents with Self-Evolving Online Curriculum RL☆535Jun 6, 2025Updated last year
- [ICLR 2026 Oral] Official Implementation of the paper "MetaEmbed: Scaling Multimodal Retrieval at Test-Time with Flexible Late Interactio…☆18Jul 2, 2026Updated 3 weeks ago