The official code repository for the paper "CostBench: Evaluating Multi-Turn Cost-Optimal Planning and Adaptation in Dynamic Environments for LLM Tool-Use Agents"
☆35Jun 14, 2026Updated 4 months ago
Alternatives and similar repositories for CostBench
Users that are interested in CostBench are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- The official codebase for our paper "NOVA: NOise-aware Verbal Confidence CAlibration for Robust Large Language Models in RAG Systems"☆23Aug 26, 2026Updated 2 months ago
- Official Repository for our paper: PlanBench-XL: Evaluating Long-Horizon Planning of LLM Tool-Use Agents in Large-Scale Tool Ecosystems☆42Sep 19, 2026Updated last month
- Official Repository for our paper: AdaPlanBench: Evaluating Adaptive Planning in Large Language Model Agents under World and User Constra…☆28Sep 19, 2026Updated last month
- [NeurIPS 2026] Towards On-Policy Data Evolution for Visual-Native Multimodal Deep Search Agents☆34May 13, 2026Updated 5 months ago
- [ICLR 2026] Lean4Physics: Comprehensive Reasoning Framework for College-level Physics in Lean4☆20Mar 20, 2026Updated 7 months ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Codes for the EMNLP2021 paper: Benchmarking Commonsense Knowledge Base Population (https://aclanthology.org/2021.emnlp-main.705.pdf). An …☆26Feb 14, 2024Updated 2 years ago
- This is the official implementation for MA-LoT.☆21Aug 4, 2025Updated last year
- Benchmarking multimodal agents on realistic, ultra-challenging visual scenarios requiring long-horizon hybrid tool use.☆76Mar 10, 2026Updated 7 months ago
- (ICML'26 Spotlight) ClinTutor-R1: Advancing Scalable and Robust One-to-Many Alignment in Clinical Socratic Education☆14May 2, 2026Updated 6 months ago
- MATP-BENCH: Can MLLM Be a Good Automated Theorem Prover for Multimodal Problems?☆11Jun 29, 2025Updated last year
- Resources and paper list for 'Scaling Environments for Agents'. This repository accompanies our survey on how environments contribute to …☆75Jan 28, 2026Updated 9 months ago
- ☆11Oct 24, 2025Updated last year
- A curated list of papers and technical reports related to Multi-Teacher On-Policy Distillation (MOPD).☆17Updated this week
- [NeurIPS 2026] Code and data for paper "Model-Adaptive Tool Necessity Reveals the Knowing-Doing Gap in LLM Tool Use"☆19Sep 24, 2026Updated last month
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- ☆12May 15, 2025Updated last year
- Rubric Reward Model to reduce “miracle steps” and unfaithful CoT in math; SFT+PPO training and verified evaluation.☆11Jan 7, 2026Updated 10 months ago
- Public code repo for EMNLP 2024 Findings paper "MACAROON: Training Vision-Language Models To Be Your Engaged Partners"☆14Sep 28, 2024Updated 2 years ago
- [Findings of EMNLP 2026] Official implementation of SkillRevise: trace-conditioned revision of LLM-authored agent skills.☆57Sep 5, 2026Updated 2 months ago
- Implementation for ACL 2023 Findings paper "Unsupervised Dense Retrieval with Relevance-Aware Contrastive Pre-Training"☆11May 19, 2024Updated 2 years ago
- ☆11Oct 2, 2024Updated 2 years ago
- ☆48Aug 12, 2026Updated 2 months ago
- Code for the ACL2023 paper: CAT: A Contextualized Conceptualization and Instantiation Framework for Commonsense Reasoning (https://aclant…☆11May 9, 2023Updated 3 years ago
- Diagnostic Framework for LLMs and MLLMs☆39Mar 2, 2026Updated 8 months ago
- End-to-end encrypted cloud storage - Proton Drive • AdSpecial offer: 40% Off Yearly / 80% Off First Month. Protect your most important files, photos, and documents from prying eyes.
- Official Implementation of "Simulating Environments with Reasoning Models for Agent Training"☆70Feb 18, 2026Updated 8 months ago
- Official repo for [ACL 2026] "A Holistic Benchmark for High-Fidelity Image-to-Code Generation"☆17Apr 26, 2026Updated 6 months ago
- Agent World Model in the Wild: Computer-Use Agent Environment Synthesis☆87Oct 21, 2026Updated 2 weeks ago
- ☆10Mar 3, 2025Updated last year
- [ICML 2026] XSkill: Continual Learning from Experience and Skills in Multimodal Agents☆276May 13, 2026Updated 5 months ago
- [NeurIPS'22] Trap and Replace: Defending Backdoor Attacks by Trapping Them into an Easy-to-Replace Subnetwork. Haotao Wang, Junyuan Hong,…☆15Nov 27, 2023Updated 2 years ago
- Official implementation of paper OneClip-RAG☆14Jul 14, 2026Updated 3 months ago
- This repository contains the official implementation of ExeSQL.☆12Dec 21, 2025Updated 10 months ago
- Code and data for the paper: IntentionQA: A Benchmark for Evaluating Purchase Intention Comprehension Abilities of Large Language Models …☆12Apr 27, 2024Updated 2 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- This is the repository for paper EscapeBench: Pushing Language Models to Think Outside the Box☆18Dec 19, 2024Updated last year
- All-in-One Safety Evaluation Framwork☆56Oct 30, 2026Updated last week
- A fast and neat API for Conceptualization of Probase☆17Oct 28, 2019Updated 7 years ago
- [ACL 2024] "Understanding and Patching Compositional Reasoning in LLMs"☆14Aug 8, 2026Updated 2 months ago
- Official Implementation of Multi-Masked Aggregators for Graph Neural Networks in Pytorch and PyTorch Geometric☆11Mar 24, 2023Updated 3 years ago
- [ACL 2026 Oral] From Word to World: Can Large Language Models be Implicit Text-based World Models?☆84Apr 13, 2026Updated 6 months ago
- 吃点啥☆18Jun 30, 2023Updated 3 years ago