[ACL2026 Main] AgencyBench: Benchmarking the Frontiers of Autonomous Agents in 1M-Token Real-World Contexts
☆105Jan 23, 2026Updated 9 months ago
Alternatives and similar repositories for AgencyBench
Users that are interested in AgencyBench are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- daVinci-Agency: Unlocking Long-Horizon Agency Data-Efficiently☆38Feb 4, 2026Updated 9 months ago
- ☆34Updated this week
- ☆12May 26, 2025Updated last year
- ☆51May 4, 2026Updated 6 months ago
- ☆15May 27, 2025Updated last year
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- ☆32Mar 15, 2026Updated 7 months ago
- [ACL 2026] This is the repo of Data Darwinism.☆27Apr 16, 2026Updated 6 months ago
- [ACL 2026 SAC Highlight Award] Can We Predict Before Executing Machine Learning Agents?☆25Jul 7, 2026Updated 4 months ago
- [ACL'26 Findings] Official code for "BAPO: Boundary-Aware Policy Optimization for Reliable Agentic Search"☆30Apr 23, 2026Updated 6 months ago
- [ICML 2026 Oral] Agent-native Mid-training for Software Engineering☆85Jun 7, 2026Updated 4 months ago
- DatasetResearch: Benchmarking Agent Systems for Demand-Driven Dataset Discovery☆23Sep 24, 2025Updated last year
- BeHonest: Benchmarking Honesty in Large Language Models☆36Aug 15, 2024Updated 2 years ago
- source code for "Instant Personalized Large Language Model Adaptation via Hypernetwork"☆14Dec 22, 2025Updated 10 months ago
- [ICML 2026] What Does Vision Tool-Use Reinforcement Learning Really Learn? Disentangling Tool-Induced and Intrinsic Effects for Crop-and-…☆23May 15, 2026Updated 5 months ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- [NeurIPS 2024] OlympicArena: Benchmarking Multi-discipline Cognitive Reasoning for Superintelligent AI☆106Mar 6, 2025Updated last year
- ☆14Aug 15, 2026Updated 2 months ago
- code and data for XL2Bench☆11Apr 9, 2024Updated 2 years ago
- A lightweight Python tracing toolkit for recording execution graphs from existing systems.☆17Jun 7, 2026Updated 4 months ago
- Reinforcement Learning 2021 in School of Data Science, USTC☆10Jan 16, 2022Updated 4 years ago
- The Walnut Plan☆11Oct 10, 2024Updated 2 years ago
- ☆10May 23, 2025Updated last year
- [NeurIPS 2026] When Reasoning Meets Its Laws☆38Jan 2, 2026Updated 10 months ago
- ☆18Oct 13, 2026Updated 3 weeks ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- ☆39Mar 23, 2026Updated 7 months ago
- [ACL 2025] DICE-BENCH: Evaluating the Tool-Use Capabilities of Large Language Models in Multi-Round, Multi-Party Dialogues☆26Jul 10, 2025Updated last year
- Evaluating Long-Horizon Agentic Software Development Across Version Upgrades — 115 tasks, 17 repos, 5 languages☆17May 19, 2026Updated 5 months ago
- [ICLR 2026] The Tool Decathlon: Benchmarking Language Agents for Diverse, Realistic, and Long-Horizon Task Execution☆513Aug 18, 2026Updated 2 months ago
- [AAAI 2025 oral] Evaluating Mathematical Reasoning Beyond Accuracy☆80Oct 9, 2025Updated last year
- ResearcherBench: Evaluating Deep AI Research Systems on the Frontiers of Scientific Inquiry☆55Jul 21, 2026Updated 3 months ago
- World Models Meet Language Models: On the Complementarity of Concrete and Abstract Reasoning☆23Aug 21, 2026Updated 2 months ago
- Repo for the OdysseyBench Benchmark for Evaluating Agent Memory on Long-horizon Productivity Workflows☆20Jun 11, 2026Updated 4 months ago
- BAGEN (Budget-Aware Agent): benchmark and training code for budget-aware LLM agents that estimate token, time, and money cost mid-task.☆19Oct 30, 2026Updated last week
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- ☆13Jul 14, 2024Updated 2 years ago
- Scalable Meta-Evaluation of LLMs as Evaluators☆43Feb 15, 2024Updated 2 years ago
- ☆13Jul 23, 2026Updated 3 months ago
- All-in-one benchmarking platform for evaluating LLM.☆16Nov 12, 2025Updated 11 months ago
- A collection of survey papers and resources related to Large Language Models (LLMs).☆40Feb 6, 2024Updated 2 years ago
- Measuring how well CLI agents like Claude Code or Codex CLI can post-train base LLMs on a single H100 GPU in 10 hours☆616Updated this week
- Acta: A Decision-Centric Runtime for Agents☆24Oct 5, 2026Updated last month