[ACL2026 Main] AgencyBench: Benchmarking the Frontiers of Autonomous Agents in 1M-Token Real-World Contexts
☆101Jan 23, 2026Updated 8 months ago
Alternatives and similar repositories for AgencyBench
Users that are interested in AgencyBench are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- daVinci-Agency: Unlocking Long-Horizon Agency Data-Efficiently☆38Feb 4, 2026Updated 7 months ago
- ☆52May 4, 2026Updated 4 months ago
- [ICLR 2026]InnovatorBench: Evaluating Agents' Ability to Conduct Innovative LLM Research☆17Feb 3, 2026Updated 7 months ago
- ☆15May 27, 2025Updated last year
- [ACL 2026] This is the repo of Data Darwinism.☆27Apr 16, 2026Updated 5 months ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- LIMI: Less is More for Agency☆162Oct 14, 2025Updated 11 months ago
- [ICML 2026 Oral] Agent-native Mid-training for Software Engineering☆80Jun 7, 2026Updated 3 months ago
- BeHonest: Benchmarking Honesty in Large Language Models☆36Aug 15, 2024Updated 2 years ago
- [NeurIPS 2024] OlympicArena: Benchmarking Multi-discipline Cognitive Reasoning for Superintelligent AI☆106Mar 6, 2025Updated last year
- DatasetResearch: Benchmarking Agent Systems for Demand-Driven Dataset Discovery☆23Sep 24, 2025Updated last year
- [ICML 2026] What Does Vision Tool-Use Reinforcement Learning Really Learn? Disentangling Tool-Induced and Intrinsic Effects for Crop-and-…☆23May 15, 2026Updated 4 months ago
- [ACL 2026 SAC Highlight Award] Can We Predict Before Executing Machine Learning Agents?☆24Jul 7, 2026Updated 2 months ago
- ICLR 2026: Agent-X Evaluating Deep Multimodal Reasoning in Vision-Centric Agentic Tasks☆46Apr 28, 2026Updated 4 months ago
- [NeurIPS 2026] When Reasoning Meets Its Laws☆38Jan 2, 2026Updated 8 months ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- [ACL 2025] DICE-BENCH: Evaluating the Tool-Use Capabilities of Large Language Models in Multi-Round, Multi-Party Dialogues☆26Jul 10, 2025Updated last year
- ☆13Jul 14, 2024Updated 2 years ago
- ResearcherBench: Evaluating Deep AI Research Systems on the Frontiers of Scientific Inquiry☆54Jul 21, 2026Updated 2 months ago
- VitaBench: Benchmarking LLM Agents with Versatile Interactive Tasks in Real-world Applications☆23Oct 17, 2025Updated 11 months ago
- Measuring how well CLI agents like Claude Code or Codex CLI can post-train base LLMs on a single H100 GPU in 10 hours☆570Updated this week
- Scalable Meta-Evaluation of LLMs as Evaluators☆43Feb 15, 2024Updated 2 years ago
- All-in-one benchmarking platform for evaluating LLM.☆15Nov 12, 2025Updated 10 months ago
- LongCLI-Bench's official repository☆48Aug 14, 2026Updated last month
- Safety-J: Evaluating Safety with Critique☆16Jul 28, 2024Updated 2 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Reproducible and flexible LLM evaluations for scientific reasoning.☆32Jul 23, 2025Updated last year
- Code repository for the ICML 2026 Oral paper "Characterizing, Evaluating, and Optimizing Complex Reasoning".☆20Jun 21, 2026Updated 3 months ago
- Explore what LLMs are really leanring over SFT☆28Mar 30, 2024Updated 2 years ago
- ☆25Jul 10, 2026Updated 2 months ago
- Benchmarking Benchmark Leakage in Large Language Models☆61May 20, 2024Updated 2 years ago
- [IJCAI'19] Code for "Self-attentive Biaffine Dependency Parsing"☆16Jun 13, 2019Updated 7 years ago
- ☆211Mar 16, 2026Updated 6 months ago
- This repository contains the code and data for the paper "VisOnlyQA: Large Vision Language Models Still Struggle with Visual Perception o…☆29Jul 9, 2025Updated last year
- [ICML'26] Scaling Long-Horizon LLM Agent via Context-Folding☆191May 18, 2026Updated 4 months ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- ☆156Mar 31, 2026Updated 5 months ago
- Code for our TKDE paper "Understanding WeChat User Preferences and “Wow” Diffusion"☆20Aug 29, 2024Updated 2 years ago
- Build coherent and visually polished multimodal webpages with hierarchical planning, AIGC tools, and iterative reflection.☆18May 17, 2026Updated 4 months ago
- Official implementation for 'Extending LLMs’ Context Window with 100 Samples'☆83Jan 18, 2024Updated 2 years ago
- [EMNLP 2026] Aligning Agentic World Models via Knowledgeable Experience Learning☆41May 15, 2026Updated 4 months ago
- LLM evaluation.☆16Nov 7, 2023Updated 2 years ago
- A challenging aggregation benchmark for long-context models☆55Feb 22, 2026Updated 7 months ago