[ACL2026 Main] AgencyBench: Benchmarking the Frontiers of Autonomous Agents in 1M-Token Real-World Contexts
☆93Jan 23, 2026Updated 6 months ago
Alternatives and similar repositories for AgencyBench
Users that are interested in AgencyBench are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- daVinci-Agency: Unlocking Long-Horizon Agency Data-Efficiently☆38Feb 4, 2026Updated 6 months ago
- ☆49May 4, 2026Updated 3 months ago
- [ICLR 2026]InnovatorBench: Evaluating Agents' Ability to Conduct Innovative LLM Research☆17Feb 3, 2026Updated 6 months ago
- ☆15May 27, 2025Updated last year
- [ACL 2026] This is the repo of Data Darwinism.☆26Apr 16, 2026Updated 4 months ago
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- LIMI: Less is More for Agency☆162Oct 14, 2025Updated 10 months ago
- [ICML 2026 Oral] Agent-native Mid-training for Software Engineering☆76Jun 7, 2026Updated 2 months ago
- [ACL'26 Findings] Official code for "BAPO: Boundary-Aware Policy Optimization for Reliable Agentic Search"☆31Apr 23, 2026Updated 3 months ago
- [NeurIPS 2024] OlympicArena: Benchmarking Multi-discipline Cognitive Reasoning for Superintelligent AI☆106Mar 6, 2025Updated last year
- DatasetResearch: Benchmarking Agent Systems for Demand-Driven Dataset Discovery☆23Sep 24, 2025Updated 10 months ago
- [ICML 2026] What Does Vision Tool-Use Reinforcement Learning Really Learn? Disentangling Tool-Induced and Intrinsic Effects for Crop-and-…☆23May 15, 2026Updated 3 months ago
- Can We Predict Before Executing Machine Learning Agents?☆21Jul 7, 2026Updated last month
- ICLR 2026: Agent-X Evaluating Deep Multimodal Reasoning in Vision-Centric Agentic Tasks☆43Apr 28, 2026Updated 3 months ago
- ☆37Mar 23, 2026Updated 4 months ago
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- When Reasoning Meets Its Laws☆38Jan 2, 2026Updated 7 months ago
- VitaBench: Benchmarking LLM Agents with Versatile Interactive Tasks in Real-world Applications☆23Oct 17, 2025Updated 10 months ago
- Scalable Meta-Evaluation of LLMs as Evaluators☆43Feb 15, 2024Updated 2 years ago
- A collection of survey papers and resources related to Large Language Models (LLMs).☆40Feb 6, 2024Updated 2 years ago
- All-in-one benchmarking platform for evaluating LLM.☆15Nov 12, 2025Updated 9 months ago
- Measuring how well CLI agents like Claude Code or Codex CLI can post-train base LLMs on a single H100 GPU in 10 hours☆518Updated this week
- LongCLI-Bench's official repository☆44Updated this week
- Safety-J: Evaluating Safety with Critique☆16Jul 28, 2024Updated 2 years ago
- ☆50Mar 2, 2024Updated 2 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Explore what LLMs are really leanring over SFT☆28Mar 30, 2024Updated 2 years ago
- ☆23Jul 10, 2026Updated last month
- Benchmarking Benchmark Leakage in Large Language Models☆61May 20, 2024Updated 2 years ago
- ☆207Mar 16, 2026Updated 5 months ago
- This repository contains the code and data for the paper "VisOnlyQA: Large Vision Language Models Still Struggle with Visual Perception o…☆29Jul 9, 2025Updated last year
- [ICML'26] Scaling Long-Horizon LLM Agent via Context-Folding☆182May 18, 2026Updated 2 months ago
- Build coherent and visually polished multimodal webpages with hierarchical planning, AIGC tools, and iterative reflection.☆17May 17, 2026Updated 3 months ago
- Official implementation for 'Extending LLMs’ Context Window with 100 Samples'☆83Jan 18, 2024Updated 2 years ago
- Aligning Agentic World Models via Knowledgeable Experience Learning☆39May 15, 2026Updated 3 months ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- LLM evaluation.☆16Nov 7, 2023Updated 2 years ago
- A challenging aggregation benchmark for long-context models☆52Feb 22, 2026Updated 5 months ago
- [TrustNLP@NAACL 2025] BiasEdit: Debiasing Stereotyped Language Models via Model Editing☆18Sep 30, 2025Updated 10 months ago
- A benchmark to evaluate search-augmented LLMs☆17Aug 28, 2025Updated 11 months ago
- Reasoning-based Evaluation and Ranking of Translations.☆22Jun 2, 2026Updated 2 months ago
- [ICLR2026] Laser: Learn to Reason Efficiently with Adaptive Length-based Reward Shaping☆68May 22, 2025Updated last year
- ☆84Mar 11, 2025Updated last year