Official eval scripts for JobBench
☆64Oct 6, 2026Updated 2 weeks ago
Alternatives and similar repositories for job-bench-eval
Users that are interested in job-bench-eval are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Benchmark self-evolving Agent upon realistic large-scale file workspaces☆81Aug 27, 2026Updated last month
- A benchmark for evaluating AI agents on realistic business workflows☆352Aug 4, 2026Updated 2 months ago
- (ICLR 2025) AgentRefine: Enhancing Agent Generalization through Refinement Tuning☆22Nov 22, 2025Updated 11 months ago
- ☆18Jun 3, 2025Updated last year
- Your efficient and accurate answer verification system for RL training.☆41Jun 23, 2025Updated last year
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- ☆25Jun 18, 2026Updated 4 months ago
- FrontierSWE is an ultra long-horizon coding agent benchmark that tests implementation, performance eng and ML research☆235Updated this week
- ☆60Sep 25, 2026Updated 3 weeks ago
- Reproducing R1 for Code with Reliable Rewards☆13Apr 9, 2025Updated last year
- EdgeBench: Unveiling scaling laws of learning from real-world environments☆468Sep 20, 2026Updated last month
- Toolathlon-Gym for testing AI agents real-world tool-use capabilities across diverse MCP servers.☆151Oct 1, 2026Updated 3 weeks ago
- [ICLR'26] Building a Foundational Guardrail for General Agentic Systems via Synthetic Data☆49Oct 26, 2025Updated 11 months ago
- MemoHarness: Agent Harnesses That Learn from Experience☆111Sep 26, 2026Updated 3 weeks ago
- ☆11Jan 3, 2024Updated 2 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Measuring how well CLI agents like Claude Code or Codex CLI can post-train base LLMs on a single H100 GPU in 10 hours☆602Oct 2, 2026Updated 3 weeks ago
- ☆415Updated this week
- A benchmark for scientific research agents, evaluating end-to-end paper reproduction across 12 research areas.☆40Oct 8, 2026Updated 2 weeks ago
- you.com's framework for evaluating deep research systems.☆77May 15, 2025Updated last year
- Python package for serving a local search engine. One command to download and serve a datastore---that's it 😎.☆26Jun 6, 2025Updated last year
- Official Repository for "Training Versatile Coding Agents in Synthetic Environments"☆22Jan 11, 2026Updated 9 months ago
- FORTSearcher: Synthesizing Hard-to-Shortcut Search Tasks for Deep Search Agents☆29Jun 11, 2026Updated 4 months ago
- [NeurIPS 2026] $OneMillion-Bench: How Far are Language Agents from Human Experts?☆55Updated this week
- Official repo of Toucan: Synthesizing 1.5M Tool-Agentic Data from Real-World MCP Environments☆270Dec 16, 2025Updated 10 months ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- ☆16Jul 11, 2023Updated 3 years ago
- IKEA: Reinforced Internal-External Knowledge Synergistic Reasoning for Efficient Adaptive Search Agent☆71May 13, 2025Updated last year
- 🍼 Official implementation of Dynamic Data Mixing Maximizes Instruction Tuning for Mixture-of-Experts☆40Sep 29, 2024Updated 2 years ago
- [ICLR 2026] The Tool Decathlon: Benchmarking Language Agents for Diverse, Realistic, and Long-Horizon Task Execution☆504Aug 18, 2026Updated 2 months ago
- A benchmark to evaluate search-augmented LLMs☆17Aug 28, 2025Updated last year
- 🦞 ClawMark: A Living-World Benchmark for Multi-Day, Multimodal Coworker Agents☆123May 28, 2026Updated 4 months ago
- Climbing to the Search Frontier.☆104Sep 28, 2026Updated 3 weeks ago
- Including 12+ cutting-edge agent systems across multiple research directions☆37Nov 10, 2025Updated 11 months ago
- Benchmarking Open-Ended Inference Optimization by AI Agents☆47Jul 6, 2026Updated 3 months ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- HierSearch: A Hierarchical Enterprise Deep Search Framework Integrating Local and Web Searches☆41Oct 9, 2025Updated last year
- A benchmark for evaluating LLMs on open-ended CS problems. Exploring the Next Frontier of Computer Science.☆335Updated this week
- Scaling Agentic Environments Automatically.☆70Mar 26, 2026Updated 6 months ago
- This repository contains the code and released models for the paper Segmenting Text and Learning Their Rewards for Improved RLHF in Langu…☆18Jan 8, 2025Updated last year
- [ICLR2025 Spotlight] Agent Trajectory Synthesis via Guiding Replay with Web Tutorials☆60Feb 21, 2025Updated last year
- ☆31Jul 24, 2026Updated 2 months ago
- Official Implementation of "Probing Language Models for Pre-training Data Detection"☆19Dec 4, 2024Updated last year