☆25Jun 18, 2026Updated 4 months ago
Alternatives and similar repositories for terminal-bench-challenges
Users that are interested in terminal-bench-challenges are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- A compact high-signal benchmark for evaluating frontier agents☆42Aug 3, 2026Updated 2 months ago
- A curated list of awesome Harbor ecosystem projects☆59May 29, 2026Updated 4 months ago
- Convert GitHub PRs into Harbor tasks☆89Jul 13, 2026Updated 3 months ago
- Measuring and evolving with the frontier of agent work☆952Updated this week
- Terminal-Bench-Science: Evaluating AI agents on research workflows across scientific domains☆752Updated this week
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- ☆128Apr 1, 2026Updated 6 months ago
- SWE-Serve: an agentic benchmark of 53 production inference-engineering tasks derived from merged SGLang pull requests, run with Harbor.☆19Oct 9, 2026Updated 2 weeks ago
- Benchmark harness and code for "SWE-fficiency: Can Language Models Optimize Real World Repositories on Real World Workloads?"☆27Feb 17, 2026Updated 8 months ago
- ☆13Jan 15, 2026Updated 9 months ago
- ☆16Jul 11, 2023Updated 3 years ago
- ☆28Aug 27, 2026Updated last month
- A Difficulty-Calibrated Benchmark for Building Terminal Agents☆35Feb 20, 2026Updated 8 months ago
- ☆14Aug 6, 2024Updated 2 years ago
- Official eval scripts for JobBench☆64Oct 6, 2026Updated 2 weeks ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- ☆18Sep 11, 2025Updated last year
- ☆430Apr 30, 2026Updated 5 months ago
- Trajectory Recording and Capture Environments☆19Jan 24, 2026Updated 8 months ago
- This is the repository for the paper 'DiaHalu: A Dialogue-level Hallucination Evaluation Benchmark for Large Language Models' (EMNLP2024 …☆18Apr 5, 2025Updated last year
- Library for manipulating gdb in batch mode☆21Aug 9, 2026Updated 2 months ago
- Benchmarking Open-Ended Inference Optimization by AI Agents☆47Jul 6, 2026Updated 3 months ago
- ☆76Mar 24, 2026Updated 6 months ago
- BenchPress: calibrated LLM benchmark score completion☆34Oct 4, 2026Updated 2 weeks ago
- RSI Bench is an ongoing effort to evaluate whether AI agents can develop the capabilities required to advance AI R&D.☆94Updated this week
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- Phi-Bench (Φ-Bench): 85 open-source LLM-infrastructure engineering tasks for frontier LLMs & coding agents (KFC/LH/E2E). Self-contained p…☆69Oct 13, 2026Updated last week
- Realistic examples of building evals and optimizing agents with Harbor☆249Apr 23, 2026Updated 6 months ago
- ☆13Apr 5, 2026Updated 6 months ago
- Optimal stopping package for LLM evaluations☆24Sep 13, 2026Updated last month
- ☆41Aug 21, 2026Updated 2 months ago
- Download Web-10K data by querying Bing Image Search☆10Feb 1, 2022Updated 4 years ago
- Simple WebSockets API☆10Nov 18, 2021Updated 4 years ago
- 15k open math problems, linked to their sources.☆28Jul 31, 2026Updated 2 months ago
- Agentic Research and Evaluation Suite☆117Aug 12, 2026Updated 2 months ago
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- ☆15Jul 17, 2026Updated 3 months ago
- A Python implementation of the Refinement Types Tutorial.☆10Feb 4, 2021Updated 5 years ago
- A benchmark for LLMs on complicated tasks in the terminal☆2,604Jul 11, 2026Updated 3 months ago
- Sydr benchmark applications☆17Jul 25, 2022Updated 4 years ago
- [ICLR 2025] On Evluating the Durability of Safegurads for Open-Weight LLMs☆13Jun 20, 2025Updated last year
- ☆57Sep 27, 2026Updated 3 weeks ago
- A Datasette instance for searching WebVid-10M☆15Sep 30, 2022Updated 4 years ago