☆308Jul 1, 2026Updated 2 weeks ago
Alternatives and similar repositories for hal-harness
Users that are interested in hal-harness are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆77Nov 23, 2025Updated 7 months ago
- [ICLR'25] ScienceAgentBench: Toward Rigorous Assessment of Language Agents for Data-Driven Scientific Discovery☆149Updated this week
- Meta Agents Research Environments is a comprehensive platform designed to evaluate AI agents in dynamic, realistic scenarios. Unlike stat…☆528Jun 20, 2026Updated last month
- Inspect: A framework for large language model evaluations☆2,386Updated this week
- Inspect Flow is a workflow stack built on Inspect AI that enables research organisations to run AI evaluations at scale.☆16Updated this week
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- SkyRL: A Modular Full-stack RL Library for LLMs☆2,085Updated this week
- 🌍 AppWorld: A Controllable World of Apps and People for Benchmarking Function Calling and Interactive Coding Agent, ACL'24 Best Resource…☆465Feb 17, 2026Updated 5 months ago
- Collection of evals for Inspect AI☆592Updated this week
- An agent benchmark with tasks in a simulated software company.☆748Nov 17, 2025Updated 8 months ago
- ☆30Mar 11, 2025Updated last year
- ☆187Jul 14, 2026Updated last week
- Code for 'Answer Matching Outperforms Multiple Choice for Language Model Evaluation' paper☆18Jul 4, 2025Updated last year
- Code for T-MARS data filtering☆35Aug 23, 2023Updated 2 years ago
- ☆38Jan 8, 2025Updated last year
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Framework for evaluating and improving agents☆3,348Updated this week
- Code and Data for Tau-Bench☆1,337Mar 18, 2026Updated 4 months ago
- MLE-bench is a benchmark for measuring how well AI agents perform at machine learning engineering☆1,647Apr 24, 2026Updated 2 months ago
- OpenAI Frontier Evals☆1,261Apr 21, 2026Updated 3 months ago
- An Ultra-Long Output Reinforcement Learning Approach☆23Jul 31, 2025Updated 11 months ago
- Code for Paper: Training Software Engineering Agents and Verifiers with SWE-Gym [ICML 2025]☆708Jul 29, 2025Updated 11 months ago
- ☆28Jun 2, 2026Updated last month
- Code for the paper "Coding Agents with Multimodal Browsing are Generalist Problem Solvers"☆103Oct 27, 2025Updated 8 months ago
- τ-Bench: A Benchmark for Tool-Agent-User Interaction in Real-World Domains☆1,631Updated this week
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- Code repo for "WebArena: A Realistic Web Environment for Building Autonomous Agents"☆1,550Nov 26, 2025Updated 7 months ago
- ☆117Sep 25, 2024Updated last year
- BenchBench is a Python package to evaluate multi-task benchmarks.☆23Oct 12, 2025Updated 9 months ago
- A Sober Look at Language Model Reasoning☆92Nov 18, 2025Updated 8 months ago
- ☆57Mar 18, 2026Updated 4 months ago
- ☆119Jun 17, 2026Updated last month
- Trajectory Recording and Capture Environments☆19Jan 24, 2026Updated 5 months ago
- Agentic RL Training at Scale☆1,702Updated this week
- SWE-bench: Can Language Models Resolve Real-world Github Issues?☆5,467Apr 1, 2026Updated 3 months ago
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- A benchmark for LLMs on complicated tasks in the terminal☆2,472Jul 11, 2026Updated last week
- [NeurIPS'25] Official codebase for "SWE-RL: Advancing LLM Reasoning via Reinforcement Learning on Open Software Evolution"☆712Mar 16, 2025Updated last year
- slime is an LLM post-training framework for RL Scaling.☆7,569Updated this week
- Functional Benchmarks and the Reasoning Gap☆90Oct 1, 2024Updated last year
- Reproducible, flexible LLM evaluations☆388Mar 24, 2026Updated 3 months ago
- Code and data for Koo et al's ACL 2024 paper "Benchmarking Cognitive Biases in Large Language Models as Evaluators"☆23Feb 16, 2024Updated 2 years ago
- Measuring how well CLI agents like Claude Code or Codex CLI can post-train base LLMs on a single H100 GPU in 10 hours☆463Updated this week