☆311Jul 1, 2026Updated last month
Alternatives and similar repositories for hal-harness
Users that are interested in hal-harness are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆78Nov 23, 2025Updated 8 months ago
- [ICLR'25] ScienceAgentBench: Toward Rigorous Assessment of Language Agents for Data-Driven Scientific Discovery☆153Jul 18, 2026Updated 3 weeks ago
- Meta Agents Research Environments is a comprehensive platform designed to evaluate AI agents in dynamic, realistic scenarios. Unlike stat…☆539Updated this week
- Inspect: A framework for large language model evaluations☆2,517Updated this week
- Inspect Flow is a workflow stack built on Inspect AI that enables research organisations to run AI evaluations at scale.☆17Updated this week
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- SkyRL: A Modular Full-stack RL Library for LLMs☆2,138Updated this week
- 🌍 AppWorld: A Controllable World of Apps and People for Benchmarking Function Calling and Interactive Coding Agent, ACL'24 Best Resource…☆479Feb 17, 2026Updated 5 months ago
- Collection of evals for Inspect AI☆617Updated this week
- An agent benchmark with tasks in a simulated software company.☆758Nov 17, 2025Updated 8 months ago
- ☆30Mar 11, 2025Updated last year
- ☆187Jul 14, 2026Updated 3 weeks ago
- Code for 'Answer Matching Outperforms Multiple Choice for Language Model Evaluation' paper☆19Jul 4, 2025Updated last year
- Code for T-MARS data filtering☆35Aug 23, 2023Updated 2 years ago
- ☆39Jan 8, 2025Updated last year
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Framework for evaluating and improving agents☆4,076Updated this week
- Code and Data for Tau-Bench☆1,370Mar 18, 2026Updated 4 months ago
- MLE-bench is a benchmark for measuring how well AI agents perform at machine learning engineering☆1,681Apr 24, 2026Updated 3 months ago
- OpenAI Frontier Evals☆1,276Apr 21, 2026Updated 3 months ago
- An Ultra-Long Output Reinforcement Learning Approach☆23Jul 31, 2025Updated last year
- Code for Paper: Training Software Engineering Agents and Verifiers with SWE-Gym [ICML 2025]☆720Jul 29, 2025Updated last year
- ☆28Jun 2, 2026Updated 2 months ago
- Code for the paper "Coding Agents with Multimodal Browsing are Generalist Problem Solvers"☆103Oct 27, 2025Updated 9 months ago
- τ-Bench: A Benchmark for Tool-Agent-User Interaction in Real-World Domains☆1,770Updated this week
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- Code repo for "WebArena: A Realistic Web Environment for Building Autonomous Agents"☆1,575Nov 26, 2025Updated 8 months ago
- ☆122Sep 25, 2024Updated last year
- [NeurIPS'25] Official codebase for "SWE-RL: Advancing LLM Reasoning via Reinforcement Learning on Open Software Evolution"☆715Mar 16, 2025Updated last year
- BenchBench is a Python package to evaluate multi-task benchmarks.☆23Oct 12, 2025Updated 9 months ago
- ☆17Jan 27, 2026Updated 6 months ago
- A Sober Look at Language Model Reasoning☆92Nov 18, 2025Updated 8 months ago
- ☆57Mar 18, 2026Updated 4 months ago
- ☆126Aug 1, 2026Updated last week
- Trajectory Recording and Capture Environments☆19Jan 24, 2026Updated 6 months ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Agentic RL Training at Scale☆1,878Updated this week
- SWE-bench: Can Language Models Resolve Real-world Github Issues?☆5,607Updated this week
- A benchmark for LLMs on complicated tasks in the terminal☆2,534Jul 11, 2026Updated last month
- slime is an LLM post-training framework for RL Scaling.☆7,832Updated this week
- Functional Benchmarks and the Reasoning Gap☆90Jul 23, 2026Updated 2 weeks ago
- Reproducible, flexible LLM evaluations☆391Mar 24, 2026Updated 4 months ago
- Code and data for Koo et al's ACL 2024 paper "Benchmarking Cognitive Biases in Large Language Models as Evaluators"☆23Feb 16, 2024Updated 2 years ago