☆308Jul 1, 2026Updated 4 months ago
Alternatives and similar repositories for hal-harness
Users that are interested in hal-harness are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆80Nov 23, 2025Updated 11 months ago
- [ICLR'25] ScienceAgentBench: Toward Rigorous Assessment of Language Agents for Data-Driven Scientific Discovery☆186Updated this week
- Meta Agents Research Environments is a comprehensive platform designed to evaluate AI agents in dynamic, realistic scenarios. Unlike stat…☆581Sep 30, 2026Updated last month
- Run FMBench simultaneously across multiple Amazon EC2 machines to benchmark an FM across multiple serving stacks simultaneously☆15Apr 11, 2025Updated last year
- ☆30Mar 11, 2025Updated last year
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- ☆205Aug 17, 2026Updated 3 months ago
- Inspect Flow is a workflow stack built on Inspect AI that enables research organisations to run AI evaluations at scale.☆23Updated this week
- Inspect: A framework for large language model evaluations☆3,277Updated this week
- Code for T-MARS data filtering☆35Aug 23, 2023Updated 3 years ago
- SkyRL: A Modular Full-stack RL Library for LLMs☆2,541Updated this week
- An agent benchmark with tasks in a simulated software company.☆822Nov 17, 2025Updated last year
- Code and Data for Tau-Bench☆1,513Mar 18, 2026Updated 8 months ago
- 🌍 AppWorld: A Controllable World of Apps and People for Benchmarking Function Calling and Interactive Coding Agent, ACL'24 Best Resource…☆558Updated this week
- ☆44Jan 8, 2025Updated last year
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- An Ultra-Long Output Reinforcement Learning Approach☆23Jul 31, 2025Updated last year
- Collection of evals for Inspect AI☆750Updated this week
- OpenAI Frontier Evals☆1,345Oct 12, 2026Updated last month
- MLE-bench is a benchmark for measuring how well AI agents perform at machine learning engineering☆1,802Apr 24, 2026Updated 6 months ago
- Code for 'Answer Matching Outperforms Multiple Choice for Language Model Evaluation' paper☆20Jul 4, 2025Updated last year
- TFT (Training from Traces) benchmark: 5 scenarios comparing TFT pipeline vs Direct Training on SGD restaurant traces☆13Sep 7, 2026Updated 2 months ago
- ☆28Jun 2, 2026Updated 5 months ago
- Code for the paper "Coding Agents with Multimodal Browsing are Generalist Problem Solvers"☆106Oct 27, 2025Updated last year
- Code repo for "WebArena: A Realistic Web Environment for Building Autonomous Agents"☆1,645Nov 26, 2025Updated 11 months ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Code for Paper: Training Software Engineering Agents and Verifiers with SWE-Gym [ICML 2025]☆764Nov 1, 2026Updated 2 weeks ago
- ☆17Jan 27, 2026Updated 9 months ago
- A Sober Look at Language Model Reasoning☆92Nov 18, 2025Updated last year
- [NeurIPS'25] Official codebase for "SWE-RL: Advancing LLM Reasoning via Reinforcement Learning on Open Software Evolution"☆723Mar 16, 2025Updated last year
- ☆58Mar 18, 2026Updated 8 months ago
- AI_Powered_Dev_Search_Engine☆12Mar 10, 2024Updated 2 years ago
- BenchBench is a Python package to evaluate multi-task benchmarks.☆24Oct 12, 2025Updated last year
- ☆132Sep 25, 2024Updated 2 years ago
- τ-Bench: A Benchmark for Tool-Agent-User Interaction in Real-World Domains☆2,484Nov 10, 2026Updated last week
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- A Comprehensive Benchmark to Evaluate LLMs as Agents (ICLR'24)☆3,828Feb 8, 2026Updated 9 months ago
- Trajectory Recording and Capture Environments☆19Jan 24, 2026Updated 9 months ago
- ☆11Nov 3, 2025Updated last year
- Reproducible, flexible LLM evaluations☆413Mar 24, 2026Updated 7 months ago
- Holistic Evaluation of Language Models (HELM) is an open source Python framework created by the Center for Research on Foundation Models …☆2,976Sep 1, 2026Updated 2 months ago
- Framework for evaluating and improving agents☆7,205Updated this week
- ☆360Jun 19, 2024Updated 2 years ago
Are these results useful?