☆308Jul 1, 2026Updated 3 months ago
Alternatives and similar repositories for hal-harness
Users that are interested in hal-harness are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆80Nov 23, 2025Updated 11 months ago
- [ICLR'25] ScienceAgentBench: Toward Rigorous Assessment of Language Agents for Data-Driven Scientific Discovery☆179Jul 18, 2026Updated 3 months ago
- Meta Agents Research Environments is a comprehensive platform designed to evaluate AI agents in dynamic, realistic scenarios. Unlike stat…☆575Sep 30, 2026Updated last month
- Inspect Flow is a workflow stack built on Inspect AI that enables research organisations to run AI evaluations at scale.☆23Updated this week
- Run FMBench simultaneously across multiple Amazon EC2 machines to benchmark an FM across multiple serving stacks simultaneously☆15Apr 11, 2025Updated last year
- End-to-end encrypted cloud storage - Proton Drive • AdSpecial offer: 40% Off Yearly / 80% Off First Month. Protect your most important files, photos, and documents from prying eyes.
- ☆200Aug 17, 2026Updated 2 months ago
- ☆30Mar 11, 2025Updated last year
- Inspect: A framework for large language model evaluations☆3,140Updated this week
- SkyRL: A Modular Full-stack RL Library for LLMs☆2,476Updated this week
- An agent benchmark with tasks in a simulated software company.☆807Nov 17, 2025Updated 11 months ago
- Code for T-MARS data filtering☆35Aug 23, 2023Updated 3 years ago
- 🌍 AppWorld: A Controllable World of Apps and People for Benchmarking Function Calling and Interactive Coding Agent, ACL'24 Best Resource…☆543Sep 4, 2026Updated last month
- Collection of evals for Inspect AI☆725Updated this week
- Code and Data for Tau-Bench☆1,484Mar 18, 2026Updated 7 months ago
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- ☆44Jan 8, 2025Updated last year
- OpenAI Frontier Evals☆1,331Oct 12, 2026Updated 2 weeks ago
- MLE-bench is a benchmark for measuring how well AI agents perform at machine learning engineering☆1,788Apr 24, 2026Updated 6 months ago
- An Ultra-Long Output Reinforcement Learning Approach☆23Jul 31, 2025Updated last year
- Code for 'Answer Matching Outperforms Multiple Choice for Language Model Evaluation' paper☆20Jul 4, 2025Updated last year
- TFT (Training from Traces) benchmark: 5 scenarios comparing TFT pipeline vs Direct Training on SGD restaurant traces☆13Sep 7, 2026Updated last month
- Code for Paper: Training Software Engineering Agents and Verifiers with SWE-Gym [ICML 2025]☆754Jul 29, 2025Updated last year
- Code repo for "WebArena: A Realistic Web Environment for Building Autonomous Agents"☆1,638Nov 26, 2025Updated 11 months ago
- ☆28Jun 2, 2026Updated 4 months ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- Code for the paper "Coding Agents with Multimodal Browsing are Generalist Problem Solvers"☆105Oct 27, 2025Updated last year
- ☆132Sep 25, 2024Updated 2 years ago
- ☆17Jan 27, 2026Updated 9 months ago
- τ-Bench: A Benchmark for Tool-Agent-User Interaction in Real-World Domains☆2,362Updated this week
- A Sober Look at Language Model Reasoning☆92Nov 18, 2025Updated 11 months ago
- [NeurIPS'25] Official codebase for "SWE-RL: Advancing LLM Reasoning via Reinforcement Learning on Open Software Evolution"☆721Mar 16, 2025Updated last year
- A Comprehensive Benchmark to Evaluate LLMs as Agents (ICLR'24)☆3,801Feb 8, 2026Updated 8 months ago
- ☆57Mar 18, 2026Updated 7 months ago
- BenchBench is a Python package to evaluate multi-task benchmarks.☆24Oct 12, 2025Updated last year
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- Framework for evaluating and improving agents☆6,619Updated this week
- "Streamable HTTP" MCP server deployed on AWS Lambda and amazon API Gateway. The server provides a tool for Amazon Bedrock spend analysis.☆17May 8, 2025Updated last year
- ☆359Jun 19, 2024Updated 2 years ago
- Trajectory Recording and Capture Environments☆19Jan 24, 2026Updated 9 months ago
- Reproducible, flexible LLM evaluations☆403Mar 24, 2026Updated 7 months ago
- [NeurIPS 2026] AgentForesight: Online Auditing for Early Failure Prediction in Multi-Agent Systems☆25May 12, 2026Updated 5 months ago
- slime is an LLM training framework for RL Scaling.☆8,762Updated this week