Alternatives and similar repositories for hal-harness

Users that are interested in hal-harness are comparing it to the libraries listed below

• ScalingIntelligence / Archon
  Archon provides a modular framework for combining different inference-time techniques and LMs with just a JSON config file.
  ☆173Updated 3 months ago
• UKGovernmentBEIS / inspect_evals
  Collection of evals for Inspect AI
  ☆155Updated this week
• METR / RE-Bench
  ☆84Updated 2 months ago
• SalesforceAIResearch / LaTRO
  ☆115Updated 4 months ago
• Yu-Fangxu / FoR
  [ICML 2025] Flow of Reasoning: Training LLMs for Divergent Reasoning with Minimal Examples
  ☆95Updated 2 weeks ago
• siegelz / core-bench
  ☆40Updated 3 months ago
• ucl-dark / llm_debate
  Code release for "Debating with More Persuasive LLMs Leads to More Truthful Answers"
  ☆109Updated last year
• BigComputer-Project / SWE-Arena
  SWE Arena
  ☆34Updated 2 months ago
• princeton-nlp / USACO
  Can Language Models Solve Olympiad Programming?
  ☆116Updated 5 months ago
• hughbzhang / o1_inference_scaling_laws
  Replicating O1 inference-time scaling laws
  ☆87Updated 6 months ago
• suzgunmirac / dynamic-cheatsheet
  Dynamic Cheatsheet: Test-Time Learning with Adaptive Memory
  ☆62Updated last month
• LeonGuertler / TextArena
  A Collection of Competitive Text-Based Games for Language Model Evaluation and Reinforcement Learning
  ☆184Updated this week
• facebookresearch / sweet_rl
  Benchmark and research code for the paper SWEET-RL Training Multi-Turn LLM Agents onCollaborative Reasoning Tasks
  ☆219Updated last month
• zorazrw / agent-workflow-memory
  AWM: Agent Workflow Memory
  ☆275Updated 4 months ago
• oriyor / assistantbench
  Implementation of the paper: "AssistantBench: Can Web Agents Solve Realistic and Time-Consuming Tasks?"
  ☆57Updated 6 months ago
• data-for-agents / insta
  Official Repo for InSTA: Towards Internet-Scale Training For Agents
  ☆42Updated this week
• PrimeIntellect-ai / genesys
  ☆127Updated 3 months ago
• xiaowu0162 / LongMemEval
  Benchmarking Chat Assistants on Long-Term Interactive Memory (ICLR 2025)
  ☆115Updated last month
• kanishkg / stream-of-search
  Repository for the paper Stream of Search: Learning to Search in Language
  ☆148Updated 4 months ago
• StonyBrookNLP / appworld
  🌍 Repository for "AppWorld: A Controllable World of Apps and People for Benchmarking Interactive Coding Agent", ACL'24 Best Resource Pap…
  ☆215Updated last month
• ryoungj / ToolEmu
  [ICLR'24 Spotlight] A language model (LM)-based emulation framework for identifying the risks of LM agents with tool use
  ☆145Updated last year
• letta-ai / sleep-time-compute
  accompanying material for sleep-time compute paper
  ☆93Updated last month
• aorwall / moatless-tree-search
  ☆86Updated 2 weeks ago
• jwhj / OREO
  ☆114Updated 5 months ago
• goodfire-ai / r1-interpretability
  Open source interpretability artefacts for R1.
  ☆149Updated 2 months ago
• google-deepmind / mishax
  ☆134Updated 2 months ago
• ConsequentAI / fneval
  Functional Benchmarks and the Reasoning Gap
  ☆87Updated 8 months ago
• scicode-bench / SciCode
  A benchmark that challenges language models to code solutions for scientific problems
  ☆124Updated 2 weeks ago
• GAIR-NLP / scaleeval
  Scalable Meta-Evaluation of LLMs as Evaluators
  ☆42Updated last year
• MLE-Dojo / MLE-Dojo
  ☆53Updated last week