Alternatives and similar repositories for insights

Users that are interested in insights are comparing it to the libraries listed below

• METR / eval-analysis-public
  Public repository containing METR's DVC pipeline for eval data analysis
  ☆183Updated this week
• invariantlabs-ai / explorer
  A better way of testing, inspecting, and analyzing AI Agent traces.
  ☆40Updated last week
• SWE-bench / sb-cli
  Run SWE-bench evaluations remotely
  ☆50Updated 5 months ago
• thomasnormal / fewshot
  ☆29Updated 2 months ago
• ScalingIntelligence / codemonkeys
  ☆59Updated 11 months ago
• laude-institute / harbor
  Harbor is a framework for running agent evaluations and creating and using RL environments.
  ☆381Updated this week
• aavetis / PRarena
  This repo tracks the opened and merged PRs by the top SWE coding agents by OpenAI, GitHub, and others. Updates every 3 hours.
  ☆298Updated this week
• scaleapi / SWE-bench_Pro-os
  SWE-Bench Pro: Can AI Agents Solve Long-Horizon Software Engineering Tasks?
  ☆246Updated last week
• microsoft / debug-gym
  A Text-Based Environment for Interactive Debugging
  ☆289Updated this week
• aorwall / moatless-tree-search
  ☆129Updated 7 months ago
• haizelabs / verdict
  Inference-time scaling for LLMs-as-a-judge.
  ☆325Updated 2 months ago
• Aider-AI / aider-swe-bench
  Harness used to benchmark aider against SWE Bench benchmarks
  ☆78Updated last year
• ScalingIntelligence / Archon
  Archon provides a modular framework for combining different inference-time techniques and LMs with just a JSON config file.
  ☆190Updated 10 months ago
• Aider-AI / polyglot-benchmark
  Coding problems used in aider's polyglot benchmark
  ☆199Updated last year
• SWE-bench / experiments
  Open sourced predictions, execution logs, trajectories, and results from model inference + evaluation runs on the SWE-bench task.
  ☆237Updated last week
• METR / vivaria
  Vivaria is METR's tool for running evaluations and conducting agent elicitation research.
  ☆130Updated last week
• haizelabs / j1-micro
  j1-micro (1.7B) & j1-nano (600M) are absurdly tiny but mighty reward models.
  ☆101Updated 6 months ago
• SWE-agent / SWE-ReX
  Sandboxed code execution for AI agents, locally or on the cloud. Massively parallel, easy to extend. Powering SWE-agent and more.
  ☆409Updated last week
• r2e-project / r2e
  [ICML '24] R2E: Turn any GitHub Repository into a Programming Agent Environment
  ☆138Updated 9 months ago
• guidance-ai / jsonschemabench
  ☆75Updated 7 months ago
• invariantlabs-ai / playwright-computer-use
  Let Claude control a web browser on your machine.
  ☆39Updated 7 months ago
• centerforaisafety / emergent-values
  Code for "Utility Engineering: Analyzing and Controlling Emergent Value Systems in AIs"
  ☆86Updated 10 months ago
• MinhxLe / subliminal-learning
  ☆105Updated 5 months ago
• haizelabs / sphynx
  Sphynx Hallucination Induction
  ☆52Updated 11 months ago
• Ziems / arbor
  A framework for optimizing DSPy programs with RL
  ☆304Updated last week
• egozverev / Should-It-Be-Executed-Or-Processed
  Accompanying code and SEP dataset for the "Can LLMs Separate Instructions From Data? And What Do We Even Mean By That?" paper.
  ☆58Updated 10 months ago
• asappresearch / webagents-step
  ☆41Updated last year
• safety-research / open-source-alignment-faking
  Open Source Replication of Anthropic's Alignment Faking Paper
  ☆54Updated 9 months ago
• PrimeIntellect-ai / prime-environments
  Curated collection of community environments
  ☆204Updated last week
• CarperAI / Code-Pile
  This repository contains all the code for collecting large scale amounts of code from GitHub.
  ☆110Updated 2 years ago