Alternatives and similar repositories for insights

Users that are interested in insights are comparing it to the libraries listed below

• Aider-AI / aider-swe-bench
  Harness used to benchmark aider against SWE Bench benchmarks
  ☆78Updated last year
• METR / eval-analysis-public
  Public repository containing METR's DVC pipeline for eval data analysis
  ☆164Updated 8 months ago
• laude-institute / harbor
  Harbor is a framework for running agent evaluations and creating and using RL environments.
  ☆213Updated this week
• invariantlabs-ai / explorer
  A better way of testing, inspecting, and analyzing AI Agent traces.
  ☆40Updated 2 months ago
• SWE-bench / experiments
  Open sourced predictions, execution logs, trajectories, and results from model inference + evaluation runs on the SWE-bench task.
  ☆228Updated last week
• microsoft / debug-gym
  A Text-Based Environment for Interactive Debugging
  ☆286Updated this week
• aorwall / moatless-tree-search
  ☆128Updated 6 months ago
• scaleapi / SWE-bench_Pro-os
  SWE-Bench Pro: Can AI Agents Solve Long-Horizon Software Engineering Tasks?
  ☆233Updated last month
• ScalingIntelligence / codemonkeys
  ☆59Updated 10 months ago
• ScalingIntelligence / Archon
  Archon provides a modular framework for combining different inference-time techniques and LMs with just a JSON config file.
  ☆190Updated 9 months ago
• PrimeIntellect-ai / prime-environments
  Curated collection of community environments
  ☆195Updated last week
• SWE-bench / sb-cli
  Run SWE-bench evaluations remotely
  ☆47Updated 4 months ago
• thomasnormal / fewshot
  ☆29Updated 2 months ago
• aavetis / PRarena
  This repo tracks the opened and merged PRs by the top SWE coding agents by OpenAI, GitHub, and others. Updates every 3 hours.
  ☆296Updated this week
• guidance-ai / jsonschemabench
  ☆68Updated 6 months ago
• Aider-AI / polyglot-benchmark
  Coding problems used in aider's polyglot benchmark
  ☆198Updated last year
• amazon-science / SWE-PolyBench
  SWE-PolyBench: A multi-language benchmark for repository level evaluation of coding agents
  ☆75Updated this week
• princeton-pli / hal-harness
  ☆207Updated last week
• PrimeIntellect-ai / genesys
  ☆136Updated 9 months ago
• Ziems / arbor
  A framework for optimizing DSPy programs with RL
  ☆298Updated last month
• GoodAI / goodai-ltm-benchmark
  A library for benchmarking the Long Term Memory and Continual learning capabilities of LLM based agents. With all the tests and code you…
  ☆81Updated last year
• HazyResearch / cartridges
  Storing long contexts in tiny caches with self-study
  ☆226Updated 2 weeks ago
• All-Hands-AI / openhands-resolver
  A system that tries to resolve all issues on a github repo with OpenHands.
  ☆117Updated last year
• All-Hands-AI / openhands-aci
  Agent computer interface for AI software engineer.
  ☆115Updated 2 weeks ago
• anthropic-experimental / automated-auditing
  Prompts used in the Automated Auditing Blog Post
  ☆127Updated 5 months ago
• r2e-project / r2e
  [ICML '24] R2E: Turn any GitHub Repository into a Programming Agent Environment
  ☆138Updated 8 months ago
• mistralai / mistral-evals
  ☆80Updated last month
• ConsequentAI / fneval
  Functional Benchmarks and the Reasoning Gap
  ☆90Updated last year
• SWE-agent / SWE-ReX
  Sandboxed code execution for AI agents, locally or on the cloud. Massively parallel, easy to extend. Powering SWE-agent and more.
  ☆396Updated this week
• gso-bench / gso
  [NeurIPS '25] Challenging Software Optimization Tasks for Evaluating SWE-Agents
  ☆58Updated 3 weeks ago