Alternatives and similar repositories for insights

Users that are interested in insights are comparing it to the libraries listed below

• aorwall / moatless-tree-search
  ☆112Updated 3 months ago
• ScalingIntelligence / codemonkeys
  ☆56Updated 7 months ago
• Aider-AI / polyglot-benchmark
  Coding problems used in aider's polyglot benchmark
  ☆180Updated 9 months ago
• haizelabs / j1-micro
  j1-micro (1.7B) & j1-nano (600M) are absurdly tiny but mighty reward models.
  ☆98Updated 2 months ago
• Aider-AI / aider-swe-bench
  Harness used to benchmark aider against SWE Bench benchmarks
  ☆76Updated last year
• scaleapi / SWE-bench_Pro-os
  SWE-Bench Pro: Can AI Agents Solve Long-Horizon Software Engineering Tasks?
  ☆107Updated this week
• princeton-pli / hal-harness
  ☆133Updated this week
• thomasnormal / fewshot
  ☆28Updated 3 months ago
• aavetis / PRarena
  This repo tracks the opened and merged PRs by the top SWE coding agents by OpenAI, GitHub, and others. Updates every 3 hours.
  ☆252Updated this week
• METR / eval-analysis-public
  Public repository containing METR's DVC pipeline for eval data analysis
  ☆110Updated 5 months ago
• SWE-bench / sb-cli
  Run SWE-bench evaluations remotely
  ☆42Updated last month
• Ziems / arbor
  A framework for optimizing DSPy programs with RL
  ☆182Updated this week
• safety-research / open-source-alignment-faking
  Open Source Replication of Anthropic's Alignment Faking Paper
  ☆50Updated 5 months ago
• scicode-bench / SciCode
  A benchmark that challenges language models to code solutions for scientific problems
  ☆143Updated this week
• evalplus / repoqa
  RepoQA: Evaluating Long-Context Code Understanding
  ☆117Updated 10 months ago
• commit-0 / commit0
  Commit0: Library Generation from Scratch
  ☆167Updated 4 months ago
• ScalingIntelligence / Archon
  Archon provides a modular framework for combining different inference-time techniques and LMs with just a JSON config file.
  ☆183Updated 6 months ago
• r2e-project / r2e
  [ICML '24] r2e: turn any github repository into a programming agent environment
  ☆129Updated 5 months ago
• egozverev / Should-It-Be-Executed-Or-Processed
  Accompanying code and SEP dataset for the "Can LLMs Separate Instructions From Data? And What Do We Even Mean By That?" paper.
  ☆55Updated 6 months ago
• pyember / ember
  ☆224Updated 3 months ago
• microsoft / debug-gym
  A Text-Based Environment for Interactive Debugging
  ☆266Updated this week
• BigComputer-Project / SWE-Arena
  SWE Arena
  ☆34Updated 2 months ago
• codelion / pts
  Pivotal Token Search
  ☆125Updated 2 months ago
• oriyor / assistantbench
  Implementation of the paper: "AssistantBench: Can Web Agents Solve Realistic and Time-Consuming Tasks?"
  ☆62Updated 9 months ago
• letta-ai / sleep-time-compute
  accompanying material for sleep-time compute paper
  ☆111Updated 4 months ago
• invariantlabs-ai / explorer
  A better way of testing, inspecting, and analyzing AI Agent traces.
  ☆40Updated this week
• PrimeIntellect-ai / genesys
  ☆133Updated 6 months ago
• andyzorigin / cybench
  ☆148Updated 3 months ago
• VITA-Group / ChainCoder
  [ICML 2023] "Outline, Then Details: Syntactically Guided Coarse-To-Fine Code Generation", Wenqing Zheng, S P Sharan, Ajay Kumar Jaiswal, …
  ☆41Updated last year
• PrimeIntellect-ai / prime-environments
  Training-Ready RL Environments + Evals
  ☆101Updated this week