Alternatives and similar repositories for StarScout

Users that are interested in StarScout are comparing it to the libraries listed below

• SWE-bench / experiments
  Open sourced predictions, execution logs, trajectories, and results from model inference + evaluation runs on the SWE-bench task.
  ☆186Updated this week
• evalplus / repoqa
  RepoQA: Evaluating Long-Context Code Understanding
  ☆109Updated 7 months ago
• commit-0 / commit0
  Commit0: Library Generation from Scratch
  ☆155Updated last month
• THUDM / SWE-Dev
  [ACL25' Findings] SWE-Dev is an SWE agent with a scalable test case construction pipeline.
  ☆40Updated 2 weeks ago
• GavinZhengOI / LiveCodeBench-Pro
  ☆100Updated last month
• facebookresearch / cruxeval
  CRUXEval: Code Reasoning, Understanding, and Execution Evaluation
  ☆145Updated 8 months ago
• codelion / pts
  Pivotal Token Search
  ☆104Updated last month
• sshh12 / llm_backdoor
  Experimental tools to backdoor large language models by re-writing their system prompts at a raw parameter level. This allows you to pote…
  ☆172Updated 2 months ago
• egozverev / Should-It-Be-Executed-Or-Processed
  Accompanying code and SEP dataset for the "Can LLMs Separate Instructions From Data? And What Do We Even Mean By That?" paper.
  ☆53Updated 3 months ago
• facebookresearch / ZeroSumEval
  A framework for pitting LLMs against each other in an evolving library of games ⚔
  ☆31Updated 2 months ago
• vaibhavagg303 / DARS-Agent
  ☆64Updated last month
• BigComputer-Project / SWE-Arena
  SWE Arena
  ☆34Updated 2 months ago
• evo-eval / evoeval
  EvoEval: Evolving Coding Benchmarks via LLM
  ☆73Updated last year
• InternLM / SWE-Fixer
  ☆97Updated last month
• LiveBench / liveswebench
  ☆42Updated 2 months ago
• SWE-bench / swe-bench.github.io
  Landing page + leaderboard for SWE-Bench benchmark
  ☆6Updated 2 weeks ago
• EQ-bench / creative-writing-bench
  ☆31Updated 2 months ago
• nuprl / CanItEdit
  Can It Edit? Evaluating the Ability of Large Language Models to Follow Code Editing Instructions
  ☆43Updated 10 months ago
• Aider-AI / polyglot-benchmark
  Coding problems used in aider's polyglot benchmark
  ☆141Updated 6 months ago
• Aider-AI / aider-swe-bench
  Harness used to benchmark aider against SWE Bench benchmarks
  ☆72Updated 11 months ago
• laude-institute / terminal-bench
  A benchmark for LLMs on complicated tasks in the terminal
  ☆177Updated this week
• multi-swe-bench / multi-swe-bench
  Multi-SWE-bench: A Multilingual Benchmark for Issue Resolving
  ☆195Updated this week
• gitbugactions / gitbugactions
  ⚙️ A tool for collecting executable code datasets with GitHub Actions ⚙️
  ☆20Updated this week
• aavetis / ai-pr-watcher
  This repo tracks the opened and merged PRs by the top SWE coding agents by OpenAI, GitHub, and others. Updates every 3 hours.
  ☆146Updated this week
• coderabbitai / ast-grep-essentials
  Community-led collection of essential ast-grep rules.
  ☆55Updated 2 months ago
• guidance-ai / jsonschemabench
  ☆41Updated 2 weeks ago
• GammaTauAI / opentau
  Using Large Language Models for Repo-wide Type Prediction
  ☆109Updated last year
• adityasoni9998 / OpenHands-Versa
  Code for the paper "Coding Agents with Multimodal Browsing are Generalist Problem Solvers"
  ☆50Updated this week
• logic-star-ai / swt-bench
  [NeurIPS 2024] Evaluation harness for SWT-Bench, a benchmark for evaluating LLM repository-level test-generation
  ☆50Updated 3 weeks ago
• mathpn / llm-docsmith
  Generate Python docstrings automatically with LLM and syntax trees
  ☆14Updated 2 weeks ago