Alternatives and similar repositories for liveswebench

Users that are interested in liveswebench are comparing it to the libraries listed below

• SWE-bench / SWE-smith
  Scaling Data for SWE-agents
  ☆160Updated this week
• InternLM / SWE-Fixer
  ☆87Updated last week
• asappresearch / webagents-step
  ☆40Updated 9 months ago
• evalplus / repoqa
  RepoQA: Evaluating Long-Context Code Understanding
  ☆108Updated 6 months ago
• ozyyshr / RepoGraph
  Enhancing AI Software Engineering with Repository-level Code Graph
  ☆164Updated last month
• QwenLM / CodeElo
  CodeElo: Benchmarking Competition-level Code Generation of LLMs with Human-comparable Elo Ratings
  ☆36Updated 3 months ago
• Aider-AI / polyglot-benchmark
  Coding problems used in aider's polyglot benchmark
  ☆115Updated 4 months ago
• aorwall / moatless-tree-search
  ☆80Updated last month
• multi-swe-bench / multi-swe-bench
  Multi-SWE-bench: A Multilingual Benchmark for Issue Resolving
  ☆157Updated this week
• NL2Code / CodeR
  ☆155Updated 8 months ago
• aorwall / SWE-bench-docker
  ☆92Updated 10 months ago
• R2E-Gym / R2E-Gym
  Official repository for R2E-Gym: Procedural Environment Generation and Hybrid Verifiers for Scaling Open-Weights SWE Agents
  ☆67Updated 3 weeks ago
• Arvid-pku / Godel_Agent
  Gödel Agent: A Self-Referential Agent Framework for Recursive Self-Improvement
  ☆88Updated 3 months ago
• colonylabs / ScribeAgent
  Code for ScribeAgent paper
  ☆57Updated 2 months ago
• SalesforceAIResearch / LaTRO
  ☆114Updated 2 months ago
• SWE-agent / SWE-ReX
  Sandboxed code execution for AI agents, locally or on the cloud. Massively parallel, easy to extend. Powering SWE-agent and more.
  ☆182Updated this week
• BigComputer-Project / SWE-Arena
  SWE Arena
  ☆33Updated last month
• agentica-project / verl-pipeline
  Async pipelined version of Verl
  ☆78Updated last month
• shirley-wu / cot_decoding
  ☆45Updated last year
• aymeric-roucher / GAIA
  Beating the GAIA benchmark with Transformers Agents. 🚀
  ☆114Updated 2 months ago
• facebookresearch / fastgen
  Simple high-throughput inference library
  ☆46Updated this week
• TIGER-AI-Lab / General-Reasoner
  General Reasoner: Advancing LLM Reasoning Across All Domains
  ☆82Updated last week
• RepoUnderstander / RepoUnderstander
  Official implementation of paper How to Understand Whole Repository? New SOTA on SWE-bench Lite (21.3%)
  ☆85Updated last month
• THUDM / NaturalCodeBench
  NaturalCodeBench (Findings of ACL 2024)
  ☆64Updated 7 months ago
• bigcode-project / the-stack-v2
  Code for the curation of The Stack v2 and StarCoder2 training data
  ☆105Updated last year
• allenai / WildBench
  Benchmarking LLMs with Challenging Tasks from Real Users
  ☆222Updated 6 months ago
• scicode-bench / SciCode
  A benchmark that challenges language models to code solutions for scientific problems
  ☆119Updated this week
• facebookresearch / sweet_rl
  Benchmark and research code for the paper SWEET-RL Training Multi-Turn LLM Agents onCollaborative Reasoning Tasks
  ☆193Updated last week
• LLM360 / crystalcoder-data-prep
  Data preparation code for CrystalCoder 7B LLM
  ☆44Updated last year
• xlang-ai / computer-agent-arena
  Computer Agent Arena: Test & compare AI agents in real desktop apps & web environments. Code/data coming soon!
  ☆45Updated last month