Alternatives and similar repositories for liveswebench

Users that are interested in liveswebench are comparing it to the libraries listed below

• NL2Code / CodeR
  ☆158Updated 10 months ago
• SWE-bench / SWE-smith
  Scaling Data for SWE-agents
  ☆256Updated this week
• InternLM / SWE-Fixer
  ☆97Updated last month
• microsoft / simulated-trial-and-error
  ☆121Updated last year
• R2E-Gym / R2E-Gym
  Official repository for R2E-Gym: Procedural Environment Generation and Hybrid Verifiers for Scaling Open-Weights SWE Agents
  ☆77Updated 2 weeks ago
• allenai / WildBench
  Benchmarking LLMs with Challenging Tasks from Real Users
  ☆226Updated 7 months ago
• laude-institute / terminal-bench
  A benchmark for LLMs on complicated tasks in the terminal
  ☆177Updated this week
• evalplus / repoqa
  RepoQA: Evaluating Long-Context Code Understanding
  ☆109Updated 7 months ago
• xlang-ai / OSWorld-G
  Scaling Computer-Use Grounding via UI Decomposition and Synthesis
  ☆79Updated last week
• Aider-AI / aider-swe-bench
  Harness used to benchmark aider against SWE Bench benchmarks
  ☆72Updated last year
• aorwall / moatless-tree-search
  ☆86Updated 3 weeks ago
• aymeric-roucher / GAIA
  Beating the GAIA benchmark with Transformers Agents. 🚀
  ☆123Updated 4 months ago
• QwenLM / WorldPM
  ☆86Updated last month
• CodeEditorBench / CodeEditorBench
  ☆47Updated last year
• BigComputer-Project / SWE-Arena
  SWE Arena
  ☆34Updated 2 months ago
• xlang-ai / computer-agent-arena
  Computer Agent Arena: Test & compare AI agents in real desktop apps & web environments. Code/data coming soon!
  ☆45Updated 2 months ago
• agentica-project / verl-pipeline
  Async pipelined version of Verl
  ☆100Updated 2 months ago
• kohjingyu / search-agents
  Code for the paper 🌳 Tree Search for Language Model Agents
  ☆201Updated 11 months ago
• THUDM / SWE-Dev
  [ACL25' Findings] SWE-Dev is an SWE agent with a scalable test case construction pipeline.
  ☆40Updated 2 weeks ago
• GAIR-NLP / AIME-Preview
  ☆68Updated 3 months ago
• Aider-AI / polyglot-benchmark
  Coding problems used in aider's polyglot benchmark
  ☆141Updated 6 months ago
• my-other-github-account / llm-humaneval-benchmarks
  ☆84Updated 2 years ago
• SWE-agent / SWE-ReX
  Sandboxed code execution for AI agents, locally or on the cloud. Massively parallel, easy to extend. Powering SWE-agent and more.
  ☆228Updated last week
• THUDM / NaturalCodeBench
  NaturalCodeBench (Findings of ACL 2024)
  ☆65Updated 8 months ago
• aymeric-roucher / agent_reasoning_benchmark
  🔧 Compare how Agent systems perform on several benchmarks. 📊🚀
  ☆98Updated 8 months ago
• dwzhu-pku / LongEmbed
  LongEmbed: Extending Embedding Models for Long Context Retrieval (EMNLP 2024)
  ☆137Updated 7 months ago
• All-Hands-AI / openhands-aci
  Agent computer interface for AI software engineer.
  ☆85Updated this week
• ScalingIntelligence / Archon
  Archon provides a modular framework for combining different inference-time techniques and LMs with just a JSON config file.
  ☆173Updated 3 months ago
• gonglinyuan / safim
  ☆36Updated last month
• Tongyi-Zhiwen / QwenLong-L1
  ☆273Updated 3 weeks ago