Alternatives and similar repositories for SWE-Arena:

Users that are interested in SWE-Arena are comparing it to the libraries listed below

• qishenghu / InstructCoder
  InstructCoder: Instruction Tuning Large Language Models for Code Editing | Oral ACL-2024 srw
  ☆59Updated 6 months ago
• SalesforceAIResearch / LaTRO
  ☆114Updated 2 months ago
• Yu-Fangxu / FoR
  Flow of Reasoning: Training LLMs for Divergent Problem Solving with Minimal Examples
  ☆84Updated 3 weeks ago
• suzgunmirac / dynamic-cheatsheet
  ☆48Updated last week
• hughbzhang / o1_inference_scaling_laws
  Replicating O1 inference-time scaling laws
  ☆83Updated 4 months ago
• SynthLabsAI / big-math
  A Large-Scale, High-Quality Math Dataset for Reinforcement Learning in Language Models
  ☆47Updated last month
• WildEval / ZeroEval
  A simple unified framework for evaluating LLMs
  ☆209Updated last week
• huggingface / ioi
  ☆33Updated 3 weeks ago
• ScalerLab / JudgeBench
  ☆70Updated 5 months ago
• da03 / Internalize_CoT_Step_by_Step
  ☆166Updated this week
• R2E-Gym / R2E-Gym
  Official repository for R2E-Gym: Procedural Environment Generation and Hybrid Verifiers for Scaling Open-Weights SWE Agents
  ☆61Updated 2 weeks ago
• THUDM / ComplexFuncBench
  Complex Function Calling Benchmark.
  ☆96Updated 3 months ago
• kanishkg / stream-of-search
  Repository for the paper Stream of Search: Learning to Search in Language
  ☆144Updated 2 months ago
• allenai / WildBench
  Benchmarking LLMs with Challenging Tasks from Real Users
  ☆220Updated 5 months ago
• evalplus / repoqa
  RepoQA: Evaluating Long-Context Code Understanding
  ☆107Updated 5 months ago
• bigcode-project / astraios
  Astraios: Parameter-Efficient Instruction Tuning Code Language Models
  ☆57Updated last year
• allenai / infinigram-api
  ☆51Updated this week
• princeton-pli / hal-harness
  ☆60Updated this week
• AlexCuadron / ThinkingAgent
  Systematic evaluation framework that automatically rates overthinking behavior in large language models.
  ☆86Updated 2 weeks ago
• GAIR-NLP / scaleeval
  Scalable Meta-Evaluation of LLMs as Evaluators
  ☆42Updated last year
• dwzhu-pku / LongEmbed
  LongEmbed: Extending Embedding Models for Long Context Retrieval (EMNLP 2024)
  ☆133Updated 5 months ago
• facebookresearch / sweet_rl
  Benchmark and research code for the paper SWEET-RL Training Multi-Turn LLM Agents onCollaborative Reasoning Tasks
  ☆177Updated last week
• letta-ai / sleep-time-compute
  accompany material for sleep time compute paper
  ☆17Updated this week
• OpenEvaByte / evabyte
  EvaByte: Efficient Byte-level Language Models at Scale
  ☆87Updated last month
• orionw / promptriever
  The first dense retrieval model that can be prompted like an LM
  ☆70Updated 7 months ago
• HKUNLP / critic-rl
  Code for Paper: Teaching Language Models to Critique via Reinforcement Learning
  ☆92Updated last week
• JinjieNi / MixEval
  The official evaluation suite and dynamic data release for MixEval.
  ☆235Updated 5 months ago
• GAIR-NLP / AIME-Preview
  ☆57Updated last month
• casper-hansen / OpenCoconut
  OpenCoconut implements a latent reasoning paradigm where we generate thoughts before decoding.
  ☆171Updated 3 months ago
• JacobPfau / fillerTokens
  ☆60Updated 11 months ago