Alternatives and similar repositories for SWE-Arena:

Users that are interested in SWE-Arena are comparing it to the libraries listed below

• Yu-Fangxu / FoR
  Flow of Reasoning: Training LLMs for Divergent Problem Solving with Minimal Examples
  ☆80Updated last week
• hughbzhang / o1_inference_scaling_laws
  Replicating O1 inference-time scaling laws
  ☆83Updated 4 months ago
• hkust-nlp / B-STaR
  B-STAR: Monitoring and Balancing Exploration and Exploitation in Self-Taught Reasoners
  ☆75Updated 2 months ago
• GAIR-NLP / AIME-Preview
  ☆52Updated 3 weeks ago
• SynthLabsAI / big-math
  A Large-Scale, High-Quality Math Dataset for Reinforcement Learning in Language Models
  ☆44Updated last month
• qishenghu / InstructCoder
  InstructCoder: Instruction Tuning Large Language Models for Code Editing | Oral ACL-2024 srw
  ☆58Updated 5 months ago
• GAIR-NLP / OlympicArena
  [NeurIPS 2024] OlympicArena: Benchmarking Multi-discipline Cognitive Reasoning for Superintelligent AI
  ☆97Updated 3 weeks ago
• amazon-science / llm-code-preference
  Training and Benchmarking LLMs for Code Preference.
  ☆33Updated 4 months ago
• architsharma97 / dpo-rlaif
  ☆96Updated 9 months ago
• SalesforceAIResearch / LaTRO
  ☆111Updated last month
• OSU-NLP-Group / llm-planning-eval
  [ACL'24] Code and data of paper "When is Tree Search Useful for LLM Planning? It Depends on the Discriminator"
  ☆54Updated last year
• google-deepmind / bbeh
  ☆59Updated 2 weeks ago
• ucl-dark / llm_debate
  Code release for "Debating with More Persuasive LLMs Leads to More Truthful Answers"
  ☆103Updated last year
• evalplus / repoqa
  RepoQA: Evaluating Long-Context Code Understanding
  ☆106Updated 5 months ago
• allenai / super-benchmark
  ☆40Updated last month
• HKUNLP / critic-rl
  Code for Paper: Teaching Language Models to Critique via Reinforcement Learning
  ☆84Updated last month
• casper-hansen / OpenCoconut
  OpenCoconut implements a latent reasoning paradigm where we generate thoughts before decoding.
  ☆168Updated 2 months ago
• hamishivi / automated-instruction-selection
  Exploration of automated dataset selection approaches at large scales.
  ☆34Updated 3 weeks ago
• OpenEvaByte / evabyte
  EvaByte: Efficient Byte-level Language Models at Scale
  ☆85Updated last week
• meg-tong / sycophancy-eval
  datasets from the paper "Towards Understanding Sycophancy in Language Models"
  ☆73Updated last year
• da03 / Internalize_CoT_Step_by_Step
  ☆163Updated 3 weeks ago
• SALT-NLP / demonstrated-feedback
  ☆119Updated 6 months ago
• ScalingIntelligence / Archon
  Archon provides a modular framework for combining different inference-time techniques and LMs with just a JSON config file.
  ☆166Updated 3 weeks ago
• kanishkg / stream-of-search
  Repository for the paper Stream of Search: Learning to Search in Language
  ☆142Updated last month
• princeton-nlp / USACO
  Can Language Models Solve Olympiad Programming?
  ☆112Updated 2 months ago
• OSU-NLP-Group / Middleware
  Middleware for LLMs: Tools Are Instrumental for Language Agents in Complex Environments (EMNLP'2024)
  ☆36Updated 3 months ago
• GAIR-NLP / scaleeval
  Scalable Meta-Evaluation of LLMs as Evaluators
  ☆42Updated last year
• AlexCuadron / ThinkingAgent
  Systematic evaluation framework that automatically rates overthinking behavior in large language models.
  ☆82Updated this week
• LoryPack / LLM-LieDetector
  Code for the ICLR 2024 paper "How to catch an AI liar: Lie detection in black-box LLMs by asking unrelated questions"
  ☆67Updated 9 months ago
• JacobPfau / fillerTokens
  ☆60Updated 11 months ago