Alternatives and similar repositories for refactor-benchmark:

Users that are interested in refactor-benchmark are comparing it to the libraries listed below

• Aider-AI / aider-swe-bench
  Harness used to benchmark aider against SWE Bench benchmarks
  ☆71Updated 10 months ago
• All-Hands-AI / openhands-aci
  Agent computer interface for AI software engineer.
  ☆68Updated this week
• zbambergerNLP / strategic-debate-tot
  A DSPy-based implementation of the tree of thoughts method (Yao et al., 2023) for generating persuasive arguments
  ☆78Updated 7 months ago
• teknium1 / LLM-Benchmark-Logs
  Just a bunch of benchmark logs for different LLMs
  ☆119Updated 9 months ago
• Xalp / ECHO
  Official homepage for "Self-Harmonized Chain of Thought" (NAACL 2025)
  ☆90Updated 3 months ago
• llllvvuu / instant_apply
  proof-of-concept of Cursor's Instant Apply feature
  ☆78Updated 8 months ago
• Aider-AI / polyglot-benchmark
  Coding problems used in aider's polyglot benchmark
  ☆110Updated 4 months ago
• SWE-agent / SWE-ReX
  Sandboxed code execution for AI agents, locally or on the cloud. Massively parallel, easy to extend. Powering SWE-agent and more.
  ☆170Updated this week
• sdan / selfextend
  an implementation of Self-Extend, to expand the context window via grouped attention
  ☆119Updated last year
• emrgnt-cmplxty / zero-shot-replication
  ☆73Updated last year
• jmanhype / dspy-self-discover-framework
  Leveraging DSPy for AI-driven task understanding and solution generation, the Self-Discover Framework automates problem-solving through r…
  ☆60Updated 9 months ago
• invariantlabs-ai / explorer
  A better way of testing, inspecting, and analyzing AI Agent traces.
  ☆35Updated last week
• JD-P / RetroInstruct
  Synthetic data derived by templating, few shot prompting, transformations on public domain corpora, and monte carlo tree search.
  ☆32Updated 2 months ago
• h2oai / enterprise-h2ogpte
  Client Code Examples, Use Cases and Benchmarks for Enterprise h2oGPTe RAG-Based GenAI Platform
  ☆87Updated last week
• teknium1 / transformers-gptq-quant
  ☆48Updated last year
• nexusflowai / nexusraven-pip
  ☆38Updated last year
• zhudotexe / redel
  ReDel is a toolkit for researchers and developers to build, iterate on, and analyze recursive multi-agent systems. (EMNLP 2024 Demo)
  ☆76Updated last month
• NL2Code / CodeR
  ☆155Updated 8 months ago
• markokraemer / OACE
  ☆22Updated 10 months ago
• yoheinakajima / autofinetune
  auto fine tune of models with synthetic data
  ☆75Updated last year
• automix-llm / automix
  Mixing Language Models with Self-Verification and Meta-Verification
  ☆104Updated 4 months ago
• interstellarninja / function-calling-eval
  A framework for evaluating function calls made by LLMs
  ☆37Updated 9 months ago
• VikParuchuri / classified
  Score LLM pretraining data with classifiers
  ☆55Updated last year
• emrgnt-cmplxty / SmolTrainer
  ☆20Updated last year
• deployradiant / pychatml
  Chat Markup Language conversation library
  ☆55Updated last year
• Technoculture / personal-graph
  Simple Graph Memory for AI applications
  ☆84Updated 9 months ago
• stunningpixels / lou-eval
  Track the progress of LLM context utilisation
  ☆54Updated 3 weeks ago
• s-smits / grpo-optuna
  Optimizing Causal LMs through GRPO with weighted reward functions and automated hyperparameter tuning using Optuna
  ☆39Updated 3 months ago
• instructor-ai / evals
  Using various instructor clients evaluating the quality and capabilities of extractions and reasoning.
  ☆51Updated 7 months ago
• SWE-bench / experiments
  Open sourced predictions, execution logs, trajectories, and results from model inference + evaluation runs on the SWE-bench task.
  ☆169Updated last month