Alternatives and similar repositories for moatless-testbeds:

Users that are interested in moatless-testbeds are comparing it to the libraries listed below

• amazon-science / llm-code-preference
  Training and Benchmarking LLMs for Code Preference.
  ☆33Updated 4 months ago
• crux-eval / eval-arena
  ☆23Updated 4 months ago
• JoshuaPurtell / SmallBench
  Small, simple agent task environments for training and evaluation
  ☆18Updated 4 months ago
• aorwall / moatless-tree-search
  ☆73Updated 2 months ago
• bigcode-project / astraios
  Astraios: Parameter-Efficient Instruction Tuning Code Language Models
  ☆57Updated 11 months ago
• qishenghu / InstructCoder
  InstructCoder: Instruction Tuning Large Language Models for Code Editing | Oral ACL-2024 srw
  ☆58Updated 5 months ago
• agential-ai / agential
  🔔🧠 Easily experiment with popular language agents across diverse reasoning/decision-making benchmarks!
  ☆51Updated 2 weeks ago
• SalesforceAIResearch / CodeChain
  Official code for the paper "CodeChain: Towards Modular Code Generation Through Chain of Self-revisions with Representative Sub-modules"
  ☆45Updated 2 months ago
• allenai / super-benchmark
  ☆40Updated last month
• zorazrw / odex
  [EMNLP'23] Execution-Based Evaluation for Open Domain Code Generation
  ☆47Updated last year
• SalesforceAIResearch / swecomm
  ☆26Updated 2 months ago
• r-three / RAD
  Reference implementation for Reward-Augmented Decoding: Efficient Controlled Text Generation With a Unidirectional Reward Model
  ☆42Updated last year
• evalplus / repoqa
  RepoQA: Evaluating Long-Context Code Understanding
  ☆106Updated 4 months ago
• r2e-project / r2e
  r2e: turn any github repository into a programming agent environment
  ☆105Updated 3 weeks ago
• JacobPfau / fillerTokens
  ☆60Updated 11 months ago
• dinobby / MAGDi
  The code implementation of MAGDi: Structured Distillation of Multi-Agent Interaction Graphs Improves Reasoning in Smaller Language Models…
  ☆33Updated last year
• HazyResearch / aioli
  Aioli: A unified optimization framework for language model data mixing
  ☆22Updated 2 months ago
• gonglinyuan / ast_t5
  ☆59Updated 10 months ago
• Lagooon / LeanSTaR
  ☆36Updated 6 months ago
• OSU-NLP-Group / llm-planning-eval
  [ACL'24] Code and data of paper "When is Tree Search Useful for LLM Planning? It Depends on the Discriminator"
  ☆54Updated last year
• IPRC-DIP / ANPL
  ☆21Updated last year
• oriyor / assistantbench
  Implementation of the paper: "AssistantBench: Can Web Agents Solve Realistic and Time-Consuming Tasks?"
  ☆52Updated 3 months ago
• VITA-Group / ChainCoder
  [ICML 2023] "Outline, Then Details: Syntactically Guided Coarse-To-Fine Code Generation", Wenqing Zheng, S P Sharan, Ajay Kumar Jaiswal, …
  ☆40Updated last year
• InternLM / SWE-Fixer
  ☆80Updated last month
• nyu-mll / ILF-for-code-generation
  ☆75Updated this week
• xingyaoww / LeTI
  Official repo for NAACL 2024 Findings paper "LeTI: Learning to Generate from Textual Interactions."
  ☆63Updated last year
• ZeroSumEval / ZeroSumEval
  A framework for pitting LLMs against each other in an evolving library of games ⚔
  ☆32Updated this week
• ScalingIntelligence / codemonkeys
  ☆36Updated 2 months ago
• HKUNLP / critic-rl
  Code for Paper: Teaching Language Models to Critique via Reinforcement Learning
  ☆84Updated last month
• casmlab / NPHardEval
  Repository for NPHardEval, a quantified-dynamic benchmark of LLMs
  ☆52Updated last year