Alternatives and similar repositories for moatless-testbeds:

Users that are interested in moatless-testbeds are comparing it to the libraries listed below

• JoshuaPurtell / SmallBench
  Small, simple agent task environments for training and evaluation
  ☆18Updated 6 months ago
• amazon-science / llm-code-preference
  Training and Benchmarking LLMs for Code Preference.
  ☆33Updated 5 months ago
• IPRC-DIP / ANPL
  ☆21Updated last year
• aorwall / moatless-tree-search
  ☆79Updated 2 weeks ago
• HazyResearch / aioli
  Aioli: A unified optimization framework for language model data mixing
  ☆25Updated 3 months ago
• crux-eval / eval-arena
  ☆24Updated 6 months ago
• ContextualAI / CLAIR_and_APO
  Anchored Preference Optimization and Contrastive Revisions: Addressing Underspecification in Alignment
  ☆55Updated 8 months ago
• cmu-l3 / neurips2024-inference-tutorial-code
  NeurIPS 2024 tutorial on LLM Inference
  ☆43Updated 4 months ago
• allenai / recoma
  Reasoning by Communicating with Agents
  ☆27Updated last week
• zorazrw / odex
  [EMNLP'23] Execution-Based Evaluation for Open Domain Code Generation
  ☆47Updated last year
• allenai / super-benchmark
  ☆42Updated last month
• ZeroSumEval / ZeroSumEval
  A framework for pitting LLMs against each other in an evolving library of games ⚔
  ☆32Updated 2 weeks ago
• Edward-Sun / gpt-accelera
  Simple and efficient pytorch-native transformer training and inference (batched)
  ☆73Updated last year
• scottlogic-alex / prm800k-denorm
  Script for processing OpenAI's PRM800K process supervision dataset into an Alpaca-style instruction-response format
  ☆27Updated last year
• voidism / SelfCite
  Implementation of "SelfCite: Self-Supervised Alignment for Context Attribution in Large Language Models"
  ☆27Updated 2 months ago
• R2E-Gym / R2E-Gym
  Official repository for R2E-Gym: Procedural Environment Generation and Hybrid Verifiers for Scaling Open-Weights SWE Agents
  ☆64Updated 2 weeks ago
• choosewhatulike / case2code
  ☆15Updated 3 weeks ago
• martin-wey / CodeUltraFeedback
  CodeUltraFeedback: aligning large language models to coding preferences
  ☆71Updated 10 months ago
• InternLM / SWE-Fixer
  ☆85Updated last week
• GAIR-NLP / OlympicArena
  [NeurIPS 2024] OlympicArena: Benchmarking Multi-discipline Cognitive Reasoning for Superintelligent AI
  ☆101Updated 2 months ago
• Lagooon / LeanSTaR
  ☆42Updated 7 months ago
• agential-ai / agential
  🔔🧠 Easily experiment with popular language agents across diverse reasoning/decision-making benchmarks!
  ☆51Updated last month
• evalplus / repoqa
  RepoQA: Evaluating Long-Context Code Understanding
  ☆108Updated 6 months ago
• JacobPfau / fillerTokens
  ☆60Updated last year
• likenneth / q_probe
  Q-Probe: A Lightweight Approach to Reward Maximization for Language Models
  ☆41Updated 10 months ago
• LLM360 / crystalcoder-data-prep
  Data preparation code for CrystalCoder 7B LLM
  ☆44Updated 11 months ago
• EleutherAI / mdl
  Minimum Description Length probing for neural network representations
  ☆19Updated 3 months ago
• john-hewitt / implicit-ins
  Codebase for Instruction Following without Instruction Tuning
  ☆34Updated 7 months ago
• Infini-AI-Lab / gsm_infinite
  ☆44Updated 2 months ago
• hsaest / Agent-Planning-Analysis
  [NAACL'25] "Revealing the Barriers of Language Agents in Planning"
  ☆12Updated 6 months ago