Alternatives and similar repositories for SWE-bench_Pro-os

Users that are interested in SWE-bench_Pro-os are comparing it to the libraries listed below

• codelion / pts
  Pivotal Token Search
  ☆125Updated 2 months ago
• Columbia-NLP-Lab / PAPILLON
  Code for our paper PAPILLON: PrivAcy Preservation from Internet-based and Local Language MOdel ENsembles
  ☆55Updated 4 months ago
• neurallambda / awesome-reasoning
  a curated list of data for reasoning ai
  ☆137Updated last year
• em-llm / EM-LLM-model
  ☆230Updated 6 months ago
• Danau5tin / terminal-bench-rl
  GRPO training code which scales to 32xH100s for long horizon terminal/coding tasks. Base agent is now the top Qwen3 agent on Stanford's T…
  ☆259Updated last month
• Ziems / arbor
  A framework for optimizing DSPy programs with RL
  ☆182Updated this week
• llmonpy / needle-in-a-needlestack
  ☆116Updated 7 months ago
• lechmazur / nyt-connections
  Benchmark that evaluates LLMs using 759 NYT Connections puzzles extended with extra trick words
  ☆146Updated last week
• Not-Diamond / RoRF
  Routing on Random Forest (RoRF)
  ☆206Updated last year
• QuixiAI / dolphin-logger
  ☆104Updated 3 months ago
• ScalingIntelligence / codemonkeys
  ☆56Updated 7 months ago
• agentsea / r1-computer-use
  Applying the ideas of Deepseek R1 to computer use
  ☆216Updated 7 months ago
• changjonathanc / llmproc
  LLMProc: Unix-inspired runtime that treats LLMs as processes.
  ☆33Updated 2 months ago
• SWE-agent / SWE-ReX
  Sandboxed code execution for AI agents, locally or on the cloud. Massively parallel, easy to extend. Powering SWE-agent and more.
  ☆321Updated this week
• Aider-AI / polyglot-benchmark
  Coding problems used in aider's polyglot benchmark
  ☆180Updated 9 months ago
• LAION-AI / AIW
  Alice in Wonderland code base for experiments and raw experiments data
  ☆131Updated last week
• OpenPipe / deductive-reasoning
  Train your own SOTA deductive reasoning model
  ☆106Updated 6 months ago
• egozverev / Should-It-Be-Executed-Or-Processed
  Accompanying code and SEP dataset for the "Can LLMs Separate Instructions From Data? And What Do We Even Mean By That?" paper.
  ☆55Updated 6 months ago
• ScalingIntelligence / tokasaurus
  ☆421Updated last month
• babycommando / neuralgraffiti
  Live-bending a foundation model’s output at neural network level.
  ☆264Updated 5 months ago
• zbambergerNLP / strategic-debate-tot
  A DSPy-based implementation of the tree of thoughts method (Yao et al., 2023) for generating persuasive arguments
  ☆89Updated 11 months ago
• bradhilton / temporal-clue
  Clue inspired puzzles for testing LLM deduction abilities
  ☆43Updated 6 months ago
• brendanhogan / picoDeepResearch
  ☆68Updated 4 months ago
• google / lmeval
  ☆231Updated 2 months ago
• haizelabs / j1-micro
  j1-micro (1.7B) & j1-nano (600M) are absurdly tiny but mighty reward models.
  ☆98Updated 2 months ago
• s-smits / grpo-optuna
  Optimizing Causal LMs through GRPO with weighted reward functions and automated hyperparameter tuning using Optuna
  ☆55Updated 7 months ago
• METR / eval-analysis-public
  Public repository containing METR's DVC pipeline for eval data analysis
  ☆110Updated 5 months ago
• MaximeRivest / ovllm
  ☆32Updated last month
• invariantlabs-ai / explorer
  A better way of testing, inspecting, and analyzing AI Agent traces.
  ☆40Updated this week
• microsoft / ArchScale
  Simple & Scalable Pretraining for Neural Architecture Research
  ☆294Updated last month