Alternatives and similar repositories for Awesome-LLM-Judges

Users that are interested in Awesome-LLM-Judges are comparing it to the libraries listed below

• haizelabs / verdict
  Inference-time scaling for LLMs-as-a-judge.
  ☆308Updated last week
• PrimeIntellect-ai / prime-environments
  Training-Ready RL Environments + Evals
  ☆174Updated this week
• hud-evals / hud-python
  OSS RL environment + evals toolkit
  ☆200Updated this week
• tokenbender / avataRL
  rl from zero pretrain, can it be done? yes.
  ☆280Updated last month
• brendanhogan / picoDeepResearch
  ☆68Updated 5 months ago
• casper-hansen / OpenCoconut
  OpenCoconut implements a latent reasoning paradigm where we generate thoughts before decoding.
  ☆173Updated 10 months ago
• NousResearch / Open-Reasoning-Tasks
  A comprehensive repository of reasoning tasks for LLMs (and beyond)
  ☆450Updated last year
• OpenPipe / deductive-reasoning
  Train your own SOTA deductive reasoning model
  ☆108Updated 8 months ago
• PrimeIntellect-ai / genesys
  ☆135Updated 7 months ago
• Danau5tin / calculator_agent_rl
  Training an LLM to use a calculator with multi-turn reinforcement learning, achieving a **62% absolute increase in evaluation accuracy**.
  ☆58Updated 6 months ago
• google-deepmind / latent-multi-hop-reasoning
  [ACL 2024] Do Large Language Models Latently Perform Multi-Hop Reasoning?
  ☆82Updated 7 months ago
• brendanhogan / DeepSeekRL-Extended
  Exploring Applications of GRPO
  ☆248Updated 2 months ago
• goodfire-ai / r1-interpretability
  Open source interpretability artefacts for R1.
  ☆163Updated 6 months ago
• alexzhang13 / rlm
  Super basic implementation (gist-like) of RLMs with REPL environments.
  ☆248Updated 3 weeks ago
• haizelabs / j1-micro
  j1-micro (1.7B) & j1-nano (600M) are absurdly tiny but mighty reward models.
  ☆97Updated 3 months ago
• zbambergerNLP / strategic-debate-tot
  A DSPy-based implementation of the tree of thoughts method (Yao et al., 2023) for generating persuasive arguments
  ☆92Updated last month
• princeton-pli / hal-harness
  ☆180Updated last week
• Ziems / arbor
  A framework for optimizing DSPy programs with RL
  ☆276Updated this week
• HazyResearch / cartridges
  Storing long contexts in tiny caches with self-study
  ☆213Updated 3 weeks ago
• LeonGuertler / UnstableBaselines
  ☆106Updated 3 weeks ago
• groundlight / r1_vlm
  Build your own visual reasoning model
  ☆414Updated last month
• BhabhaAI / dataformer
  Solving data for LLMs - Create quality synthetic datasets!
  ☆150Updated 9 months ago
• ScalingIntelligence / Archon
  Archon provides a modular framework for combining different inference-time techniques and LMs with just a JSON config file.
  ☆189Updated 8 months ago
• agora-protocol / paper-demo
  ☆171Updated 8 months ago
• willccbb / claude-deep-research
  Claude Deep Research config for Claude Code.
  ☆224Updated 7 months ago
• jerber / lang-jepa
  ☆125Updated 10 months ago
• LeonGuertler / TextArena
  A Collection of Competitive Text-Based Games for Language Model Evaluation and Reinforcement Learning
  ☆304Updated 2 weeks ago
• haizelabs / dspy-redteam
  Red-Teaming Language Models with DSPy
  ☆235Updated 9 months ago
• ai8hyf / OpenResearchAssistant
  An automated tool for discovering insights from research papaer corpora
  ☆138Updated last year
• ServiceNow / TapeAgents
  TapeAgents is a framework that facilitates all stages of the LLM Agent development lifecycle
  ☆299Updated last week