Alternatives and similar repositories for Awesome-LLM-Judges:

Users that are interested in Awesome-LLM-Judges are comparing it to the libraries listed below

• haizelabs / verdict
  Verdict is a library for scaling judge-time compute.
  ☆195Updated 3 weeks ago
• casper-hansen / OpenCoconut
  OpenCoconut implements a latent reasoning paradigm where we generate thoughts before decoding.
  ☆170Updated 3 months ago
• OpenPipe / deductive-reasoning
  Train your own SOTA deductive reasoning model
  ☆83Updated last month
• ivanleomk / kura
  Kura is a simple reproduction of the CLIO paper which uses language models to label user behaviour before clustering them based on embedd…
  ☆99Updated this week
• huggingface / yourbench
  🤗 Benchmark Large Language Models Reliably On Your Data
  ☆233Updated this week
• LeonGuertler / TextArena
  A Collection of Competitive Text-Based Games for Language Model Evaluation and Reinforcement Learning
  ☆102Updated this week
• PrimeIntellect-ai / genesys
  ☆120Updated 3 weeks ago
• OpenPipe / ART
  OpenPipe ART (Agent Reinforcement Trainer): train LLM agents
  ☆77Updated this week
• agora-protocol / paper-demo
  ☆145Updated last month
• google-deepmind / latent-multi-hop-reasoning
  [ACL 2024] Do Large Language Models Latently Perform Multi-Hop Reasoning?
  ☆60Updated 3 weeks ago
• NousResearch / Open-Reasoning-Tasks
  A comprehensive repository of reasoning tasks for LLMs (and beyond)
  ☆429Updated 6 months ago
• willccbb / claude-code-mcp
  Letting Claude Code develop his own MCP tools :)
  ☆97Updated last month
• hammer-mt / DSPyUI
  A user interface for DSPy
  ☆142Updated 5 months ago
• redotvideo / pluto
  Synthetic Data for LLM Fine-Tuning
  ☆113Updated last year
• haizelabs / dspy-redteam
  Red-Teaming Language Models with DSPy
  ☆181Updated 2 months ago
• teknium1 / ShareGPT-Builder
  ☆112Updated 3 months ago
• jerber / arc_agi
  ☆53Updated 2 months ago
• Mihaiii / backtrack_sampler
  An easy-to-understand framework for LLM samplers that rewind and revise generated tokens
  ☆139Updated last month
• zbambergerNLP / strategic-debate-tot
  A DSPy-based implementation of the tree of thoughts method (Yao et al., 2023) for generating persuasive arguments
  ☆77Updated 6 months ago
• ConsequentAI / fneval
  Functional Benchmarks and the Reasoning Gap
  ☆85Updated 6 months ago
• ai8hyf / OpenResearchAssistant
  An automated tool for discovering insights from research papaer corpora
  ☆137Updated 10 months ago
• zorazrw / agent-workflow-memory
  AWM: Agent Workflow Memory
  ☆257Updated 2 months ago
• METR / RE-Bench
  ☆71Updated 2 months ago
• ScalingIntelligence / codemonkeys
  ☆37Updated 2 months ago
• haizelabs / sphynx
  Sphynx Hallucination Induction
  ☆53Updated 2 months ago
• facebookresearch / sweet_rl
  Benchmark and research code for the paper SWEET-RL Training Multi-Turn LLM Agents onCollaborative Reasoning Tasks
  ☆175Updated this week
• colonylabs / ScribeAgent
  Code for ScribeAgent paper
  ☆55Updated last month
• AnswerDotAI / fastdata
  ☆151Updated 4 months ago
• teknium1 / LLM-Benchmark-Logs
  Just a bunch of benchmark logs for different LLMs
  ☆119Updated 8 months ago
• haizelabs / get-haized
  A subset of jailbreaks automatically discovered by the Haize Labs haizing suite.
  ☆89Updated this week