Alternatives and similar repositories for Awesome-LLM-Judges:

Users that are interested in Awesome-LLM-Judges are comparing it to the libraries listed below

• haizelabs / verdict
  Verdict is a library for scaling judge-time compute.
  ☆202Updated last week
• casper-hansen / OpenCoconut
  OpenCoconut implements a latent reasoning paradigm where we generate thoughts before decoding.
  ☆172Updated 3 months ago
• 567-labs / kura
  Kura is a simple reproduction of the CLIO paper which uses language models to label user behaviour before clustering them based on embedd…
  ☆104Updated 3 weeks ago
• google-deepmind / latent-multi-hop-reasoning
  [ACL 2024] Do Large Language Models Latently Perform Multi-Hop Reasoning?
  ☆65Updated last month
• PrimeIntellect-ai / genesys
  ☆123Updated last month
• OpenPipe / deductive-reasoning
  Train your own SOTA deductive reasoning model
  ☆91Updated 2 months ago
• NousResearch / atropos
  Atropos is a Language Model Reinforcement Learning Environments framework for collecting and evaluating LLM trajectories through diverse …
  ☆257Updated this week
• LeonGuertler / TextArena
  A Collection of Competitive Text-Based Games for Language Model Evaluation and Reinforcement Learning
  ☆150Updated last week
• Danau5tin / calculator_agent_rl
  Training an LLM to use a calculator with multi-turn reinforcement learning, achieving a **62% absolute increase in evaluation accuracy**.
  ☆17Updated last week
• ScalingIntelligence / Archon
  Archon provides a modular framework for combining different inference-time techniques and LMs with just a JSON config file.
  ☆172Updated 2 months ago
• ConsequentAI / fneval
  Functional Benchmarks and the Reasoning Gap
  ☆85Updated 7 months ago
• agora-protocol / paper-demo
  ☆147Updated 2 months ago
• goodfire-ai / r1-interpretability
  Open source interpretability artefacts for R1.
  ☆105Updated 2 weeks ago
• princeton-pli / hal-harness
  ☆73Updated this week
• willccbb / claude-code-mcp
  Letting Claude Code develop his own MCP tools :)
  ☆98Updated last month
• haizelabs / dspy-redteam
  Red-Teaming Language Models with DSPy
  ☆188Updated 2 months ago
• BhabhaAI / dataformer
  Solving data for LLMs - Create quality synthetic datasets!
  ☆146Updated 3 months ago
• automix-llm / automix
  Mixing Language Models with Self-Verification and Meta-Verification
  ☆104Updated 4 months ago
• Arize-ai / LLMTest_NeedleInAHaystack
  Doing simple retrieval from LLM models at various context lengths to measure accuracy
  ☆99Updated last year
• haizelabs / sphynx
  Sphynx Hallucination Induction
  ☆54Updated 3 months ago
• zorazrw / agent-workflow-memory
  AWM: Agent Workflow Memory
  ☆269Updated 3 months ago
• AnswerDotAI / fastdata
  ☆151Updated 5 months ago
• letta-ai / sleep-time-compute
  accompanying material for sleep-time compute paper
  ☆77Updated last week
• jerber / arc_agi
  ☆54Updated 3 months ago
• Mihaiii / backtrack_sampler
  An easy-to-understand framework for LLM samplers that rewind and revise generated tokens
  ☆139Updated 2 months ago
• google-deepmind / mishax
  ☆130Updated last month
• zenbase-ai / py-priompt
  Prompt design in Python
  ☆57Updated 5 months ago
• allenai / infinigram-api
  ☆55Updated this week
• haizelabs / bijection-learning
  ☆22Updated 6 months ago
• ServiceNow / TapeAgents
  TapeAgents is a framework that facilitates all stages of the LLM Agent development lifecycle
  ☆264Updated this week