Alternatives and similar repositories for LLM-as-a-Judge:

Users that are interested in LLM-as-a-Judge are comparing it to the libraries listed below

• abhika-m / FAVA
  ☆66Updated last year
• weizhepei / InstructRAG
  [ICLR 2025] InstructRAG: Instructing Retrieval-Augmented Generation via Self-Synthesized Rationales
  ☆71Updated last week
• OpenMatch / ActiveRAG
  This is the code repo for our paper "Autonomously Knowledge Assimilation and Accommodation through Retrieval-Augmented Agents".
  ☆102Updated 3 months ago
• TIGER-AI-Lab / MAmmoTH2
  Official code for "MAmmoTH2: Scaling Instructions from the Web" [NeurIPS 2024]
  ☆135Updated 3 months ago
• tianyang-x / SaySelf
  Public code repo for paper "SaySelf: Teaching LLMs to Express Confidence with Self-Reflective Rationales"
  ☆98Updated 4 months ago
• WHGTyen / BIG-Bench-Mistake
  A dataset of LLM-generated chain-of-thought steps annotated with mistake location.
  ☆77Updated 6 months ago
• OSU-NLP-Group / LLM-Knowledge-Conflict
  [ICLR'24 Spotlight] "Adaptive Chameleon or Stubborn Sloth: Revealing the Behavior of Large Language Models in Knowledge Conflicts"
  ☆65Updated 10 months ago
• salesforce / summary-of-a-haystack
  Codebase accompanying the Summary of a Haystack paper.
  ☆74Updated 4 months ago
• Hannibal046 / xRAG
  [Neurips2024] Source code for xRAG: Extreme Context Compression for Retrieval-augmented Generation with One Token
  ☆116Updated 7 months ago
• OSU-NLP-Group / llm-planning-eval
  [ACL'24] Code and data of paper "When is Tree Search Useful for LLM Planning? It Depends on the Discriminator"
  ☆54Updated 11 months ago
• oriyor / reasoning-on-cots
  Implementation of the paper: "Answering Questions by Meta-Reasoning over Multiple Chains of Thought"
  ☆93Updated last year
• GAIR-NLP / scaleeval
  Scalable Meta-Evaluation of LLMs as Evaluators
  ☆43Updated last year
• MozerWang / Loong
  [EMNLP 2024 (Oral)] Leave No Document Behind: Benchmarking Long-Context LLMs with Extended Multi-Doc QA
  ☆111Updated 3 months ago
• GAIR-NLP / ReAlign
  Reformatted Alignment
  ☆114Updated 4 months ago
• shizhediao / R-Tuning
  [NAACL 2024 Outstanding Paper] Source code for the NAACL 2024 paper entitled "R-Tuning: Instructing Large Language Models to Say 'I Don't…
  ☆108Updated 7 months ago
• Anni-Zou / Meta-CoT
  Meta-CoT: Generalizable Chain-of-Thought Prompting in Mixed-task Scenarios with Large Language Models
  ☆94Updated last year
• DAMO-NLP-SG / contrastive-cot
  Contrastive Chain-of-Thought Prompting
  ☆58Updated last year
• Dereck0602 / Awesome_Test_Time_LLMs
  ☆64Updated 2 weeks ago
• Open-Source-O1 / o1_Reasoning_Patterns_Study
  ☆98Updated 2 months ago
• lifan-yuan / CRAFT
  Code for ICLR 2024 paper "CRAFT: Customizing LLMs by Creating and Retrieving from Specialized Toolsets"
  ☆51Updated 8 months ago
• ZitongYang / Synthetic_Continued_Pretraining
  Code implementation of synthetic continued pretraining
  ☆87Updated last month
• gpt4life / alpagasus
  Unofficial implementation of AlpaGasus
  ☆90Updated last year
• sail-sg / CPO
  [NeurIPS 2024] The official implementation of paper: Chain of Preference Optimization: Improving Chain-of-Thought Reasoning in LLMs.
  ☆94Updated 4 months ago
• SALT-NLP / demonstrated-feedback
  ☆117Updated 4 months ago
• zankner / CLoud
  Critique-out-Loud Reward Models
  ☆51Updated 4 months ago
• rxlqn / awesome-llm-self-reflection
  augmented LLM with self reflection
  ☆111Updated last year
• qhjqhj00 / WebBrain
  ☆69Updated last year
• chujiezheng / LLM-Extrapolation
  Official repository for paper "Weak-to-Strong Extrapolation Expedites Alignment"
  ☆72Updated 8 months ago
• princeton-nlp / LLMBar
  [ICLR 2024] Evaluating Large Language Models at Evaluating Instruction Following
  ☆119Updated 7 months ago