Alternatives and similar repositories for LLM-as-a-Judge:

Users that are interested in LLM-as-a-Judge are comparing it to the libraries listed below

• abhika-m / FAVA
  ☆62Updated 10 months ago
• weizhepei / InstructRAG
  InstructRAG: Instructing Retrieval-Augmented Generation via Self-Synthesized Rationales
  ☆64Updated last month
• salesforce / summary-of-a-haystack
  Codebase accompanying the Summary of a Haystack paper.
  ☆75Updated 3 months ago
• TIGER-AI-Lab / MAmmoTH2
  Official code for "MAmmoTH2: Scaling Instructions from the Web" [NeurIPS 2024]
  ☆129Updated 2 months ago
• OSU-NLP-Group / llm-planning-eval
  [ACL'24] Code and data of paper "When is Tree Search Useful for LLM Planning? It Depends on the Discriminator"
  ☆52Updated 10 months ago
• oriyor / reasoning-on-cots
  Implementation of the paper: "Answering Questions by Meta-Reasoning over Multiple Chains of Thought"
  ☆94Updated 11 months ago
• SALT-NLP / demonstrated-feedback
  ☆113Updated 3 months ago
• kaistAI / Janus
  [NeurIPS 2024] Train LLMs with diverse system messages reflecting individualized preferences to generalize to unseen system messages
  ☆41Updated last month
• GAIR-NLP / scaleeval
  Scalable Meta-Evaluation of LLMs as Evaluators
  ☆42Updated 10 months ago
• OpenMatch / ActiveRAG
  This is the code repo for our paper "Autonomously Knowledge Assimilation and Accommodation through Retrieval-Augmented Agents".
  ☆102Updated 2 months ago
• awslabs / rag-qa-arena
  ☆33Updated 4 months ago
• princeton-nlp / LitSearch
  [EMNLP 2024] A Retrieval Benchmark for Scientific Literature Search
  ☆69Updated last month
• kyegomez / Lets-Verify-Step-by-Step
  "Improving Mathematical Reasoning with Process Supervision" by OPENAI
  ☆97Updated 3 weeks ago
• xsc1234 / Search-in-the-Chain
  Code for Search-in-the-Chain: Towards Accurate, Credible and Traceable Large Language Models for Knowledge-intensive Tasks
  ☆50Updated 9 months ago
• qhjqhj00 / WebBrain
  ☆69Updated last year
• ryokamoi / llm-self-correction-papers
  List of papers on Self-Correction of LLMs.
  ☆70Updated 2 weeks ago
• shizhediao / R-Tuning
  [NAACL 2024 Outstanding Paper] Source code for the NAACL 2024 paper entitled "R-Tuning: Instructing Large Language Models to Say 'I Don't…
  ☆104Updated 6 months ago
• jwhj / OREO
  ☆76Updated 2 weeks ago
• Raibows / Learn-to-Reason
  Code for "Democratizing Reasoning Ability: Tailored Learning from Large Language Model", EMNLP 2023
  ☆31Updated last year
• lifan-yuan / CRAFT
  Code for ICLR 2024 paper "CRAFT: Customizing LLMs by Creating and Retrieving from Specialized Toolsets"
  ☆50Updated 7 months ago
• xlang-ai / BRIGHT
  BRIGHT: A Realistic and Challenging Benchmark for Reasoning-Intensive Retrieval
  ☆64Updated last week
• zankner / CLoud
  Critique-out-Loud Reward Models
  ☆46Updated 2 months ago
• McGill-NLP / instruct-qa
  Code and Data for "Evaluating Correctness and Faithfulness of Instruction-Following Models for Question Answering"
  ☆82Updated 4 months ago
• OSU-NLP-Group / LLM-Knowledge-Conflict
  [ICLR'24 Spotlight] "Adaptive Chameleon or Stubborn Sloth: Revealing the Behavior of Large Language Models in Knowledge Conflicts"
  ☆63Updated 8 months ago
• Anni-Zou / Meta-CoT
  Meta-CoT: Generalizable Chain-of-Thought Prompting in Mixed-task Scenarios with Large Language Models
  ☆88Updated last year
• oriyor / ret-robust
  Implementation of the paper: "Making Retrieval-Augmented Language Models Robust to Irrelevant Context"
  ☆65Updated 5 months ago
• cambridgeltl / PairS
  Aligning with Human Judgement: The Role of Pairwise Preference in Large Language Model Evaluators (Liu et al.; arXiv preprint arXiv:2403.…
  ☆40Updated 2 weeks ago
• ZitongYang / Synthetic_Continued_Pretraining
  Code implementation of synthetic continued pretraining
  ☆75Updated this week
• princeton-nlp / LLMBar
  [ICLR 2024] Evaluating Large Language Models at Evaluating Instruction Following
  ☆120Updated 6 months ago
• facebookresearch / CRAG
  Comprehensive benchmark for RAG
  ☆91Updated 2 months ago