Alternatives and similar repositories for JUDGE-BENCH

Users that are interested in JUDGE-BENCH are comparing it to the libraries listed below

• kayoyin / interpret-lm
  Interpreting Language Models with Contrastive Explanations (EMNLP 2022 Best Paper Honorable Mention)
  ☆62Updated 3 years ago
• jzbjyb / lm-calibration
  ☆35Updated 3 years ago
• martiansideofthemoon / longeval-summarization
  Official repository for our EACL 2023 paper "LongEval: Guidelines for Human Evaluation of Faithfulness in Long-form Summarization" (https…
  ☆44Updated last year
• violet-zct / fairseq-detect-hallucination
  Detect hallucinated tokens for conditional sequence generation.
  ☆64Updated 3 years ago
• Betswish / MIRAGE
  Easy-to-use MIRAGE code for faithful answer attribution in RAG applications. Paper: https://aclanthology.org/2024.emnlp-main.347/
  ☆25Updated 6 months ago
• chaitanyamalaviya / ExpertQA
  [Data + code] ExpertQA : Expert-Curated Questions and Attributed Answers
  ☆133Updated last year
• McGill-NLP / instruct-qa
  Code and Data for "Evaluating Correctness and Faithfulness of Instruction-Following Models for Question Answering"
  ☆86Updated last year
• inspired-cognition / critique-apps
  Apps built using Inspired Cognition's Critique.
  ☆58Updated 2 years ago
• cambridgeltl / composable-sft
  A library for parameter-efficient and composable transfer learning for NLP with sparse fine-tunings.
  ☆74Updated last year
• microsoft / HaDes
  Token-level Reference-free Hallucination Detection
  ☆96Updated 2 years ago
• davidheineman / thresh
  🌾 Universal, customizable and deployable fine-grained evaluation for text generation.
  ☆23Updated last year
• google-deepmind / streamingqa
  ☆49Updated last year
• awebson / prompt_semantics
  This repository accompanies our paper “Do Prompt-Based Models Really Understand the Meaning of Their Prompts?”
  ☆85Updated 3 years ago
• jennhu / metalinguistic-prompting
  Materials for "Prompting is not a substitute for probability measurements in large language models" (EMNLP 2023)
  ☆24Updated last year
• sunlab-osu / ReasonBERT
  Code and pre-trained models for "ReasonBert: Pre-trained to Reason with Distant Supervision", EMNLP'2021
  ☆29Updated 2 years ago
• ThomasScialom / QuestEval
  ☆100Updated last year
• google-research / true
  Code and data accompanying the paper "TRUE: Re-evaluating Factual Consistency Evaluation".
  ☆81Updated 2 months ago
• yanaiela / pararel
  ☆45Updated last year
• ZurichNLP / mbr
  Minimum Bayes Risk Decoding for Hugging Face Transformers
  ☆59Updated last year
• r-three / fib
  ☆26Updated 2 years ago
• OSU-NLP-Group / AttrScore
  Code, datasets, models for the paper "Automatic Evaluation of Attribution by Large Language Models"
  ☆56Updated 2 years ago
• mbzuai-nlp / bactrian-x
  A Multilingual Replicable Instruction-Following Model
  ☆95Updated 2 years ago
• gsarti / pecore
  Materials for "Quantifying the Plausibility of Context Reliance in Neural Machine Translation" at ICLR'24 🐑 🐑
  ☆15Updated last year
• salesforce / factualNLG
  Code for the arXiv paper: "LLMs as Factual Reasoners: Insights from Existing Benchmarks and Beyond"
  ☆59Updated 7 months ago
• faridlazuarda / cultural-llm-papers
  A curated list of research papers and resources on Cultural LLM.
  ☆48Updated 11 months ago
• hitz-zentroa / lm-contamination
  The LM Contamination Index is a manually created database of contamination evidences for LMs.
  ☆80Updated last year
• ryokamoi / wice
  This repository contains the dataset and code for "WiCE: Real-World Entailment for Claims in Wikipedia" in EMNLP 2023.
  ☆42Updated last year
• mt-upc / transformer-contributions
  Measuring the Mixing of Contextual Information in the Transformer
  ☆31Updated 2 years ago
• shayne-longpre / a-pretrainers-guide
  ☆72Updated 2 years ago
• nkandpa2 / long_tail_knowledge
  Repo for the paper "Large Language Models Struggle to Learn Long-Tail Knowledge"
  ☆78Updated 2 years ago