Alternatives and similar repositories for JUDGE-BENCH

Users that are interested in JUDGE-BENCH are comparing it to the libraries listed below

• inspired-cognition / critique-apps
  Apps built using Inspired Cognition's Critique.
  ☆57Updated 2 years ago
• martiansideofthemoon / longeval-summarization
  Official repository for our EACL 2023 paper "LongEval: Guidelines for Human Evaluation of Faithfulness in Long-form Summarization" (https…
  ☆44Updated last year
• kayoyin / interpret-lm
  Interpreting Language Models with Contrastive Explanations (EMNLP 2022 Best Paper Honorable Mention)
  ☆62Updated 3 years ago
• awebson / prompt_semantics
  This repository accompanies our paper “Do Prompt-Based Models Really Understand the Meaning of Their Prompts?”
  ☆86Updated 3 years ago
• davidheineman / thresh
  🌾 Universal, customizable and deployable fine-grained evaluation for text generation.
  ☆24Updated 2 years ago
• jennhu / metalinguistic-prompting
  Materials for "Prompting is not a substitute for probability measurements in large language models" (EMNLP 2023)
  ☆24Updated 2 years ago
• google-research / true
  Code and data accompanying the paper "TRUE: Re-evaluating Factual Consistency Evaluation".
  ☆82Updated 2 weeks ago
• mbzuai-nlp / bactrian-x
  A Multilingual Replicable Instruction-Following Model
  ☆95Updated 2 years ago
• jzbjyb / lm-calibration
  ☆35Updated 4 years ago
• faridlazuarda / cultural-llm-papers
  A curated list of research papers and resources on Cultural LLM.
  ☆52Updated last year
• r-three / fib
  ☆26Updated 3 years ago
• hitz-zentroa / lm-contamination
  The LM Contamination Index is a manually created database of contamination evidences for LMs.
  ☆82Updated last year
• microsoft / HaDes
  Token-level Reference-free Hallucination Detection
  ☆97Updated 2 years ago
• Betswish / MIRAGE
  Easy-to-use MIRAGE code for faithful answer attribution in RAG applications. Paper: https://aclanthology.org/2024.emnlp-main.347/
  ☆26Updated 9 months ago
• alexa / ramen
  A software for transferring pre-trained English models to foreign languages
  ☆19Updated 2 years ago
• rudinger / winogender-schemas
  Data for evaluating gender bias in coreference resolution systems.
  ☆81Updated 6 years ago
• McGill-NLP / instruct-qa
  Code and Data for "Evaluating Correctness and Faithfulness of Instruction-Following Models for Question Answering"
  ☆87Updated last year
• MadryLab / AT2
  Attribute statements generated by LLMs to preceding tokens using attention weights.
  ☆21Updated 8 months ago
• yanaiela / pararel
  ☆47Updated last year
• ryokamoi / wice
  This repository contains the dataset and code for "WiCE: Real-World Entailment for Claims in Wikipedia" in EMNLP 2023.
  ☆42Updated 2 years ago
• ritikamangla / QSalience
  https://arxiv.org/abs/2404.10917
  ☆14Updated 9 months ago
• claws-lab / XLingEval
  Code and Resources for the paper, "Better to Ask in English: Cross-Lingual Evaluation of Large Language Models for Healthcare Queries"
  ☆19Updated last year
• salesforce / creativity_eval
  ☆39Updated 3 months ago
• chaitanyamalaviya / ExpertQA
  [Data + code] ExpertQA : Expert-Curated Questions and Attributed Answers
  ☆136Updated last year
• cambridgeltl / composable-sft
  A library for parameter-efficient and composable transfer learning for NLP with sparse fine-tunings.
  ☆75Updated last year
• ekinakyurek / influence
  Code for "Tracing Knowledge in Language Models Back to the Training Data"
  ☆39Updated 3 years ago
• google-research-datasets / AIS
  AIS is an evaluation framework for assessing whether the output of natural language models only contains information about the external w…
  ☆31Updated 2 years ago
• shayne-longpre / a-pretrainers-guide
  ☆72Updated 2 years ago
• g8a9 / ear
  Code associated with the paper "Entropy-based Attention Regularization Frees Unintended Bias Mitigation from Lists"
  ☆50Updated 3 years ago
• google-deepmind / streamingqa
  ☆49Updated 2 years ago