Alternatives and similar repositories for benchmark_llm_summarization

Users that are interested in benchmark_llm_summarization are comparing it to the libraries listed below

• salesforce / factualNLG
  Code for the arXiv paper: "LLMs as Factual Reasoners: Insights from Existing Benchmarks and Beyond"
  ☆61Updated 11 months ago
• microsoft / HaDes
  Token-level Reference-free Hallucination Detection
  ☆97Updated 2 years ago
• google-research / true
  Code and data accompanying the paper "TRUE: Re-evaluating Factual Consistency Evaluation".
  ☆82Updated this week
• eladsegal / strategyqa
  The official code of TACL 2021, "Did Aristotle Use a Laptop? A Question Answering Benchmark with Implicit Reasoning Strategies".
  ☆82Updated 3 years ago
• yzjiao / On-Demand-IE
  Code and dataset for the emnlp paper titled Instruct and Extract: Instruction Tuning for On-Demand Information Extraction
  ☆54Updated 2 years ago
• OSU-NLP-Group / AttrScore
  Code, datasets, models for the paper "Automatic Evaluation of Attribution by Large Language Models"
  ☆56Updated 2 years ago
• sunlab-osu / Understanding-CoT
  ☆88Updated 2 years ago
• nelson-liu / evaluating-verifiability-in-generative-search-engines
  Companion repo for "Evaluating Verifiability in Generative Search Engines".
  ☆85Updated 2 years ago
• McGill-NLP / instruct-qa
  Code and Data for "Evaluating Correctness and Faithfulness of Instruction-Following Models for Question Answering"
  ☆87Updated last year
• yuh-zha / AlignScore
  ACL2023 - AlignScore, a metric for factual consistency evaluation.
  ☆148Updated last year
• OpenMatch / COCO-DR
  [EMNLP 2022] This is the code repo for our EMNLP‘22 paper "COCO-DR: Combating Distribution Shifts in Zero-Shot Dense Retrieval with Contr…
  ☆50Updated 2 years ago
• salesforce / QAFactEval
  ☆55Updated 2 years ago
• epfl-dlab / SynthIE
  The data and the PyTorch implementation for the models and experiments in the paper "Exploiting Asymmetry for Synthetic Training Data Gen…
  ☆64Updated 2 years ago
• AlexTMallen / adaptive-retrieval
  ☆188Updated 6 months ago
• ryokamoi / wice
  This repository contains the dataset and code for "WiCE: Real-World Entailment for Claims in Wikipedia" in EMNLP 2023.
  ☆42Updated 2 years ago
• osainz59 / t5-encoder
  A extension of Transformers library to include T5ForSequenceClassification class.
  ☆40Updated 2 years ago
• chaitanyamalaviya / ExpertQA
  [Data + code] ExpertQA : Expert-Curated Questions and Attributed Answers
  ☆137Updated last year
• realtimeqa / realtimeqa_public
  ☆83Updated last month
• zhudotexe / fanoutqa
  Companion code for FanOutQA: Multi-Hop, Multi-Document Question Answering for Large Language Models (ACL 2024)
  ☆58Updated 3 months ago
• awebson / prompt_semantics
  This repository accompanies our paper “Do Prompt-Based Models Really Understand the Meaning of Their Prompts?”
  ☆85Updated 3 years ago
• Yale-LILY / FeTaQA
  Dataset for TACL 2022 paper: "FeTaQA: Free-form Table Question Answering"
  ☆85Updated 2 years ago
• NExTplusplus / TAT-QA
  TAT-QA (Tabular And Textual dataset for Question Answering) contains 16,552 questions associated with 2,757 hybrid contexts from real-wor…
  ☆124Updated last year
• wzhouad / context-faithful-llm
  Code and data for paper "Context-faithful Prompting for Large Language Models".
  ☆41Updated 2 years ago
• violet-zct / fairseq-detect-hallucination
  Detect hallucinated tokens for conditional sequence generation.
  ☆64Updated 3 years ago
• nayeon7lee / FactualityPrompt
  ☆88Updated 3 years ago
• ielab / PromptReps
  Prompting Large Language Models to Generate Dense and Sparse Representations for Zero-Shot Document Retrieval
  ☆51Updated this week
• project-miracl / hagrid
  A Human-LLM Collaborative Dataset for Generative Information-seeking with Attribution
  ☆35Updated 2 years ago
• microsoft / HiTab
  [ACL 2022] A hierarchical table dataset for question answering and data-to-text generation.
  ☆104Updated 3 weeks ago
• hitz-zentroa / lm-contamination
  The LM Contamination Index is a manually created database of contamination evidences for LMs.
  ☆82Updated last year
• nicola-decao / KnowledgeEditor
  Code for Editing Factual Knowledge in Language Models
  ☆142Updated 3 years ago