Alternatives and similar repositories for benchmark_llm_summarization:

Users that are interested in benchmark_llm_summarization are comparing it to the libraries listed below

• wenhuchen / Time-Sensitive-QA
  Code and Data for NeurIPS2021 Paper "A Dataset for Answering Time-Sensitive Questions"
  ☆66Updated 2 years ago
• microsoft / HaDes
  Token-level Reference-free Hallucination Detection
  ☆93Updated last year
• oriram / spider
  ☆55Updated 2 years ago
• salesforce / factualNLG
  Code for the arXiv paper: "LLMs as Factual Reasoners: Insights from Existing Benchmarks and Beyond"
  ☆59Updated 9 months ago
• project-miracl / hagrid
  A Human-LLM Collaborative Dataset for Generative Information-seeking with Attribution
  ☆30Updated last year
• wzhouad / context-faithful-llm
  Code and data for paper "Context-faithful Prompting for Large Language Models".
  ☆39Updated last year
• OSU-NLP-Group / AttrScore
  Code, datasets, models for the paper "Automatic Evaluation of Attribution by Large Language Models"
  ☆53Updated last year
• sunlab-osu / Understanding-CoT
  ☆85Updated last year
• ryokamoi / wice
  This repository contains the dataset and code for "WiCE: Real-World Entailment for Claims in Wikipedia" in EMNLP 2023.
  ☆40Updated last year
• sean0042 / Open_WikiTable
  Open-WikiTable :Dataset for Open Domain Question Answering with Complex Reasoning over Table
  ☆22Updated last year
• yzjiao / On-Demand-IE
  Code and dataset for the emnlp paper titled Instruct and Extract: Instruction Tuning for On-Demand Information Extraction
  ☆50Updated last year
• violet-zct / fairseq-detect-hallucination
  Detect hallucinated tokens for conditional sequence generation.
  ☆64Updated 2 years ago
• jzbjyb / ReAtt
  Retrieval as Attention
  ☆83Updated 2 years ago
• epfl-dlab / SynthIE
  The data and the PyTorch implementation for the models and experiments in the paper "Exploiting Asymmetry for Synthetic Training Data Gen…
  ☆60Updated last year
• google-research / true
  Code and data accompanying the paper "TRUE: Re-evaluating Factual Consistency Evaluation".
  ☆73Updated 2 months ago
• nelson-liu / evaluating-verifiability-in-generative-search-engines
  Companion repo for "Evaluating Verifiability in Generative Search Engines".
  ☆82Updated last year
• eladsegal / strategyqa
  The official code of TACL 2021, "Did Aristotle Use a Laptop? A Question Answering Benchmark with Implicit Reasoning Strategies".
  ☆65Updated 2 years ago
• awebson / prompt_semantics
  This repository accompanies our paper “Do Prompt-Based Models Really Understand the Meaning of Their Prompts?”
  ☆85Updated 2 years ago
• hitz-zentroa / lm-contamination
  The LM Contamination Index is a manually created database of contamination evidences for LMs.
  ☆75Updated 9 months ago
• salesforce / QAFactEval
  ☆44Updated last year
• xu1998hz / InstructScore_SEScore3
  First explanation metric (diagnostic report) for text generation evaluation
  ☆62Updated 6 months ago
• swj0419 / kNN_prompt
  TBC
  ☆26Updated 2 years ago
• xlang-ai / BRIGHT
  BRIGHT: A Realistic and Challenging Benchmark for Reasoning-Intensive Retrieval
  ☆66Updated 2 weeks ago
• StonyBrookNLP / musique
  Repository for MuSiQue: Multi-hop Questions via Single-hop Question Composition, TACL 2022
  ☆102Updated 7 months ago
• yanaiela / pararel
  ☆42Updated 11 months ago
• Yale-LILY / ROSE
  ☆36Updated last year
• oriyor / ret-robust
  Implementation of the paper: "Making Retrieval-Augmented Language Models Robust to Irrelevant Context"
  ☆65Updated 5 months ago
• McGill-NLP / instruct-qa
  Code and Data for "Evaluating Correctness and Faithfulness of Instruction-Following Models for Question Answering"
  ☆82Updated 5 months ago
• Alab-NII / 2wikimultihop
  ☆81Updated last year
• NeuraSearch / NeurIPS-2022-Submission-3358
  This is the code for the Submission 3358 at NeurIPS 2022.
  ☆21Updated 2 years ago