Alternatives and similar repositories for benchmark_llm_summarization:

Users that are interested in benchmark_llm_summarization are comparing it to the libraries listed below

• OSU-NLP-Group / AttrScore
  Code, datasets, models for the paper "Automatic Evaluation of Attribution by Large Language Models"
  ☆56Updated last year
• Betswish / MIRAGE
  Easy-to-use MIRAGE code for faithful answer attribution in RAG applications. Paper: https://aclanthology.org/2024.emnlp-main.347/
  ☆21Updated 2 weeks ago
• ryokamoi / wice
  This repository contains the dataset and code for "WiCE: Real-World Entailment for Claims in Wikipedia" in EMNLP 2023.
  ☆41Updated last year
• microsoft / HaDes
  Token-level Reference-free Hallucination Detection
  ☆94Updated last year
• project-miracl / hagrid
  A Human-LLM Collaborative Dataset for Generative Information-seeking with Attribution
  ☆30Updated last year
• yuzhaouoe / pretraining-data-packing
  [ACL'24 Oral] Analysing The Impact of Sequence Composition on Language Model Pre-Training
  ☆19Updated 7 months ago
• salesforce / QAFactEval
  ☆44Updated last year
• XinyuanLu00 / SciTab
  The project page for "SCITAB: A Challenging Benchmark for Compositional Reasoning and Claim Verification on Scientific Tables"
  ☆20Updated last year
• oriram / spider
  ☆54Updated 2 years ago
• eladsegal / strategyqa
  The official code of TACL 2021, "Did Aristotle Use a Laptop? A Question Answering Benchmark with Implicit Reasoning Strategies".
  ☆69Updated 2 years ago
• sunlab-osu / Understanding-CoT
  ☆86Updated last year
• kayoyin / interpret-lm
  Interpreting Language Models with Contrastive Explanations (EMNLP 2022 Best Paper Honorable Mention)
  ☆62Updated 2 years ago
• nelson-liu / evaluating-verifiability-in-generative-search-engines
  Companion repo for "Evaluating Verifiability in Generative Search Engines".
  ☆83Updated last year
• xu1998hz / InstructScore_SEScore3
  First explanation metric (diagnostic report) for text generation evaluation
  ☆62Updated 3 weeks ago
• wzhouad / context-faithful-llm
  Code and data for paper "Context-faithful Prompting for Large Language Models".
  ☆39Updated 2 years ago
• yanaiela / pararel
  ☆44Updated last year
• epfl-dlab / SynthIE
  The data and the PyTorch implementation for the models and experiments in the paper "Exploiting Asymmetry for Synthetic Training Data Gen…
  ☆60Updated last year
• OpenMatch / COCO-DR
  [EMNLP 2022] This is the code repo for our EMNLP‘22 paper "COCO-DR: Combating Distribution Shifts in Zero-Shot Dense Retrieval with Contr…
  ☆49Updated last year
• krystalan / chatgpt_as_nlg_evaluator
  Technical Report: Is ChatGPT a Good NLG Evaluator? A Preliminary Study
  ☆43Updated 2 years ago
• oriyor / ret-robust
  Implementation of the paper: "Making Retrieval-Augmented Language Models Robust to Irrelevant Context"
  ☆65Updated 7 months ago
• google-research / true
  Code and data accompanying the paper "TRUE: Re-evaluating Factual Consistency Evaluation".
  ☆76Updated 2 weeks ago
• chaitanyamalaviya / ExpertQA
  [Data + code] ExpertQA : Expert-Curated Questions and Attributed Answers
  ☆126Updated last year
• jzbjyb / lm-calibration
  ☆34Updated 3 years ago
• chaochun / nlu-asdiv-dataset
  ☆47Updated last year
• ielab / PromptReps
  Prompting Large Language Models to Generate Dense and Sparse Representations for Zero-Shot Document Retrieval
  ☆43Updated 5 months ago
• swj0419 / kNN_prompt
  TBC
  ☆26Updated 2 years ago
• Nanami18 / Snowballed_Hallucination
  ☆44Updated 6 months ago
• jaehunjung1 / Maieutic-Prompting
  ☆50Updated last year
• salesforce / factualNLG
  Code for the arXiv paper: "LLMs as Factual Reasoners: Insights from Existing Benchmarks and Beyond"
  ☆59Updated last month
• hitz-zentroa / lm-contamination
  The LM Contamination Index is a manually created database of contamination evidences for LMs.
  ☆77Updated 11 months ago