Alternatives and similar repositories for benchmark_llm_summarization:

Users that are interested in benchmark_llm_summarization are comparing it to the libraries listed below

• microsoft / HaDes
  Token-level Reference-free Hallucination Detection
  ☆94Updated last year
• oriram / spider
  ☆55Updated 2 years ago
• salesforce / factualNLG
  Code for the arXiv paper: "LLMs as Factual Reasoners: Insights from Existing Benchmarks and Beyond"
  ☆59Updated 3 weeks ago
• ryokamoi / wice
  This repository contains the dataset and code for "WiCE: Real-World Entailment for Claims in Wikipedia" in EMNLP 2023.
  ☆40Updated last year
• OSU-NLP-Group / AttrScore
  Code, datasets, models for the paper "Automatic Evaluation of Attribution by Large Language Models"
  ☆54Updated last year
• nicola-decao / KnowledgeEditor
  Code for Editing Factual Knowledge in Language Models
  ☆136Updated 3 years ago
• epfl-dlab / SynthIE
  The data and the PyTorch implementation for the models and experiments in the paper "Exploiting Asymmetry for Synthetic Training Data Gen…
  ☆60Updated last year
• bigscience-workshop / lm-evaluation-harness
  A framework for few-shot evaluation of autoregressive language models.
  ☆102Updated last year
• yumeng5 / SuperGen
  [NeurIPS 2022] Generating Training Data with Language Models: Towards Zero-Shot Language Understanding
  ☆64Updated 2 years ago
• osainz59 / t5-encoder
  A extension of Transformers library to include T5ForSequenceClassification class.
  ☆37Updated last year
• google-research / true
  Code and data accompanying the paper "TRUE: Re-evaluating Factual Consistency Evaluation".
  ☆75Updated 3 months ago
• jzbjyb / ReAtt
  Retrieval as Attention
  ☆83Updated 2 years ago
• eladsegal / strategyqa
  The official code of TACL 2021, "Did Aristotle Use a Laptop? A Question Answering Benchmark with Implicit Reasoning Strategies".
  ☆66Updated 2 years ago
• sunlab-osu / Understanding-CoT
  ☆85Updated last year
• teacherpeterpan / ProgramFC
  Codes for ACL 2023 Paper "Fact-Checking Complex Claims with Program-Guided Reasoning"
  ☆29Updated last year
• realtimeqa / realtimeqa_public
  ☆71Updated last year
• wzhouad / context-faithful-llm
  Code and data for paper "Context-faithful Prompting for Large Language Models".
  ☆39Updated last year
• DevSinghSachan / unsupervised-passage-reranking
  Code, datasets, and checkpoints for the paper "Improving Passage Retrieval with Zero-Shot Question Generation (EMNLP 2022)"
  ☆100Updated 2 years ago
• sean0042 / Open_WikiTable
  Open-WikiTable :Dataset for Open Domain Question Answering with Complex Reasoning over Table
  ☆22Updated last year
• Yale-LILY / ROSE
  ☆37Updated last year
• orionw / FollowIR
  FollowIR: Evaluating and Teaching Information Retrieval Models to Follow Instructions
  ☆42Updated 7 months ago
• McGill-NLP / instruct-qa
  Code and Data for "Evaluating Correctness and Faithfulness of Instruction-Following Models for Question Answering"
  ☆83Updated 6 months ago
• swj0419 / in-context-pretraining
  ☆47Updated 10 months ago
• mireshghallah / mixmatch
  Repository for ACL 2022 paper Mix and Match: Learning-free Controllable Text Generation using Energy Language Models
  ☆41Updated 2 years ago
• xsc1234 / Search-in-the-Chain
  Code for Search-in-the-Chain: Towards Accurate, Credible and Traceable Large Language Models for Knowledge-intensive Tasks
  ☆54Updated 10 months ago
• unicamp-dl / ExaRanker
  ☆29Updated last year
• oriyor / ret-robust
  Implementation of the paper: "Making Retrieval-Augmented Language Models Robust to Irrelevant Context"
  ☆66Updated 6 months ago
• wenhuchen / Time-Sensitive-QA
  Code and Data for NeurIPS2021 Paper "A Dataset for Answering Time-Sensitive Questions"
  ☆66Updated 2 years ago
• salesforce / QAFactEval
  ☆44Updated last year
• martiansideofthemoon / longeval-summarization
  Official repository for our EACL 2023 paper "LongEval: Guidelines for Human Evaluation of Faithfulness in Long-form Summarization" (https…
  ☆43Updated 6 months ago