Alternatives and similar repositories for benchmark_llm_summarization

Users that are interested in benchmark_llm_summarization are comparing it to the libraries listed below

• ryokamoi / wice
  This repository contains the dataset and code for "WiCE: Real-World Entailment for Claims in Wikipedia" in EMNLP 2023.
  ☆41Updated last year
• microsoft / HaDes
  Token-level Reference-free Hallucination Detection
  ☆94Updated last year
• wzhouad / context-faithful-llm
  Code and data for paper "Context-faithful Prompting for Large Language Models".
  ☆39Updated 2 years ago
• salesforce / factualNLG
  Code for the arXiv paper: "LLMs as Factual Reasoners: Insights from Existing Benchmarks and Beyond"
  ☆59Updated 3 months ago
• yzjiao / On-Demand-IE
  Code and dataset for the emnlp paper titled Instruct and Extract: Instruction Tuning for On-Demand Information Extraction
  ☆52Updated last year
• google-deepmind / streamingqa
  ☆46Updated last year
• OSU-NLP-Group / AttrScore
  Code, datasets, models for the paper "Automatic Evaluation of Attribution by Large Language Models"
  ☆56Updated last year
• oriram / spider
  ☆54Updated 2 years ago
• sunlab-osu / Understanding-CoT
  ☆86Updated last year
• epfl-dlab / SynthIE
  The data and the PyTorch implementation for the models and experiments in the paper "Exploiting Asymmetry for Synthetic Training Data Gen…
  ☆61Updated last year
• ZihanWangKi / GoalEx
  Implementation of the Paper "Goal-Driven Explainable Clustering via Language Descriptions"
  ☆36Updated last year
• McGill-NLP / instruct-qa
  Code and Data for "Evaluating Correctness and Faithfulness of Instruction-Following Models for Question Answering"
  ☆83Updated 9 months ago
• osainz59 / t5-encoder
  A extension of Transformers library to include T5ForSequenceClassification class.
  ☆38Updated 2 years ago
• eladsegal / strategyqa
  The official code of TACL 2021, "Did Aristotle Use a Laptop? A Question Answering Benchmark with Implicit Reasoning Strategies".
  ☆72Updated 2 years ago
• realtimeqa / realtimeqa_public
  ☆75Updated last year
• Betswish / MIRAGE
  Easy-to-use MIRAGE code for faithful answer attribution in RAG applications. Paper: https://aclanthology.org/2024.emnlp-main.347/
  ☆22Updated 2 months ago
• orionw / FollowIR
  FollowIR: Evaluating and Teaching Information Retrieval Models to Follow Instructions
  ☆44Updated 10 months ago
• ielab / PromptReps
  Prompting Large Language Models to Generate Dense and Sparse Representations for Zero-Shot Document Retrieval
  ☆45Updated 6 months ago
• nelson-liu / evaluating-verifiability-in-generative-search-engines
  Companion repo for "Evaluating Verifiability in Generative Search Engines".
  ☆83Updated 2 years ago
• chaitanyamalaviya / ExpertQA
  [Data + code] ExpertQA : Expert-Curated Questions and Attributed Answers
  ☆128Updated last year
• yanaiela / pararel
  ☆44Updated last year
• violet-zct / fairseq-detect-hallucination
  Detect hallucinated tokens for conditional sequence generation.
  ☆64Updated 3 years ago
• swj0419 / kNN_prompt
  TBC
  ☆27Updated 2 years ago
• krystalan / chatgpt_as_nlg_evaluator
  Technical Report: Is ChatGPT a Good NLG Evaluator? A Preliminary Study
  ☆43Updated 2 years ago
• oriyor / ret-robust
  Implementation of the paper: "Making Retrieval-Augmented Language Models Robust to Irrelevant Context"
  ☆70Updated 9 months ago
• yixinL7 / SumLLM
  Repo for "On Learning to Summarize with Large Language Models as References"
  ☆44Updated last year
• yuzhaouoe / pretraining-data-packing
  [ACL'24 Oral] Analysing The Impact of Sequence Composition on Language Model Pre-Training
  ☆21Updated 8 months ago
• hitz-zentroa / lm-contamination
  The LM Contamination Index is a manually created database of contamination evidences for LMs.
  ☆78Updated last year
• salesforce / QAFactEval
  ☆48Updated 2 years ago
• sunlab-osu / ReasonBERT
  Code and pre-trained models for "ReasonBert: Pre-trained to Reason with Distant Supervision", EMNLP'2021
  ☆29Updated 2 years ago