Alternatives and similar repositories for LLMs-for-NLG-Evaluation

Users that are interested in LLMs-for-NLG-Evaluation are comparing it to the libraries listed below

• fengranMark / ConvGQR
  ConvGQR: Generative Query Reformulation for Conversational Search. A codebase for ACL 2023 accepted paper.
  ☆33Updated last year
• Alsace08 / SumCoT
  [ACL 2023] Code and Data Repo for Paper "Element-aware Summary and Summary Chain-of-Thought (SumCoT)"
  ☆53Updated 2 years ago
• DevSinghSachan / unsupervised-passage-reranking
  Code, datasets, and checkpoints for the paper "Improving Passage Retrieval with Zero-Shot Question Generation (EMNLP 2022)"
  ☆100Updated 3 years ago
• ellaneeman / disent_qa
  This code accompanies the paper DisentQA: Disentangling Parametric and Contextual Knowledge with Counterfactual Question Answering.
  ☆16Updated 2 years ago
• qinyiwei / InfoBench
  ☆58Updated last year
• yilunzhao / Awsome-Table-Reasoning
  A comprehensive paper list of Reasoning over Tables.
  ☆30Updated 3 years ago
• dig-team / hanna-benchmark-asg
  HANNA, a large annotated dataset of Human-ANnotated NArratives for ASG evaluation.
  ☆36Updated last year
• khuangaf / ZeroFEC
  Official implementation of the ACL 2023 paper: "Zero-shot Faithful Factual Error Correction"
  ☆17Updated 2 years ago
• iwangjian / TopDial
  Target-oriented Proactive Dialogue Systems with Personalization: Problem Formulation and Dataset Curation (EMNLP 2023)
  ☆31Updated 3 months ago
• OSU-NLP-Group / LLM-Knowledge-Conflict
  [ICLR'24 Spotlight] "Adaptive Chameleon or Stubborn Sloth: Revealing the Behavior of Large Language Models in Knowledge Conflicts"
  ☆82Updated last year
• zhudotexe / fanoutqa
  Companion code for FanOutQA: Multi-Hop, Multi-Document Question Answering for Large Language Models (ACL 2024)
  ☆58Updated 4 months ago
• RUCAIBox / Language-Specific-Neurons
  ☆90Updated last year
• xu1998hz / InstructScore_SEScore3
  First explanation metric (diagnostic report) for text generation evaluation
  ☆62Updated 10 months ago
• salesforce / DialFact
  We construct and introduce DIALFACT, a testing benchmark dataset crowd-annotated conversational claims, paired with pieces of evidence fr…
  ☆44Updated 3 years ago
• ehsk / OpenQA-eval
  ACL 2023: Evaluating Open-Domain Question Answering in the Era of Large Language Models
  ☆47Updated 2 years ago
• kyriemao / LeCoRE
  Code of LeCoRE
  ☆13Updated 2 years ago
• Sahandfer / PersonaPaper
  This is a repository for sharing papers in the field of persona-based conversational AI. The related source code for each paper is linked…
  ☆168Updated last year
• hkust-nlp / felm
  Github repository for "FELM: Benchmarking Factuality Evaluation of Large Language Models" (NeurIPS 2023)
  ☆63Updated 2 years ago
• realtimeqa / realtimeqa_public
  ☆83Updated this week
• AlexTMallen / adaptive-retrieval
  ☆188Updated 6 months ago
• soyoung97 / ListT5
  official repository for ListT5
  ☆48Updated 2 months ago
• arkilpatel / SVAMP
  NAACL 2021: Are NLP Models really able to Solve Simple Math Word Problems?
  ☆139Updated 3 years ago
• HKUST-KnowComp / Knowledge-Constrained-Decoding
  Official Code for EMNLP2023 Main Conference paper: "KCTS: Knowledge-Constrained Tree Search Decoding with Token-Level Hallucination Detec…
  ☆30Updated 2 years ago
• minnesotanlp / cobbler
  Code and data for Koo et al's ACL 2024 paper "Benchmarking Cognitive Biases in Large Language Models as Evaluators"
  ☆21Updated last year
• YunahJang / IterCQR
  ☆20Updated 4 months ago
• Mayer123 / UDT-QA
  Code for the paper "Open Domain Question Answering with A Unified Knowledge Interface" (ACL 2022)
  ☆56Updated 2 years ago
• ictnlp / TACS
  Source code for Truth-Aware Context Selection: Mitigating the Hallucinations of Large Language Models Being Misled by Untruthful Contexts
  ☆17Updated last year
• DevSinghSachan / art
  Code and models for the paper "Questions Are All You Need to Train a Dense Passage Retriever (TACL 2023)"
  ☆62Updated 3 years ago
• yasumasaonoe / entity_knowledge_propagation
  ☆17Updated 2 years ago
• kaistAI / LangBridge
  [ACL 2024] LangBridge: Multilingual Reasoning Without Multilingual Supervision
  ☆95Updated last year