Alternatives and similar repositories for LLMCheckup

Users that are interested in LLMCheckup are comparing it to the libraries listed below

• chaitanyamalaviya / ExpertQA
  [Data + code] ExpertQA : Expert-Curated Questions and Attributed Answers
  ☆136Updated last year
• McGill-NLP / instruct-qa
  Code and Data for "Evaluating Correctness and Faithfulness of Instruction-Following Models for Question Answering"
  ☆86Updated last year
• Betswish / MIRAGE
  Easy-to-use MIRAGE code for faithful answer attribution in RAG applications. Paper: https://aclanthology.org/2024.emnlp-main.347/
  ☆26Updated 10 months ago
• OSU-NLP-Group / AttrScore
  Code, datasets, models for the paper "Automatic Evaluation of Attribution by Large Language Models"
  ☆56Updated 2 years ago
• primeqa / clapnq
  ☆43Updated last year
• microsoft / HaDes
  Token-level Reference-free Hallucination Detection
  ☆98Updated 2 years ago
• ryokamoi / wice
  This repository contains the dataset and code for "WiCE: Real-World Entailment for Claims in Wikipedia" in EMNLP 2023.
  ☆42Updated 2 years ago
• epfl-dlab / SynthIE
  The data and the PyTorch implementation for the models and experiments in the paper "Exploiting Asymmetry for Synthetic Training Data Gen…
  ☆64Updated 2 years ago
• neulab / data-agora
  [ACL 2025 Main] Official Repository for "Evaluating Language Models as Synthetic Data Generators"
  ☆40Updated last year
• yuxiaw / Factcheck-GPT
  Fact-Checking the Output of Generative Large Language Models in both Annotation and Evaluation.
  ☆112Updated 2 years ago
• eladsegal / strategyqa
  The official code of TACL 2021, "Did Aristotle Use a Laptop? A Question Answering Benchmark with Implicit Reasoning Strategies".
  ☆83Updated 3 years ago
• hitz-zentroa / lm-contamination
  The LM Contamination Index is a manually created database of contamination evidences for LMs.
  ☆82Updated last year
• project-miracl / hagrid
  A Human-LLM Collaborative Dataset for Generative Information-seeking with Attribution
  ☆35Updated 2 years ago
• tatsu-lab / opinions_qa
  ☆117Updated last year
• abhika-m / FAVA
  ☆75Updated last year
• realtimeqa / realtimeqa_public
  ☆84Updated last week
• lovodkin93 / attribute-first-then-generate
  Repository for "Attribute First, then Generate: Locally-attributable Grounded Text Generation", ACL 2024
  ☆29Updated last year
• allenai / marg-reviewer
  Code/data for MARG (multi-agent review generation)
  ☆59Updated 4 months ago
• OAfzal / nlp-for-peer-review
  ☆52Updated last year
• evandez / REMEDI
  Inspecting and Editing Knowledge Representations in Language Models
  ☆119Updated 2 years ago
• yuh-zha / AlignScore
  ACL2023 - AlignScore, a metric for factual consistency evaluation.
  ☆150Updated last year
• yuxiaw / OpenFactCheck
  ☆58Updated last year
• nyu-mll / BBQ
  Repository for the Bias Benchmark for QA dataset.
  ☆136Updated 2 years ago
• lilakk / BooookScore
  A package to generate summaries of long-form text and evaluate the coherence of these summaries. Official package for our ICLR 2024 paper…
  ☆128Updated last year
• HanjieChen / REV
  Code for the paper "REV: Information-Theoretic Evaluation of Free-Text Rationales"
  ☆16Updated 2 years ago
• google-research / true
  Code and data accompanying the paper "TRUE: Re-evaluating Factual Consistency Evaluation".
  ☆83Updated 3 weeks ago
• aaronmueller / MIB
  Landing page for MIB: A Mechanistic Interpretability Benchmark
  ☆24Updated 5 months ago
• salesforce / factualNLG
  Code for the arXiv paper: "LLMs as Factual Reasoners: Insights from Existing Benchmarks and Beyond"
  ☆61Updated last year
• allenai / noncompliance
  This repository contains data, code and models for contextual noncompliance.
  ☆25Updated last year
• epfl-dlab / llm-latent-language
  Repo accompanying our paper "Do Llamas Work in English? On the Latent Language of Multilingual Transformers".
  ☆80Updated last year