Alternatives and similar repositories for LLMCheckup

Users that are interested in LLMCheckup are comparing it to the libraries listed below

• chaitanyamalaviya / ExpertQA
  [Data + code] ExpertQA : Expert-Curated Questions and Attributed Answers
  ☆133Updated last year
• Betswish / MIRAGE
  Easy-to-use MIRAGE code for faithful answer attribution in RAG applications. Paper: https://aclanthology.org/2024.emnlp-main.347/
  ☆25Updated 6 months ago
• epfl-dlab / SynthIE
  The data and the PyTorch implementation for the models and experiments in the paper "Exploiting Asymmetry for Synthetic Training Data Gen…
  ☆63Updated 2 years ago
• McGill-NLP / instruct-qa
  Code and Data for "Evaluating Correctness and Faithfulness of Instruction-Following Models for Question Answering"
  ☆86Updated last year
• lovodkin93 / attribute-first-then-generate
  Repository for "Attribute First, then Generate: Locally-attributable Grounded Text Generation", ACL 2024
  ☆29Updated 9 months ago
• primeqa / clapnq
  ☆41Updated 8 months ago
• yuxiaw / Factcheck-GPT
  Fact-Checking the Output of Generative Large Language Models in both Annotation and Evaluation.
  ☆105Updated last year
• nlp-uoregon / mlmm-evaluation
  Multilingual Large Language Models Evaluation Benchmark
  ☆131Updated last year
• project-miracl / hagrid
  A Human-LLM Collaborative Dataset for Generative Information-seeking with Attribution
  ☆35Updated 2 years ago
• neulab / data-agora
  [ACL 2025 Main] Official Repository for "Evaluating Language Models as Synthetic Data Generators"
  ☆38Updated 9 months ago
• evandez / REMEDI
  Inspecting and Editing Knowledge Representations in Language Models
  ☆116Updated 2 years ago
• OSU-NLP-Group / AttrScore
  Code, datasets, models for the paper "Automatic Evaluation of Attribution by Large Language Models"
  ☆56Updated 2 years ago
• hitz-zentroa / lm-contamination
  The LM Contamination Index is a manually created database of contamination evidences for LMs.
  ☆80Updated last year
• tylerachang / multilingual-geometry
  The geometry of multilingual language model representations (EMNLP 2022).
  ☆21Updated 2 years ago
• allenai / wimbd
  What's In My Big Data (WIMBD) - a toolkit for analyzing large text datasets
  ☆224Updated 10 months ago
• yuh-zha / AlignScore
  ACL2023 - AlignScore, a metric for factual consistency evaluation.
  ☆138Updated last year
• intuit / sac3
  Official repo for SAC3: Reliable Hallucination Detection in Black-Box Language Models via Semantic-aware Cross-check Consistency
  ☆36Updated 8 months ago
• ParticleMedia / RAGTruth
  Github repository for "RAGTruth: A Hallucination Corpus for Developing Trustworthy Retrieval-Augmented Language Models"
  ☆197Updated 9 months ago
• AlexTMallen / adaptive-retrieval
  ☆186Updated 2 months ago
• evandez / relations
  How do transformer LMs encode relations?
  ☆53Updated last year
• ryokamoi / wice
  This repository contains the dataset and code for "WiCE: Real-World Entailment for Claims in Wikipedia" in EMNLP 2023.
  ☆42Updated last year
• microsoft / HaDes
  Token-level Reference-free Hallucination Detection
  ☆96Updated 2 years ago
• dmg-illc / JUDGE-BENCH
  ☆35Updated last month
• realtimeqa / realtimeqa_public
  ☆78Updated last year
• zthang / Focus
  ☆20Updated last year
• lilakk / BooookScore
  A package to generate summaries of long-form text and evaluate the coherence of these summaries. Official package for our ICLR 2024 paper…
  ☆124Updated 11 months ago
• LanD-FBK / benchmark-gen-explanations
  Codes for "Benchmarking the Generation of Fact Checking Explanations"
  ☆10Updated last year
• Hannibal046 / SelfMemory
  [Neurips2023] Source code for Lift Yourself Up: Retrieval-augmented Text Generation with Self Memory
  ☆62Updated 2 years ago
• yzjiao / On-Demand-IE
  Code and dataset for the emnlp paper titled Instruct and Extract: Instruction Tuning for On-Demand Information Extraction
  ☆53Updated last year
• SalesforceAIResearch / FaithEval
  ☆48Updated 3 months ago