Alternatives and similar repositories for LLMCheckup

Users that are interested in LLMCheckup are comparing it to the libraries listed below

• chaitanyamalaviya / ExpertQA
  [Data + code] ExpertQA : Expert-Curated Questions and Attributed Answers
  ☆136Updated last year
• Betswish / MIRAGE
  Easy-to-use MIRAGE code for faithful answer attribution in RAG applications. Paper: https://aclanthology.org/2024.emnlp-main.347/
  ☆26Updated 10 months ago
• McGill-NLP / instruct-qa
  Code and Data for "Evaluating Correctness and Faithfulness of Instruction-Following Models for Question Answering"
  ☆86Updated last year
• tylerachang / multilingual-geometry
  The geometry of multilingual language model representations (EMNLP 2022).
  ☆22Updated 3 years ago
• neulab / data-agora
  [ACL 2025 Main] Official Repository for "Evaluating Language Models as Synthetic Data Generators"
  ☆40Updated last year
• hitz-zentroa / lm-contamination
  The LM Contamination Index is a manually created database of contamination evidences for LMs.
  ☆82Updated last year
• yuxiaw / Factcheck-GPT
  Fact-Checking the Output of Generative Large Language Models in both Annotation and Evaluation.
  ☆112Updated 2 years ago
• yuxiaw / OpenFactCheck
  ☆58Updated last year
• nlp-uoregon / mlmm-evaluation
  Multilingual Large Language Models Evaluation Benchmark
  ☆133Updated last year
• project-miracl / hagrid
  A Human-LLM Collaborative Dataset for Generative Information-seeking with Attribution
  ☆35Updated 2 years ago
• OSU-NLP-Group / AttrScore
  Code, datasets, models for the paper "Automatic Evaluation of Attribution by Large Language Models"
  ☆56Updated 2 years ago
• evandez / relations
  How do transformer LMs encode relations?
  ☆56Updated last year
• epfl-dlab / SynthIE
  The data and the PyTorch implementation for the models and experiments in the paper "Exploiting Asymmetry for Synthetic Training Data Gen…
  ☆64Updated 2 years ago
• primeqa / clapnq
  ☆43Updated last year
• microsoft / HaDes
  Token-level Reference-free Hallucination Detection
  ☆98Updated 2 years ago
• rosewang2008 / bridge
  NAACL 2024. Code & Dataset for "🌁 Bridging the Novice-Expert Gap via Models of Decision-Making: A Case Study on Remediating Math Mistake…
  ☆45Updated last year
• GeorgeVern / lmcor
  Code for the EACL 2024 paper: "Small Language Models Improve Giants by Rewriting Their Outputs"
  ☆12Updated last year
• apartresearch / specificityplus
  👩‍💻 Code for the ACL paper "Detecting Edit Failures in LLMs: An Improved Specificity Benchmark"
  ☆20Updated 2 years ago
• evandez / REMEDI
  Inspecting and Editing Knowledge Representations in Language Models
  ☆119Updated 2 years ago
• ryokamoi / wice
  This repository contains the dataset and code for "WiCE: Real-World Entailment for Claims in Wikipedia" in EMNLP 2023.
  ☆42Updated 2 years ago
• tsor13 / kaleido
  ☆23Updated last year
• tatsu-lab / opinions_qa
  ☆117Updated last year
• realtimeqa / realtimeqa_public
  ☆84Updated last week
• anthonywchen / RARR
  RARR: Researching and Revising What Language Models Say, Using Language Models
  ☆51Updated 2 years ago
• ParticleMedia / RAGTruth
  Github repository for "RAGTruth: A Hallucination Corpus for Developing Trustworthy Retrieval-Augmented Language Models"
  ☆223Updated last year
• epfl-dlab / llm-latent-language
  Repo accompanying our paper "Do Llamas Work in English? On the Latent Language of Multilingual Transformers".
  ☆80Updated last year
• edenbiran / HoppingTooLate
  Exploring the Limitations of Large Language Models on Multi-Hop Queries
  ☆30Updated 11 months ago
• gsarti / pecore
  Materials for "Quantifying the Plausibility of Context Reliance in Neural Machine Translation" at ICLR'24 🐑 🐑
  ☆15Updated last year
• nyu-mll / BBQ
  Repository for the Bias Benchmark for QA dataset.
  ☆136Updated 2 years ago
• allenai / SciRIFF
  Dataset and evaluation suite enabling LLM instruction-following for scientific literature understanding.
  ☆47Updated 10 months ago