DFKI-NLP / LLMCheckupLinks
Code for the NAACL 2024 HCI+NLP Workshop paper "LLMCheckup: Conversational Examination of Large Language Models via Interpretability Tools and Self-explanation" (Wang et al. 2024)
☆13Updated last year
Alternatives and similar repositories for LLMCheckup
Users that are interested in LLMCheckup are comparing it to the libraries listed below
Sorting:
- [Data + code] ExpertQA : Expert-Curated Questions and Attributed Answers☆133Updated last year
- Easy-to-use MIRAGE code for faithful answer attribution in RAG applications. Paper: https://aclanthology.org/2024.emnlp-main.347/☆25Updated 7 months ago
- The data and the PyTorch implementation for the models and experiments in the paper "Exploiting Asymmetry for Synthetic Training Data Gen…☆64Updated 2 years ago
- Code, datasets, models for the paper "Automatic Evaluation of Attribution by Large Language Models"☆56Updated 2 years ago
- Code and Data for "Evaluating Correctness and Faithfulness of Instruction-Following Models for Question Answering"☆86Updated last year
- This repository contains the dataset and code for "WiCE: Real-World Entailment for Claims in Wikipedia" in EMNLP 2023.☆41Updated last year
- Multilingual Large Language Models Evaluation Benchmark☆132Updated last year
- Repository for the ACL 2024 conference website☆18Updated 8 months ago
- The LM Contamination Index is a manually created database of contamination evidences for LMs.☆80Updated last year
- Token-level Reference-free Hallucination Detection☆96Updated 2 years ago
- Codes for "Benchmarking the Generation of Fact Checking Explanations"☆10Updated last year
- Attribute statements generated by LLMs to preceding tokens using attention weights.☆18Updated 5 months ago
- ☆42Updated 8 months ago
- A Human-LLM Collaborative Dataset for Generative Information-seeking with Attribution☆35Updated 2 years ago
- How do transformer LMs encode relations?☆55Updated last year
- Fact-Checking the Output of Generative Large Language Models in both Annotation and Evaluation.☆105Updated last year
- Landing page for MIB: A Mechanistic Interpretability Benchmark☆20Updated 2 months ago
- ☆74Updated last year
- LogiTorch is a PyTorch-based library for logical reasoning on natural language☆73Updated last week
- ☆52Updated last year
- ☆116Updated last year
- Code and dataset for the emnlp paper titled Instruct and Extract: Instruction Tuning for On-Demand Information Extraction☆53Updated last year
- Code for the EACL 2024 paper: "Small Language Models Improve Giants by Rewriting Their Outputs"☆11Updated last year
- Repository to create CCKGs from the paper "Similarity-weighted Construction of Contextualized Commonsense Knowledge Graphs for Knowledge-…☆11Updated 4 months ago
- [ACL 2025 Main] Official Repository for "Evaluating Language Models as Synthetic Data Generators"☆39Updated 10 months ago
- Exploring the Limitations of Large Language Models on Multi-Hop Queries☆27Updated 7 months ago
- The geometry of multilingual language model representations (EMNLP 2022).☆22Updated 2 years ago
- Repository for the Bias Benchmark for QA dataset.☆128Updated last year
- NAACL 2024. Code & Dataset for "🌁 Bridging the Novice-Expert Gap via Models of Decision-Making: A Case Study on Remediating Math Mistake…☆43Updated last year
- A collection of datasets for language model pretraining including scripts for downloading, preprocesssing, and sampling.☆61Updated last year