apartresearch / specificityplus
👩💻 Code for the ACL paper "Detecting Edit Failures in LLMs: An Improved Specificity Benchmark"
☆20Updated 10 months ago
Related projects ⓘ
Alternatives and complementary repositories for specificityplus
- This repository includes code for the paper "Does Localization Inform Editing? Surprising Differences in Where Knowledge Is Stored vs. Ca…☆55Updated last year
- ☆44Updated 2 months ago
- ☆42Updated 10 months ago
- This repository accompanies our paper “Do Prompt-Based Models Really Understand the Meaning of Their Prompts?”☆84Updated 2 years ago
- This repository contains the dataset and code for "WiCE: Real-World Entailment for Claims in Wikipedia" in EMNLP 2023.☆40Updated 11 months ago
- ☆44Updated last year
- AbstainQA, ACL 2024☆19Updated last month
- Repo for the paper "Large Language Models Struggle to Learn Long-Tail Knowledge"☆73Updated last year
- CausalGym: Benchmarking causal interpretability methods on linguistic tasks☆30Updated 8 months ago
- Code for preprint: Summarizing Differences between Text Distributions with Natural Language☆42Updated last year
- Interpreting Language Models with Contrastive Explanations (EMNLP 2022 Best Paper Honorable Mention)☆58Updated 2 years ago
- Steering Knowledge Selection Behaviours in LLMs via SAE-Based Representation Engineering☆28Updated last month
- Code and data for paper "Context-faithful Prompting for Large Language Models".☆39Updated last year
- Github repository for "FELM: Benchmarking Factuality Evaluation of Large Language Models" (NeurIPS 2023)☆54Updated 10 months ago
- ☆18Updated last year
- Official repository for our EACL 2023 paper "LongEval: Guidelines for Human Evaluation of Faithfulness in Long-form Summarization" (https…☆43Updated 3 months ago
- The LM Contamination Index is a manually created database of contamination evidences for LMs.☆76Updated 7 months ago
- Inspecting and Editing Knowledge Representations in Language Models☆108Updated last year
- ☆35Updated last year
- Data and code for the paper "The Moral Integrity Corpus: A Benchmark for Ethical Dialogue Systems"☆18Updated last year
- EMNLP 2022: "MABEL: Attenuating Gender Bias using Textual Entailment Data" https://arxiv.org/abs/2210.14975☆37Updated 11 months ago
- datasets from the paper "Towards Understanding Sycophancy in Language Models"☆63Updated last year
- Grade-School Math with Irrelevant Context (GSM-IC) benchmark is an arithmetic reasoning dataset built upon GSM8K, by adding irrelevant se…☆55Updated last year
- ☆72Updated 3 months ago
- LoFiT: Localized Fine-tuning on LLM Representations☆21Updated 4 months ago
- Code and data accompanying the paper "TRUE: Re-evaluating Factual Consistency Evaluation".☆71Updated this week
- FollowIR: Evaluating and Teaching Information Retrieval Models to Follow Instructions☆40Updated 4 months ago
- Easy-to-use MIRAGE code for faithful answer attribution in RAG applications. Paper: https://arxiv.org/abs/2406.13663☆16Updated last week
- Exploring the Limitations of Large Language Models on Multi-Hop Queries☆16Updated 4 months ago
- Companion repo for "Evaluating Verifiability in Generative Search Engines".☆82Updated last year