apartresearch / specificityplus
👩💻 Code for the ACL paper "Detecting Edit Failures in LLMs: An Improved Specificity Benchmark"
☆20Updated last year
Alternatives and similar repositories for specificityplus:
Users that are interested in specificityplus are comparing it to the libraries listed below
- ☆42Updated last year
- This repository includes code for the paper "Does Localization Inform Editing? Surprising Differences in Where Knowledge Is Stored vs. Ca…☆58Updated last year
- ☆44Updated last year
- This repository accompanies our paper “Do Prompt-Based Models Really Understand the Meaning of Their Prompts?”☆85Updated 2 years ago
- Inspecting and Editing Knowledge Representations in Language Models☆111Updated last year
- [NeurIPS 2023 D&B Track] Code and data for paper "Revisiting Out-of-distribution Robustness in NLP: Benchmarks, Analysis, and LLMs Evalua…☆31Updated last year
- Code and data for paper "Context-faithful Prompting for Large Language Models".☆39Updated last year
- Repo for the paper "Large Language Models Struggle to Learn Long-Tail Knowledge"☆74Updated last year
- This repository contains the dataset and code for "WiCE: Real-World Entailment for Claims in Wikipedia" in EMNLP 2023.☆40Updated last year
- EMNLP 2022: "MABEL: Attenuating Gender Bias using Textual Entailment Data" https://arxiv.org/abs/2210.14975☆37Updated last year
- Interpreting Language Models with Contrastive Explanations (EMNLP 2022 Best Paper Honorable Mention)☆60Updated 2 years ago
- ☆44Updated 4 months ago
- ☆20Updated last year
- datasets from the paper "Towards Understanding Sycophancy in Language Models"☆66Updated last year
- LoFiT: Localized Fine-tuning on LLM Representations☆30Updated this week
- [ICML 2023] Code for our paper “Compositional Exemplars for In-context Learning”.☆95Updated last year
- Grade-School Math with Irrelevant Context (GSM-IC) benchmark is an arithmetic reasoning dataset built upon GSM8K, by adding irrelevant se…☆58Updated last year
- Github repository for "FELM: Benchmarking Factuality Evaluation of Large Language Models" (NeurIPS 2023)☆57Updated last year
- Code and data associated with the AmbiEnt dataset in "We're Afraid Language Models Aren't Modeling Ambiguity" (Liu et al., 2023)☆57Updated 11 months ago
- Steering Knowledge Selection Behaviours in LLMs via SAE-Based Representation Engineering☆39Updated last month
- Token-level Reference-free Hallucination Detection☆93Updated last year
- Code for preprint: Summarizing Differences between Text Distributions with Natural Language☆42Updated last year
- The LM Contamination Index is a manually created database of contamination evidences for LMs.☆76Updated 9 months ago
- AbstainQA, ACL 2024☆25Updated 3 months ago
- Code and data accompanying the paper "TRUE: Re-evaluating Factual Consistency Evaluation".☆73Updated 2 months ago
- ☆33Updated 3 years ago
- TBC☆26Updated 2 years ago
- ☆75Updated 5 months ago
- ☆84Updated 2 years ago
- This repository contains data, code and models for contextual noncompliance.☆19Updated 6 months ago