apartresearch / specificityplus
π©βπ» Code for the ACL paper "Detecting Edit Failures in LLMs: An Improved Specificity Benchmark"
β20Updated 9 months ago
Related projects β
Alternatives and complementary repositories for specificityplus
- β18Updated last year
- datasets from the paper "Towards Understanding Sycophancy in Language Models"β62Updated last year
- Interpreting Language Models with Contrastive Explanations (EMNLP 2022 Best Paper Honorable Mention)β58Updated 2 years ago
- β44Updated 2 months ago
- This repository accompanies our paper βDo Prompt-Based Models Really Understand the Meaning of Their Prompts?ββ84Updated 2 years ago
- Token-level Reference-free Hallucination Detectionβ92Updated last year
- Inspecting and Editing Knowledge Representations in Language Modelsβ107Updated last year
- CausalGym: Benchmarking causal interpretability methods on linguistic tasksβ29Updated 8 months ago
- β37Updated last year
- This repository includes code for the paper "Does Localization Inform Editing? Surprising Differences in Where Knowledge Is Stored vs. Caβ¦β55Updated last year
- The LM Contamination Index is a manually created database of contamination evidences for LMs.β75Updated 7 months ago
- This repository contains the dataset and code for "WiCE: Real-World Entailment for Claims in Wikipedia" in EMNLP 2023.β39Updated 10 months ago
- Repo for the paper "Large Language Models Struggle to Learn Long-Tail Knowledge"β73Updated last year
- FollowIR: Evaluating and Teaching Information Retrieval Models to Follow Instructionsβ39Updated 4 months ago
- β42Updated 9 months ago
- Github repository for "FELM: Benchmarking Factuality Evaluation of Large Language Models" (NeurIPS 2023)β54Updated 10 months ago
- β70Updated 3 months ago
- LoFiT: Localized Fine-tuning on LLM Representationsβ21Updated 4 months ago
- [ICML 2023] Code for our paper βCompositional Exemplars for In-context Learningβ.β92Updated last year
- β37Updated 7 months ago
- β32Updated last year
- Repo accompanying our paper "Do Llamas Work in English? On the Latent Language of Multilingual Transformers".β57Updated 8 months ago
- Grade-School Math with Irrelevant Context (GSM-IC) benchmark is an arithmetic reasoning dataset built upon GSM8K, by adding irrelevant seβ¦β55Updated last year
- Code and data for paper "Context-faithful Prompting for Large Language Models".β39Updated last year
- β35Updated last year
- Code for preprint: Summarizing Differences between Text Distributions with Natural Languageβ42Updated last year
- Repo for "On Learning to Summarize with Large Language Models as References"β42Updated last year
- The accompanying code for "Transformer Feed-Forward Layers Are Key-Value Memories". Mor Geva, Roei Schuster, Jonathan Berant, and Omer Leβ¦β85Updated 3 years ago
- Repository for the ACL 2024 conference websiteβ17Updated last month
- EMNLP 2022: Generating Natural Language Proofs with Verifier-Guided Search https://arxiv.org/abs/2205.12443β81Updated last month