jennhu / metalinguistic-prompting
Materials for "Prompting is not a substitute for probability measurements in large language models" (EMNLP 2023)
☆23Updated last year
Alternatives and similar repositories for metalinguistic-prompting
Users that are interested in metalinguistic-prompting are comparing it to the libraries listed below
Sorting:
- ☆26Updated 5 months ago
- ☆34Updated 3 years ago
- This repository contains the dataset and code for "WiCE: Real-World Entailment for Claims in Wikipedia" in EMNLP 2023.☆41Updated last year
- Easy-to-use MIRAGE code for faithful answer attribution in RAG applications. Paper: https://aclanthology.org/2024.emnlp-main.347/☆22Updated 2 months ago
- ☆44Updated last year
- Grade-School Math with Irrelevant Context (GSM-IC) benchmark is an arithmetic reasoning dataset built upon GSM8K, by adding irrelevant se…☆60Updated 2 years ago
- The LM Contamination Index is a manually created database of contamination evidences for LMs.☆78Updated last year
- Code for preprint: Summarizing Differences between Text Distributions with Natural Language☆42Updated 2 years ago
- ☆58Updated 3 years ago
- ☆48Updated 2 years ago
- ☆23Updated 8 months ago
- ☆16Updated 3 years ago
- Official repository for our EACL 2023 paper "LongEval: Guidelines for Human Evaluation of Faithfulness in Long-form Summarization" (https…☆43Updated 9 months ago
- Code repository for the paper "Mission: Impossible Language Models."☆52Updated 2 weeks ago
- Teaching Models to Express Their Uncertainty in Words☆39Updated 2 years ago
- ☆22Updated last year
- Exploring the Limitations of Large Language Models on Multi-Hop Queries☆25Updated 2 months ago
- Benchmarking Generalization to New Tasks from Natural Language Instructions☆26Updated 3 years ago
- [ACL'24 Oral] Analysing The Impact of Sequence Composition on Language Model Pre-Training☆21Updated 9 months ago
- This repository accompanies our paper “Do Prompt-Based Models Really Understand the Meaning of Their Prompts?”☆85Updated 3 years ago
- 👻 Code and benchmark for our EMNLP 2023 paper - "FANToM: A Benchmark for Stress-testing Machine Theory of Mind in Interactions"☆55Updated 11 months ago
- Interpreting Language Models with Contrastive Explanations (EMNLP 2022 Best Paper Honorable Mention)☆62Updated 3 years ago
- Code for the paper "REV: Information-Theoretic Evaluation of Free-Text Rationales"☆15Updated last year
- ☆17Updated last year
- Data and code for the "Moral Stories: Situated Reasoning about Norms, Intents, Actions, and their Consequences" (Emelin et al., 2021) pap…☆59Updated 2 years ago
- Code and data associated with the AmbiEnt dataset in "We're Afraid Language Models Aren't Modeling Ambiguity" (Liu et al., 2023)☆62Updated last year
- ☆15Updated 3 years ago
- Inspecting and Editing Knowledge Representations in Language Models☆116Updated last year
- Repo for the paper "Large Language Models Struggle to Learn Long-Tail Knowledge"☆76Updated 2 years ago
- ☆24Updated 2 years ago