alisawuffles / ambient
Code and data associated with the AmbiEnt dataset in "We're Afraid Language Models Aren't Modeling Ambiguity" (Liu et al., 2023)
☆60Updated last year
Alternatives and similar repositories for ambient:
Users that are interested in ambient are comparing it to the libraries listed below
- ☆82Updated 2 years ago
- ☆73Updated last year
- Code and data for paper "Context-faithful Prompting for Large Language Models".☆39Updated 2 years ago
- Inspecting and Editing Knowledge Representations in Language Models☆112Updated last year
- This repository contains the dataset and code for "WiCE: Real-World Entailment for Claims in Wikipedia" in EMNLP 2023.☆41Updated last year
- [ICLR'24 Spotlight] "Adaptive Chameleon or Stubborn Sloth: Revealing the Behavior of Large Language Models in Knowledge Conflicts"☆67Updated 11 months ago
- Github repository for "FELM: Benchmarking Factuality Evaluation of Large Language Models" (NeurIPS 2023)☆58Updated last year
- First explanation metric (diagnostic report) for text generation evaluation☆62Updated 3 weeks ago
- [ICML 2023] Code for our paper “Compositional Exemplars for In-context Learning”.☆98Updated 2 years ago
- ☆85Updated 2 years ago
- Supporting code for ReCEval paper☆28Updated 6 months ago
- ☆86Updated last year
- Code and data for the FACTOR paper☆44Updated last year
- Benchmarking Generalization to New Tasks from Natural Language Instructions☆26Updated 3 years ago
- ☆41Updated last year
- Companion code for FanOutQA: Multi-Hop, Multi-Document Question Answering for Large Language Models (ACL 2024)☆51Updated 3 weeks ago
- WikiWhy is a new benchmark for evaluating LLMs' ability to explain between cause-effect relationships. It is a QA dataset containing 9000…☆47Updated last year
- ☆58Updated 2 years ago
- This code accompanies the paper DisentQA: Disentangling Parametric and Contextual Knowledge with Counterfactual Question Answering.☆17Updated 2 years ago
- ☆38Updated last year
- Evaluate the Quality of Critique☆34Updated 9 months ago
- ☆48Updated 11 months ago
- ☆44Updated last year
- The LM Contamination Index is a manually created database of contamination evidences for LMs.☆78Updated 11 months ago
- [NeurIPS 2022] Generating Training Data with Language Models: Towards Zero-Shot Language Understanding☆64Updated 2 years ago
- ☆16Updated last year
- GSM-Plus: Data, Code, and Evaluation for Enhancing Robust Mathematical Reasoning in Math Word Problems.☆56Updated 8 months ago
- [ACL'24 Oral] Analysing The Impact of Sequence Composition on Language Model Pre-Training☆20Updated 7 months ago
- ☆34Updated 3 years ago
- Evaluating the Ripple Effects of Knowledge Editing in Language Models☆54Updated 11 months ago