allenai / noncompliance
This repository contains data, code and models for contextual noncompliance.
☆19Updated 5 months ago
Alternatives and similar repositories for noncompliance:
Users that are interested in noncompliance are comparing it to the libraries listed below
- ☆44Updated 4 months ago
- Evaluate the Quality of Critique☆35Updated 7 months ago
- Is In-Context Learning Sufficient for Instruction Following in LLMs?☆26Updated 7 months ago
- Restore safety in fine-tuned language models through task arithmetic☆26Updated 9 months ago
- ☆27Updated 10 months ago
- [ACL'24 Oral] Analysing The Impact of Sequence Composition on Language Model Pre-Training☆18Updated 4 months ago
- Grade-School Math with Irrelevant Context (GSM-IC) benchmark is an arithmetic reasoning dataset built upon GSM8K, by adding irrelevant se…☆58Updated last year
- Code and data for paper "Context-faithful Prompting for Large Language Models".☆39Updated last year
- Augmenting Statistical Models with Natural Language Parameters☆22Updated 4 months ago
- Steering Knowledge Selection Behaviours in LLMs via SAE-Based Representation Engineering☆39Updated last month
- Long Context Extension and Generalization in LLMs☆40Updated 3 months ago
- [ACL 2023 Findings] What In-Context Learning “Learns” In-Context: Disentangling Task Recognition and Task Learning☆22Updated last year
- AbstainQA, ACL 2024☆25Updated 3 months ago
- ☆48Updated last year
- GSM-Plus: Data, Code, and Evaluation for Enhancing Robust Mathematical Reasoning in Math Word Problems.☆55Updated 6 months ago
- ☆29Updated 8 months ago
- [ACL'24] Code and data of paper "When is Tree Search Useful for LLM Planning? It Depends on the Discriminator"☆53Updated 10 months ago
- ☆29Updated 8 months ago
- ☆19Updated last year
- Code for "Tracing Knowledge in Language Models Back to the Training Data"☆35Updated 2 years ago
- ☆26Updated 6 months ago
- ☆47Updated 9 months ago
- Github repository for "FELM: Benchmarking Factuality Evaluation of Large Language Models" (NeurIPS 2023)☆57Updated last year
- ☆43Updated 5 months ago
- An open-source library for contamination detection in NLP datasets and Large Language Models (LLMs).☆46Updated 5 months ago
- Analyzing LLM Alignment via Token distribution shift☆14Updated 11 months ago
- Repository for NPHardEval, a quantified-dynamic benchmark of LLMs☆51Updated 9 months ago
- [arXiv preprint] Official Repository for "Evaluating Language Models as Synthetic Data Generators"☆30Updated last month
- [NeurIPS 2023 D&B Track] Code and data for paper "Revisiting Out-of-distribution Robustness in NLP: Benchmarks, Analysis, and LLMs Evalua…☆31Updated last year
- ☆25Updated last year