eric11eca / disco
Generating diverse counterfactual data for Natural Language Understanding tasks using Large Language Models (LLMs). The generator supports GPT-3, ChatGPT, and GPT-4.
☆36Updated last year
Alternatives and similar repositories for disco:
Users that are interested in disco are comparing it to the libraries listed below
- ☆41Updated last year
- Grade-School Math with Irrelevant Context (GSM-IC) benchmark is an arithmetic reasoning dataset built upon GSM8K, by adding irrelevant se…☆58Updated 2 years ago
- Code and data for paper "Context-faithful Prompting for Large Language Models".☆39Updated 2 years ago
- Supporting code for ReCEval paper☆28Updated 6 months ago
- AbstainQA, ACL 2024☆25Updated 5 months ago
- ☆86Updated last year
- [ACL'24] Code and data of paper "When is Tree Search Useful for LLM Planning? It Depends on the Discriminator"☆54Updated last year
- [ICLR'24 Spotlight] "Adaptive Chameleon or Stubborn Sloth: Revealing the Behavior of Large Language Models in Knowledge Conflicts"☆67Updated 11 months ago
- Data and code for ACL 2022 paper "MultiHiertt: Numerical Reasoning over Multi Hierarchical Tabular and Textual Data"☆42Updated 5 months ago
- ☆41Updated 7 months ago
- Code for RL4F: Generating Natural Language Feedback with Reinforcement Learning for Repairing Model Outputs. ACL 2023.☆62Updated 4 months ago
- ☆51Updated last year
- Evaluate the Quality of Critique☆34Updated 10 months ago
- ☆95Updated last year
- Evaluating the Ripple Effects of Knowledge Editing in Language Models☆54Updated 11 months ago
- ☆44Updated 6 months ago
- WikiWhy is a new benchmark for evaluating LLMs' ability to explain between cause-effect relationships. It is a QA dataset containing 9000…☆47Updated last year
- ☆47Updated last year
- Implementation of the paper: "Making Retrieval-Augmented Language Models Robust to Irrelevant Context"☆67Updated 7 months ago
- Repo for the paper "Large Language Models Struggle to Learn Long-Tail Knowledge"☆77Updated last year
- [ICLR'24 spotlight] Tool-Augmented Reward Modeling☆46Updated 3 months ago
- Resources for Retrieval Augmentation for Commonsense Reasoning: A Unified Approach. EMNLP 2022.☆21Updated 2 years ago
- ☆50Updated last year
- "TIGERScore: Towards Building Explainable Metric for All Text Generation Tasks" [TMLR 2024]☆31Updated 3 months ago
- GSM-Plus: Data, Code, and Evaluation for Enhancing Robust Mathematical Reasoning in Math Word Problems.☆56Updated 8 months ago
- [NAACL'25 Oral] Steering Knowledge Selection Behaviours in LLMs via SAE-Based Representation Engineering☆52Updated 4 months ago
- Code for the arXiv paper: "LLMs as Factual Reasoners: Insights from Existing Benchmarks and Beyond"☆58Updated 2 months ago
- Semi-Parametric Editing with a Retrieval-Augmented Counterfactual Model☆66Updated 2 years ago
- Complexity Based Prompting for Multi-Step Reasoning☆17Updated 2 years ago
- Evaluation on Logical Reasoning and Abstract Reasoning Challenges☆25Updated last year