csitfun / LogiEval
a benchmark suite for testing logical reasoning abilities of prompt-based models
☆22Updated 10 months ago
Related projects: ⓘ
- Code and data for paper "Context-faithful Prompting for Large Language Models".☆37Updated last year
- ☆28Updated 7 months ago
- [ACL 2023] Solving Math Word Problems via Cooperative Reasoning induced Language Models☆33Updated 9 months ago
- Paper list of "The Life Cycle of Knowledge in Big Language Models: A Survey"☆61Updated last year
- Evaluating the Ripple Effects of Knowledge Editing in Language Models☆45Updated 5 months ago
- Supporting code for ReCEval paper☆26Updated last week
- ☆57Updated last year
- ☆44Updated last year
- [EMNLP 2023] ALCUNA: Large Language Models Meet New Knowledge☆22Updated 10 months ago
- Code and Data for NeurIPS2021 Paper "A Dataset for Answering Time-Sensitive Questions"☆61Updated 2 years ago
- Logiqa2.0 dataset - logical reasoning in MRC and NLI tasks☆73Updated last year
- Semi-Parametric Editing with a Retrieval-Augmented Counterfactual Model☆59Updated last year
- ☆39Updated 9 months ago
- ☆26Updated last year
- [EMNLP 2023] MQuAKE: Assessing Knowledge Editing in Language Models via Multi-Hop Questions☆96Updated last week
- Code for reproducing the ACL'23 paper: Don't Generate, Discriminate: A Proposal for Grounding Language Models to Real-World Environments☆69Updated 8 months ago
- [EMNLP-2022 Findings] Code for paper “ProGen: Progressive Zero-shot Dataset Generation via In-context Feedback”.☆22Updated last year
- Implementation of the paper: "Making Retrieval-Augmented Language Models Robust to Irrelevant Context"☆60Updated last month
- [NAACL 2024] Making Language Models Better Tool Learners with Execution Feedback☆35Updated 6 months ago
- An open-source library for contamination detection in NLP datasets and Large Language Models (LLMs).☆40Updated last month
- [ICLR'24 Spotlight] "Adaptive Chameleon or Stubborn Sloth: Revealing the Behavior of Large Language Models in Knowledge Conflicts"☆51Updated 5 months ago
- [ACL'24] Code and data of paper "When is Tree Search Useful for LLM Planning? It Depends on the Discriminator"☆45Updated 6 months ago
- Evaluate the Quality of Critique☆35Updated 3 months ago
- [NeurIPS 2022] Generating Training Data with Language Models: Towards Zero-Shot Language Understanding☆63Updated 2 years ago
- ☆77Updated last year
- Github repository for "FELM: Benchmarking Factuality Evaluation of Large Language Models"☆54Updated 8 months ago
- ☆32Updated 2 years ago
- ☆44Updated 8 months ago
- This is the repository for paper "CREATOR: Tool Creation for Disentangling Abstract and Concrete Reasoning of Large Language Models"☆22Updated 11 months ago
- Resources for our ACL 2023 paper: Distilling Script Knowledge from Large Language Models for Constrained Language Planning☆35Updated last year