asaparov / prontoqaLinks
Synthetic question-answering dataset to formally analyze the chain-of-thought output of large language models on a reasoning task.
β147Updated 7 months ago
Alternatives and similar repositories for prontoqa
Users that are interested in prontoqa are comparing it to the libraries listed below
Sorting:
- Awesome LLM Self-Consistency: a curated list of Self-consistency in Large Language Modelsβ97Updated 9 months ago
- π LINC: Logical Inference via Neurosymbolic Computation [EMNLP2023]β70Updated last year
- datasets from the paper "Towards Understanding Sycophancy in Language Models"β76Updated last year
- Inspecting and Editing Knowledge Representations in Language Modelsβ116Updated last year
- Official Repo for ICLR 2024 paper MINT: Evaluating LLMs in Multi-turn Interaction with Tools and Language Feedback by Xingyao Wang*, Zihaβ¦β124Updated last year
- β83Updated 9 months ago
- The official repo for "TheoremQA: A Theorem-driven Question Answering dataset" (EMNLP 2023)β32Updated last year
- β94Updated last year
- β44Updated 9 months ago
- β54Updated 2 weeks ago
- An open-source library for contamination detection in NLP datasets and Large Language Models (LLMs).β57Updated 9 months ago
- [ACL'24] Code and data of paper "When is Tree Search Useful for LLM Planning? It Depends on the Discriminator"β54Updated last year
- [EMNLP 2023] MQuAKE: Assessing Knowledge Editing in Language Models via Multi-Hop Questionsβ111Updated 8 months ago
- [ICLR 2024] Evaluating Large Language Models at Evaluating Instruction Followingβ127Updated 10 months ago
- The Paper List on Data Contamination for Large Language Models Evaluation.β95Updated 2 months ago
- Github repository for "FELM: Benchmarking Factuality Evaluation of Large Language Models" (NeurIPS 2023)β59Updated last year
- [ICLR 2023] Code for our paper "Selective Annotation Makes Language Models Better Few-Shot Learners"β109Updated last year
- Self-Alignment with Principle-Following Reward Modelsβ161Updated 3 weeks ago
- Semi-Parametric Editing with a Retrieval-Augmented Counterfactual Modelβ68Updated 2 years ago
- the instructions and demonstrations for building a formal logical reasoning capable GLMβ53Updated 9 months ago
- β48Updated last year
- Easy-to-Hard Generalization: Scalable Alignment Beyond Human Supervisionβ120Updated 8 months ago
- A library for efficient patching and automatic circuit discovery.β65Updated last month
- Code and data accompanying our paper on arXiv "Faithful Chain-of-Thought Reasoning".β159Updated last year
- The accompanying code for "Transformer Feed-Forward Layers Are Key-Value Memories". Mor Geva, Roei Schuster, Jonathan Berant, and Omer Leβ¦β91Updated 3 years ago
- β85Updated 2 years ago
- General-purpose activation steering libraryβ75Updated 3 weeks ago
- Code for the paper <SelfCheck: Using LLMs to Zero-Shot Check Their Own Step-by-Step Reasoning>β49Updated last year
- β75Updated last year
- Repo accompanying our paper "Do Llamas Work in English? On the Latent Language of Multilingual Transformers".β76Updated last year