taisazero / socratic-debugging-benchmarkLinks
The repository contains the code and dataset for the Socratic Debugging task which is a novel task for Socratically Questioning Novice Debuggers to guide them towards discovering and fixing a buggy python program.
β18Updated last year
Alternatives and similar repositories for socratic-debugging-benchmark
Users that are interested in socratic-debugging-benchmark are comparing it to the libraries listed below
Sorting:
- NAACL 2024. Code & Dataset for "π Bridging the Novice-Expert Gap via Models of Decision-Making: A Case Study on Remediating Math Mistakeβ¦β43Updated last year
- Code and Data for "Evaluating Correctness and Faithfulness of Instruction-Following Models for Question Answering"β86Updated last year
- A set of utilities for running few-shot prompting experiments on large-language modelsβ122Updated last year
- [NeurIPS 2023 Main Track] This is the repository for the paper titled "Donβt Stop Pretraining? Make Prompt-based Fine-tuning Powerful Leaβ¦β75Updated last year
- Language Models of Code are Few-Shot Commonsense Learners (EMNLP 2022)β86Updated 2 years ago
- [NeurIPS 2023] PyTorch code for Can Language Models Teach? Teacher Explanations Improve Student Performance via Theory of Mindβ66Updated last year
- Code/data for MARG (multi-agent review generation)β49Updated 10 months ago
- [ACL'24] Code and data of paper "When is Tree Search Useful for LLM Planning? It Depends on the Discriminator"β54Updated last year
- A dataset of LLM-generated chain-of-thought steps annotated with mistake location.β81Updated last year
- β43Updated last year
- β52Updated last year
- DialOp: Decision-oriented dialogue environments for collaborative language agentsβ109Updated 10 months ago
- Middleware for LLMs: Tools Are Instrumental for Language Agents in Complex Environments (EMNLP'2024)β37Updated 8 months ago
- Implementation of the paper: "Answering Questions by Meta-Reasoning over Multiple Chains of Thought"β96Updated last year
- About The corresponding code from our paper " REFINER: Reasoning Feedback on Intermediate Representations" (EACL 2024). Do not hesitate tβ¦β70Updated last year
- [ICLR 2023] Code for our paper "Selective Annotation Makes Language Models Better Few-Shot Learners"β110Updated 2 years ago
- Code and data accompanying our paper on arXiv "Faithful Chain-of-Thought Reasoning".β163Updated last year
- Code, datasets, models for the paper "Automatic Evaluation of Attribution by Large Language Models"β56Updated 2 years ago
- Code for the arXiv paper: "LLMs as Factual Reasoners: Insights from Existing Benchmarks and Beyond"β59Updated 7 months ago
- PASTA: Post-hoc Attention Steering for LLMsβ122Updated 9 months ago
- This repository includes a benchmark and code for the paper "Evaluating LLMs at Detecting Errors in LLM Responses".β30Updated last year
- [EMNLP '23] Discriminator-Guided Chain-of-Thought Reasoningβ49Updated 11 months ago
- β29Updated last year
- β74Updated last year
- β73Updated last year
- Scripts for generating synthetic finetuning data for reducing sycophancy.β116Updated 2 years ago
- PACIFIC: Towards Proactive Conversational Question Answering over Tabular and Textual Data in Financeβ14Updated last year
- Supporting code for ReCEval paperβ29Updated last year
- Code for ICLR 2024 paper "CRAFT: Customizing LLMs by Creating and Retrieving from Specialized Toolsets"β58Updated last year
- Code for the ICLR 2024 paper "How to catch an AI liar: Lie detection in black-box LLMs by asking unrelated questions"β72Updated last year