Alternatives and similar repositories for socratic-debugging-benchmark

Users that are interested in socratic-debugging-benchmark are comparing it to the libraries listed below

• SALT-NLP / CultureBank
  ☆42Updated last year
• rosewang2008 / bridge
  NAACL 2024. Code & Dataset for "🌁 Bridging the Novice-Expert Gap via Models of Decision-Making: A Case Study on Remediating Math Mistake…
  ☆39Updated 10 months ago
• zorazrw / odex
  [EMNLP'23] Execution-Based Evaluation for Open Domain Code Generation
  ☆48Updated last year
• minalee-research / coauthor-interface
  ☆95Updated last year
• tsor13 / kaleido
  ☆22Updated last year
• sotopia-lab / sotopia-pi
  Sotopia-π: Interactive Learning of Socially Intelligent Language Agents (ACL 2024)
  ☆65Updated last year
• hitz-zentroa / lm-contamination
  The LM Contamination Index is a manually created database of contamination evidences for LMs.
  ☆78Updated last year
• ninodimontalcino / moralchoice
  Evaluating the Moral Beliefs Encoded in LLMs
  ☆26Updated 5 months ago
• OSU-NLP-Group / Middleware
  Middleware for LLMs: Tools Are Instrumental for Language Agents in Complex Environments (EMNLP'2024)
  ☆36Updated 5 months ago
• swarnaHub / ExplanationIntervention
  [NeurIPS 2023] PyTorch code for Can Language Models Teach? Teacher Explanations Improve Student Performance via Theory of Mind
  ☆67Updated last year
• sotopia-lab / awesome-social-agents
  A collection of works that investigate social agents, simulations and their real-world impact in text, embodied, and robotics contexts.
  ☆89Updated last year
• google-research-datasets / GSM-IC
  Grade-School Math with Irrelevant Context (GSM-IC) benchmark is an arithmetic reasoning dataset built upon GSM8K, by adding irrelevant se…
  ☆60Updated 2 years ago
• OSU-NLP-Group / AttrScore
  Code, datasets, models for the paper "Automatic Evaluation of Attribution by Large Language Models"
  ☆56Updated last year
• allenai / dream
  ☆24Updated 9 months ago
• behavioral-data / BOLT
  A Computational Framework for Behavioral Assessment of LLM Therapists
  ☆27Updated 7 months ago
• microsoft / HaDes
  Token-level Reference-free Hallucination Detection
  ☆94Updated last year
• skywalker023 / fantom
  👻 Code and benchmark for our EMNLP 2023 paper - "FANToM: A Benchmark for Stress-testing Machine Theory of Mind in Interactions"
  ☆55Updated last year
• BunsenFeng / PoliLean
  Code for "From Pretraining Data to Language Models to Downstream Tasks: Tracking the Trails of Political Biases Leading to Unfair NLP Mod…
  ☆37Updated last year
• Nanami18 / Snowballed_Hallucination
  ☆44Updated 9 months ago
• allenai / CommaQA
  Code and Dataset for Learning to Solve Complex Tasks by Talking to Agents
  ☆24Updated 3 years ago
• xlang-ai / icl-selective-annotation
  [ICLR 2023] Code for our paper "Selective Annotation Makes Language Models Better Few-Shot Learners"
  ☆109Updated last year
• allenai / noncompliance
  This repository contains data, code and models for contextual noncompliance.
  ☆22Updated 10 months ago
• allenai / marg-reviewer
  Code/data for MARG (multi-agent review generation)
  ☆43Updated 6 months ago
• WHGTyen / BIG-Bench-Mistake
  A dataset of LLM-generated chain-of-thought steps annotated with mistake location.
  ☆81Updated 9 months ago
• reasoning-machines / prompt-lib
  A set of utilities for running few-shot prompting experiments on large-language models
  ☆121Updated last year
• dmg-illc / JUDGE-BENCH
  ☆26Updated last week
• HanjieChen / REV
  Code for the paper "REV: Information-Theoretic Evaluation of Free-Text Rationales"
  ☆15Updated last year
• scandukuri / assistant-gate
  ☆24Updated last year
• tatsu-lab / opinions_qa
  ☆106Updated last year
• petezh / OpenD5
  Tasks for describing differences between text distributions.
  ☆16Updated 9 months ago