Alternatives and similar repositories for prontoqa

Users that are interested in prontoqa are comparing it to the libraries listed below

• evandez / REMEDI
  Inspecting and Editing Knowledge Representations in Language Models
  ☆116Updated last year
• xingyaoww / mint-bench
  Official Repo for ICLR 2024 paper MINT: Evaluating LLMs in Multi-turn Interaction with Tools and Language Feedback by Xingyao Wang*, Ziha…
  ☆125Updated last year
• csitfun / LogiCoT
  the instructions and demonstrations for building a formal logical reasoning capable GLM
  ☆53Updated 9 months ago
• OSU-NLP-Group / llm-planning-eval
  [ACL'24] Code and data of paper "When is Tree Search Useful for LLM Planning? It Depends on the Discriminator"
  ☆54Updated last year
• hkust-nlp / felm
  Github repository for "FELM: Benchmarking Factuality Evaluation of Large Language Models" (NeurIPS 2023)
  ☆59Updated last year
• WHGTyen / BIG-Bench-Mistake
  A dataset of LLM-generated chain-of-thought steps annotated with mistake location.
  ☆81Updated 10 months ago
• Edward-Sun / easy-to-hard
  Easy-to-Hard Generalization: Scalable Alignment Beyond Human Supervision
  ☆121Updated 9 months ago
• meg-tong / sycophancy-eval
  datasets from the paper "Towards Understanding Sycophancy in Language Models"
  ☆81Updated last year
• princeton-nlp / MQuAKE
  [EMNLP 2023] MQuAKE: Assessing Knowledge Editing in Language Models via Multi-Hop Questions
  ☆112Updated 9 months ago
• IBM / SALMON
  Self-Alignment with Principle-Following Reward Models
  ☆161Updated last month
• benlipkin / linc
  🔗 LINC: Logical Inference via Neurosymbolic Computation [EMNLP2023]
  ☆70Updated last year
• veronica320 / Faithful-COT
  Code and data accompanying our paper on arXiv "Faithful Chain-of-Thought Reasoning".
  ☆160Updated last year
• NoviScl / GPT3-Reliability
  ☆78Updated 2 years ago
• nkandpa2 / long_tail_knowledge
  Repo for the paper "Large Language Models Struggle to Learn Long-Tail Knowledge"
  ☆77Updated 2 years ago
• roeehendel / icl_task_vectors
  ☆95Updated last year
• CarperAI / autocrit
  A repository for transformer critique learning and generation
  ☆90Updated last year
• Zayne-sprague / MuSR
  ☆44Updated 10 months ago
• NingMiao / SelfCheck
  Code for the paper <SelfCheck: Using LLMs to Zero-Shot Check Their Own Step-by-Step Reasoning>
  ☆49Updated last year
• hitz-zentroa / lm-contamination
  The LM Contamination Index is a manually created database of contamination evidences for LMs.
  ☆78Updated last year
• ZhaofengWu / counterfactual-evaluation
  ☆55Updated last month
• HKUNLP / icl-ceil
  [ICML 2023] Code for our paper “Compositional Exemplars for In-context Learning”.
  ☆101Updated 2 years ago
• eric-mitchell / serac
  Semi-Parametric Editing with a Retrieval-Augmented Counterfactual Model
  ☆68Updated 2 years ago
• AlexTMallen / adaptive-retrieval
  ☆179Updated 2 weeks ago
• FranxYao / FlanT5-CoT-Specialization
  Implementation of ICML 23 Paper: Specializing Smaller Language Models towards Multi-Step Reasoning.
  ☆131Updated 2 years ago
• princeton-nlp / LLMBar
  [ICLR 2024] Evaluating Large Language Models at Evaluating Instruction Following
  ☆127Updated 11 months ago
• mukhal / GRACE
  Discriminator-Guided Chain-of-Thought Reasoning
  ☆48Updated 8 months ago
• saprmarks / geometry-of-truth
  ☆85Updated 10 months ago
• nayeon7lee / FactualityPrompt
  ☆86Updated 2 years ago
• OSU-NLP-Group / LLM-Knowledge-Conflict
  [ICLR'24 Spotlight] "Adaptive Chameleon or Stubborn Sloth: Revealing the Behavior of Large Language Models in Knowledge Conflicts"
  ☆69Updated last year
• yuzhaouoe / SAE-based-representation-engineering
  [NAACL'25 Oral] Steering Knowledge Selection Behaviours in LLMs via SAE-Based Representation Engineering
  ☆60Updated 7 months ago