Alternatives and similar repositories for PLMCalibration:

Users that are interested in PLMCalibration are comparing it to the libraries listed below

• genglinliu / UnknownBench
  Repo for paper: Examining LLMs' Uncertainty Expression Towards Questions Outside Parametric Knowledge
  ☆13Updated last year
• nayeon7lee / FactualityPrompt
  ☆85Updated 2 years ago
• edenbiran / RippleEdits
  Evaluating the Ripple Effects of Knowledge Editing in Language Models
  ☆54Updated 11 months ago
• hkust-nlp / felm
  Github repository for "FELM: Benchmarking Factuality Evaluation of Large Language Models" (NeurIPS 2023)
  ☆58Updated last year
• GAIR-NLP / alignment-for-honesty
  ☆73Updated 10 months ago
• GXimingLu / Quark
  ☆75Updated last year
• Re-Align / AlignTDS
  Analyzing LLM Alignment via Token distribution shift
  ☆15Updated last year
• yizhongw / llm-temporal-alignment
  Methods and evaluation for aligning language models temporally
  ☆27Updated last year
• princeton-nlp / MQuAKE
  [EMNLP 2023] MQuAKE: Assessing Knowledge Editing in Language Models via Multi-Hop Questions
  ☆107Updated 6 months ago
• GAIR-NLP / BeHonest
  BeHonest: Benchmarking Honesty in Large Language Models
  ☆31Updated 7 months ago
• feyzaakyurek / dune
  Dataset for Unified Editing, EMNLP 2023. This is a model editing dataset where edits are natural language phrases.
  ☆23Updated 6 months ago
• dannyallover / overthinking_the_truth
  ☆30Updated 10 months ago
• HillZhang1999 / ICD
  Code & Data for our Paper "Alleviating Hallucinations of Large Language Models through Induced Hallucinations"
  ☆63Updated last year
• hanningzhang / prm
  ☆15Updated 4 months ago
• dDua / succesive_prompting
  ☆9Updated 2 years ago
• CriticBench / CriticBench
  [ACL 2024 Findings] CriticBench: Benchmarking LLMs for Critique-Correct Reasoning
  ☆24Updated last year
• yuzhaouoe / SAE-based-representation-engineering
  [NAACL'25 Oral] Steering Knowledge Selection Behaviours in LLMs via SAE-Based Representation Engineering
  ☆52Updated 4 months ago
• WebQnA / WebQA
  ☆49Updated 2 months ago
• google-research-datasets / GSM-IC
  Grade-School Math with Irrelevant Context (GSM-IC) benchmark is an arithmetic reasoning dataset built upon GSM8K, by adding irrelevant se…
  ☆58Updated 2 years ago
• OhadRubin / EPR
  ☆61Updated 2 years ago
• SumilerGAO / SunGen
  ☆25Updated 2 years ago
• dqxiu / CaliNet
  ☆33Updated 2 years ago
• swj0419 / in-context-pretraining
  ☆48Updated 11 months ago
• eric-mitchell / serac
  Semi-Parametric Editing with a Retrieval-Augmented Counterfactual Model
  ☆66Updated 2 years ago
• acl-org / arr-health
  Monitoring the health of ARR
  ☆20Updated 2 months ago
• MtSomeThree / constrDecoding
  Constrained Decoding Project
  ☆17Updated last year
• ellaneeman / disent_qa
  This code accompanies the paper DisentQA: Disentangling Parametric and Contextual Knowledge with Counterfactual Question Answering.
  ☆17Updated 2 years ago
• Nanami18 / Snowballed_Hallucination
  ☆44Updated 6 months ago
• lifan-yuan / OOD_NLP
  [NeurIPS 2023 D&B Track] Code and data for paper "Revisiting Out-of-distribution Robustness in NLP: Benchmarks, Analysis, and LLMs Evalua…
  ☆32Updated last year
• HKUST-KnowComp / CSKB-Population
  Codes for the EMNLP2021 paper: Benchmarking Commonsense Knowledge Base Population (https://aclanthology.org/2021.emnlp-main.705.pdf). An …
  ☆26Updated last year