Alternatives and similar repositories for supervised-llm-uncertainty-estimation

Users that are interested in supervised-llm-uncertainty-estimation are comparing it to the libraries listed below

• tatsu-lab / test_set_contamination
  ☆37Updated last year
• hkust-nlp / Activation_Decoding
  In-Context Sharpness as Alerts: An Inner Representation Perspective for Hallucination Mitigation (ICML 2024)
  ☆59Updated last year
• yihuaihong / ConceptVectors
  ConceptVectors Benchmark and Code for the paper "Intrinsic Evaluation of Unlearning Using Parametric Knowledge Traces"
  ☆35Updated 3 months ago
• declare-lab / trust-align
  Codes and datasets for the paper Measuring and Enhancing Trustworthiness of LLMs in RAG through Grounded Attributions and Learning to Ref…
  ☆57Updated 3 months ago
• paul-rottger / xstest
  Röttger et al. (NAACL 2024): "XSTest: A Test Suite for Identifying Exaggerated Safety Behaviours in Large Language Models"
  ☆97Updated 3 months ago
• LoryPack / LLM-LieDetector
  Code for the ICLR 2024 paper "How to catch an AI liar: Lie detection in black-box LLMs by asking unrelated questions"
  ☆70Updated 11 months ago
• balevinstein / Probes
  ☆50Updated last year
• Luckfort / CD
  [COLING'25] Exploring Concept Depth: How Large Language Models Acquire Knowledge at Different Layers?
  ☆78Updated 4 months ago
• deeplearning-wisc / haloscope
  source code for NeurIPS'24 paper "HaloScope: Harnessing Unlabeled LLM Generations for Hallucination Detection"
  ☆44Updated last month
• tianyang-x / SaySelf
  Public code repo for paper "SaySelf: Teaching LLMs to Express Confidence with Self-Reflective Rationales"
  ☆106Updated 8 months ago
• tonychenxyz / selfie
  This repository contains the code and data for the paper "SelfIE: Self-Interpretation of Large Language Model Embeddings" by Haozhe Chen,…
  ☆49Updated 5 months ago
• IBM / activation-steering
  General-purpose activation steering library
  ☆75Updated 3 weeks ago
• OSU-NLP-Group / LLM-Knowledge-Conflict
  [ICLR'24 Spotlight] "Adaptive Chameleon or Stubborn Sloth: Revealing the Behavior of Large Language Models in Knowledge Conflicts"
  ☆68Updated last year
• activatedgeek / calibration-tuning
  ☆51Updated last month
• milesaturpin / cot-unfaithfulness
  ☆44Updated last year
• QingruZhang / PASTA
  PASTA: Post-hoc Attention Steering for LLMs
  ☆117Updated 6 months ago
• alisawuffles / proxy-tuning
  Code associated with Tuning Language Models by Proxy (Liu et al., 2024)
  ☆110Updated last year
• CaoYuanpu / BiPO
  Personalized Steering of Large Language Models: Versatile Steering Vectors Through Bi-directional Preference Optimization
  ☆25Updated 10 months ago
• ajyl / dpo_toxic
  A Mechanistic Understanding of Alignment Algorithms: A Case Study on DPO and Toxicity.
  ☆72Updated 2 months ago
• Scarelette / CultureLLM
  ☆31Updated 7 months ago
• BunsenFeng / AbstainQA
  AbstainQA, ACL 2024
  ☆25Updated 7 months ago
• fc2869 / lo-fit
  LoFiT: Localized Fine-tuning on LLM Representations
  ☆39Updated 4 months ago
• technion-cs-nlp / LLMsKnow
  ☆70Updated 4 months ago
• chrisliu298 / awesome-representation-engineering
  A resource repository for representation engineering in large language models
  ☆124Updated 6 months ago
• google-research-datasets / GSM-IC
  Grade-School Math with Irrelevant Context (GSM-IC) benchmark is an arithmetic reasoning dataset built upon GSM8K, by adding irrelevant se…
  ☆60Updated 2 years ago
• zankner / CLoud
  Critique-out-Loud Reward Models
  ☆66Updated 7 months ago
• stanfordnlp / axbench
  Stanford NLP Python library for benchmarking the utility of LLM interpretability methods
  ☆89Updated last week
• Nanami18 / Snowballed_Hallucination
  ☆44Updated 9 months ago
• yuzhaouoe / SAE-based-representation-engineering
  [NAACL'25 Oral] Steering Knowledge Selection Behaviours in LLMs via SAE-Based Representation Engineering
  ☆58Updated 6 months ago
• ucl-dark / llm_debate
  Code release for "Debating with More Persuasive LLMs Leads to More Truthful Answers"
  ☆107Updated last year