Align your LM to express calibrated verbal statements of confidence in its long-form generations.
☆29Jun 4, 2024Updated last year
Alternatives and similar repositories for linguistic_calibration
Users that are interested in linguistic_calibration are comparing it to the libraries listed below
Sorting:
- Uncertainty quantification for in-context learning of large language models☆15Apr 1, 2024Updated last year
- Code for the paper "Distinguishing the Knowable from the Unknowable with Language Models"☆11Apr 15, 2024Updated last year
- Teaching Models to Express Their Uncertainty in Words☆39May 26, 2022Updated 3 years ago
- ☆25Jun 10, 2025Updated 8 months ago
- ☆10Mar 6, 2022Updated 4 years ago
- ☆18May 3, 2025Updated 10 months ago
- ☆10Nov 1, 2019Updated 6 years ago
- ☆14Jul 5, 2023Updated 2 years ago
- Confidence Regulation Neurons in Language Models (NeurIPS 2024)☆15Feb 1, 2025Updated last year
- Official repository for ALT (ALignment with Textual feedback).☆10Jul 25, 2024Updated last year
- ☆12Oct 28, 2022Updated 3 years ago
- Bias Benchmark for Natural Language Inference. Code repo for the Findings of NAACL 2022 paper "On Measuring Social Biases in Prompt-Based…☆15Apr 28, 2022Updated 3 years ago
- Code and Hummingbird dataset for EMNLP 2021 paper "Does BERT Learn as Humans Perceive? Understanding Linguistic Styles through Lexica"☆15Apr 13, 2022Updated 3 years ago
- Source code for our paper: "LoGU: Long-form Generation with Uncertainty Expressions".☆16May 27, 2025Updated 9 months ago
- Code repository for the WWW 2019 paper "Predicting ConceptNet Path Quality Using Crowdsourced Assessments of Naturalness"☆13Feb 1, 2019Updated 7 years ago
- ☆36May 9, 2025Updated 10 months ago
- Official repo for Trumpets: Injective Flows for Inference and Inverse Problems☆13Jun 2, 2021Updated 4 years ago
- Code for the paper "Data Feedback Loops: Model-driven Amplification of Dataset Biases"☆18Sep 9, 2022Updated 3 years ago
- ☆17Nov 30, 2022Updated 3 years ago
- Code for☆16Oct 16, 2020Updated 5 years ago
- MDL Complexity computations and experiments from the paper "Revisiting complexity and the bias-variance tradeoff".☆18Jun 12, 2023Updated 2 years ago
- Code Release for the 2023 NeurIPS Paper How does GPT-2 compute greater-than?: Interpreting mathematical abilities in a pre-trained langua…☆17Dec 6, 2024Updated last year
- ☆42Feb 2, 2024Updated 2 years ago
- ☆12Sep 11, 2022Updated 3 years ago
- Code to the paper: The Geometry of Refusal in Large Language Models: Concept Cones and Representational Independence☆26Jul 31, 2025Updated 7 months ago
- The code to reproduce CVPR 2021 paper "Towards Robust Classification Model by Counterfactual and Invariant Data Generation"☆17Jul 29, 2021Updated 4 years ago
- Group-conditional DRO to alleviate spurious correlations☆15Jul 15, 2021Updated 4 years ago
- Model-agnostic posthoc calibration without distributional assumptions☆42Oct 20, 2023Updated 2 years ago
- ☆24Jun 22, 2021Updated 4 years ago
- Python package for generating datasets to evaluate reasoning and retrieval of large language models☆20Feb 23, 2026Updated 2 weeks ago
- code repo for ICLR 2024 paper "Can LLMs Express Their Uncertainty? An Empirical Evaluation of Confidence Elicitation in LLMs"☆145Mar 14, 2024Updated last year
- ☆22Nov 1, 2025Updated 4 months ago
- Source code of "Calibrating Large Language Models Using Their Generations Only", ACL2024☆22Nov 20, 2024Updated last year
- Code for identifying natural backdoors in existing image datasets.☆15Aug 24, 2022Updated 3 years ago
- Entity Evaluation code☆21Nov 6, 2019Updated 6 years ago
- [ACL 2023] The code for our ACL'23 paper Cold-Start Data Selection for Few-shot Language Model Fine-tuning: A Prompt-Based Uncertainty Pr…☆24Jun 1, 2024Updated last year
- Bayesian Optimization with Density-Ratio Estimation☆24Dec 26, 2022Updated 3 years ago
- Lightweight Adapting for Black-Box Large Language Models☆25Feb 15, 2024Updated 2 years ago
- The simplest repository for training medium-sized BackpackLM for cs224n☆25Aug 13, 2023Updated 2 years ago