tatsu-lab / linguistic_calibrationView external linksLinks
Align your LM to express calibrated verbal statements of confidence in its long-form generations.
☆29Jun 4, 2024Updated last year
Alternatives and similar repositories for linguistic_calibration
Users that are interested in linguistic_calibration are comparing it to the libraries listed below
Sorting:
- Uncertainty quantification for in-context learning of large language models☆15Apr 1, 2024Updated last year
- Code for the paper "Distinguishing the Knowable from the Unknowable with Language Models"☆11Apr 15, 2024Updated last year
- Teaching Models to Express Their Uncertainty in Words☆39May 26, 2022Updated 3 years ago
- ☆25Jun 10, 2025Updated 8 months ago
- ☆10Nov 1, 2019Updated 6 years ago
- ☆17May 3, 2025Updated 9 months ago
- ☆10Mar 6, 2022Updated 3 years ago
- ☆14Jul 5, 2023Updated 2 years ago
- Official repository for ALT (ALignment with Textual feedback).☆10Jul 25, 2024Updated last year
- Confidence Regulation Neurons in Language Models (NeurIPS 2024)☆15Feb 1, 2025Updated last year
- Bias Benchmark for Natural Language Inference. Code repo for the Findings of NAACL 2022 paper "On Measuring Social Biases in Prompt-Based…☆15Apr 28, 2022Updated 3 years ago
- ☆12Oct 28, 2022Updated 3 years ago
- Code and Hummingbird dataset for EMNLP 2021 paper "Does BERT Learn as Humans Perceive? Understanding Linguistic Styles through Lexica"☆15Apr 13, 2022Updated 3 years ago
- Source code for our paper: "LoGU: Long-form Generation with Uncertainty Expressions".☆16May 27, 2025Updated 8 months ago
- Code repository for the WWW 2019 paper "Predicting ConceptNet Path Quality Using Crowdsourced Assessments of Naturalness"☆13Feb 1, 2019Updated 7 years ago
- Code for☆16Oct 16, 2020Updated 5 years ago
- ☆17Nov 30, 2022Updated 3 years ago
- ☆35May 9, 2025Updated 9 months ago
- Code for the paper "Data Feedback Loops: Model-driven Amplification of Dataset Biases"☆18Sep 9, 2022Updated 3 years ago
- Official repo for Trumpets: Injective Flows for Inference and Inverse Problems☆13Jun 2, 2021Updated 4 years ago
- Code to the paper: The Geometry of Refusal in Large Language Models: Concept Cones and Representational Independence☆23Jul 31, 2025Updated 6 months ago
- Code Release for the 2023 NeurIPS Paper How does GPT-2 compute greater-than?: Interpreting mathematical abilities in a pre-trained langua…☆17Dec 6, 2024Updated last year
- ☆42Feb 2, 2024Updated 2 years ago
- Group-conditional DRO to alleviate spurious correlations☆15Jul 15, 2021Updated 4 years ago
- The code to reproduce CVPR 2021 paper "Towards Robust Classification Model by Counterfactual and Invariant Data Generation"☆17Jul 29, 2021Updated 4 years ago
- ☆12Sep 11, 2022Updated 3 years ago
- ☆24Jun 22, 2021Updated 4 years ago
- ☆20Feb 10, 2025Updated last year
- Model-agnostic posthoc calibration without distributional assumptions☆42Oct 20, 2023Updated 2 years ago
- Python package for generating datasets to evaluate reasoning and retrieval of large language models☆20Sep 22, 2025Updated 4 months ago
- code repo for ICLR 2024 paper "Can LLMs Express Their Uncertainty? An Empirical Evaluation of Confidence Elicitation in LLMs"☆144Mar 14, 2024Updated last year
- Entity Evaluation code☆21Nov 6, 2019Updated 6 years ago
- Code for identifying natural backdoors in existing image datasets.☆15Aug 24, 2022Updated 3 years ago
- ☆22Nov 1, 2025Updated 3 months ago
- Source code of "Calibrating Large Language Models Using Their Generations Only", ACL2024☆22Nov 20, 2024Updated last year
- ☆52Feb 12, 2025Updated last year
- Official code for "Decoding-Time Language Model Alignment with Multiple Objectives".☆29Oct 30, 2024Updated last year
- [ACL 2023] The code for our ACL'23 paper Cold-Start Data Selection for Few-shot Language Model Fine-tuning: A Prompt-Based Uncertainty Pr…☆24Jun 1, 2024Updated last year
- Bayesian Optimization with Density-Ratio Estimation☆24Dec 26, 2022Updated 3 years ago