shuoli90 / Rank-CalibrationLinks
This is the repo for constructing a comprehensive and rigorous evaluation framework for LLM calibration.
☆13Updated last year
Alternatives and similar repositories for Rank-Calibration
Users that are interested in Rank-Calibration are comparing it to the libraries listed below
Sorting:
- ☆28Updated 3 months ago
- Conformal Language Modeling☆29Updated last year
- Is In-Context Learning Sufficient for Instruction Following in LLMs? [ICLR 2025]☆30Updated 4 months ago
- In-context Example Selection with Influences☆15Updated 2 years ago
- ☆44Updated last year
- Learning adapter weights from task descriptions☆18Updated last year
- ☆29Updated last year
- ☆51Updated last month
- PaCE: Parsimonious Concept Engineering for Large Language Models (NeurIPS 2024)☆35Updated 7 months ago
- Code for the paper "Spectral Editing of Activations for Large Language Model Alignments"☆24Updated 5 months ago
- [NeurIPS'23] Aging with GRACE: Lifelong Model Editing with Discrete Key-Value Adaptors☆77Updated 5 months ago
- ☆40Updated last year
- ☆83Updated 9 months ago
- [NAACL'25 Oral] Steering Knowledge Selection Behaviours in LLMs via SAE-Based Representation Engineering☆58Updated 6 months ago
- Fairer Preferences Elicit Improved Human-Aligned Large Language Model Judgments (Zhou et al., EMNLP 2024)☆13Updated 8 months ago
- Codebase for Context-aware Meta-learned Loss Scaling (CaMeLS). https://arxiv.org/abs/2305.15076.☆25Updated last year
- Few-shot Learning with Auxiliary Data☆28Updated last year
- ☆50Updated last year
- ☆24Updated last year
- ☆32Updated 10 months ago
- Lightweight Adapting for Black-Box Large Language Models☆22Updated last year
- Investigating the generalization behavior of LM probes trained to predict truth labels: (1) from one annotator to another, and (2) from e…☆26Updated last year
- Align your LM to express calibrated verbal statements of confidence in its long-form generations.☆25Updated last year
- Stanford NLP Python library for benchmarking the utility of LLM interpretability methods☆92Updated this week
- Unofficial implementation of Conformal Language Modeling by Quach et al☆28Updated last year
- Applies ROME and MEMIT on Mamba-S4 models☆14Updated last year
- ☆29Updated 10 months ago
- ☆50Updated 2 months ago
- Official implementation of Vector-ICL: In-context Learning with Continuous Vector Representations☆18Updated this week
- Exploration of automated dataset selection approaches at large scales.☆42Updated 3 months ago