activatedgeek / calibration-tuning
☆43Updated 5 months ago
Alternatives and similar repositories for calibration-tuning:
Users that are interested in calibration-tuning are comparing it to the libraries listed below
- [NAACL'25] Steering Knowledge Selection Behaviours in LLMs via SAE-Based Representation Engineering☆41Updated 2 months ago
- [EMNLP Findings 2024 & ACL 2024 NLRSE Oral] Enhancing Mathematical Reasoning in Language Models with Fine-grained Rewards☆49Updated 8 months ago
- ☆78Updated 10 months ago
- This is an official implementation of the Reward rAnked Fine-Tuning Algorithm (RAFT), also known as iterative best-of-n fine-tuning or re…☆22Updated 4 months ago
- Directional Preference Alignment☆54Updated 4 months ago
- A library for efficient patching and automatic circuit discovery.☆48Updated 2 months ago
- Skill-It! A Data-Driven Skills Framework for Understanding and Training Language Models☆43Updated last year
- Easy-to-Hard Generalization: Scalable Alignment Beyond Human Supervision☆112Updated 4 months ago
- ☆75Updated 5 months ago
- ☆34Updated 11 months ago
- ☆86Updated last year
- Implementation of PaCE: Parsimonious Concept Engineering for Large Language Models (NeurIPS 2024)☆31Updated 2 months ago
- Long Context Extension and Generalization in LLMs☆40Updated 4 months ago
- Align your LM to express calibrated verbal statements of confidence in its long-form generations.☆21Updated 7 months ago
- Function Vectors in Large Language Models (ICLR 2024)☆135Updated 3 months ago
- ☆27Updated 10 months ago
- ☆25Updated last year
- Augmenting Statistical Models with Natural Language Parameters☆22Updated 4 months ago
- ☆27Updated 2 months ago
- ☆26Updated 6 months ago
- ☆44Updated 4 months ago
- [NeurIPS 2024 Spotlight] Code and data for the paper "Finding Transformer Circuits with Edge Pruning".☆45Updated last month
- Official implementation of Bootstrapping Language Models via DPO Implicit Rewards☆42Updated 6 months ago
- GSM-Plus: Data, Code, and Evaluation for Enhancing Robust Mathematical Reasoning in Math Word Problems.☆55Updated 6 months ago
- The accompanying code for "Transformer Feed-Forward Layers Are Key-Value Memories". Mor Geva, Roei Schuster, Jonathan Berant, and Omer Le…☆89Updated 3 years ago
- [ACL 2024] Self-Training with Direct Preference Optimization Improves Chain-of-Thought Reasoning☆36Updated 6 months ago
- Official repository for paper "Weak-to-Strong Extrapolation Expedites Alignment"☆71Updated 7 months ago
- This repository contains the code used for the experiments in the paper "Fine-Tuning Enhances Existing Mechanisms: A Case Study on Entity…