tml-epfl / long-is-more-for-alignment
Long Is More for Alignment: A Simple but Tough-to-Beat Baseline for Instruction Fine-Tuning [ICML 2024]
☆17Updated last year
Alternatives and similar repositories for long-is-more-for-alignment
Users that are interested in long-is-more-for-alignment are comparing it to the libraries listed below
Sorting:
- Restore safety in fine-tuned language models through task arithmetic☆28Updated last year
- ☆29Updated last year
- Code for "Universal Adversarial Triggers Are Not Universal."☆17Updated last year
- ☆40Updated last year
- [ICML 2024] Junk DNA Hypothesis: A Task-Centric Angle of LLM Pre-trained Weights through Sparsity; Lu Yin*, Ajay Jaiswal*, Shiwei Liu, So…☆16Updated 3 weeks ago
- Analyzing LLM Alignment via Token distribution shift☆16Updated last year
- Providing the answer to "How to do patching on all available SAEs on GPT-2?". It is an official repository of the implementation of the p…☆11Updated 3 months ago
- ☆50Updated last year
- Code for "Tracing Knowledge in Language Models Back to the Training Data"☆38Updated 2 years ago
- A Kernel-Based View of Language Model Fine-Tuning https://arxiv.org/abs/2210.05643☆76Updated last year
- Source codes for "Preference-grounded Token-level Guidance for Language Model Fine-tuning" (NeurIPS 2023).☆16Updated 4 months ago
- Repository for "Propagating Knowledge Updates to LMs Through Distillation" (NeurIPS 2023).☆25Updated 8 months ago
- Self-Supervised Alignment with Mutual Information☆18Updated 11 months ago
- ☆14Updated 7 months ago
- [ACL'24 Oral] Analysing The Impact of Sequence Composition on Language Model Pre-Training☆21Updated 8 months ago
- Is In-Context Learning Sufficient for Instruction Following in LLMs? [ICLR 2025]☆30Updated 3 months ago
- ☆28Updated last year
- ☆14Updated last year
- GSM-Plus: Data, Code, and Evaluation for Enhancing Robust Mathematical Reasoning in Math Word Problems.☆61Updated 10 months ago
- Official repository for ICLR 2024 Spotlight paper "Large Language Models Are Not Robust Multiple Choice Selectors"☆38Updated 11 months ago
- Offcial Repo of Paper "Eliminating Position Bias of Language Models: A Mechanistic Approach""☆14Updated 8 months ago
- This is the official repo for Towards Uncertainty-Aware Language Agent.☆24Updated 9 months ago
- ☆66Updated 3 years ago
- Test-time-training on nearest neighbors for large language models☆41Updated last year
- [NeurIPS 2024 Spotlight] Code and data for the paper "Finding Transformer Circuits with Edge Pruning".☆55Updated 2 months ago
- Forcing Diffuse Distributions out of Language Models☆15Updated 8 months ago
- Align your LM to express calibrated verbal statements of confidence in its long-form generations.☆24Updated 11 months ago
- ☆9Updated last year
- Augmenting Statistical Models with Natural Language Parameters☆26Updated 7 months ago
- ☆36Updated 7 months ago