tml-epfl / long-is-more-for-alignment
Long Is More for Alignment: A Simple but Tough-to-Beat Baseline for Instruction Fine-Tuning [ICML 2024]
☆17Updated 10 months ago
Alternatives and similar repositories for long-is-more-for-alignment:
Users that are interested in long-is-more-for-alignment are comparing it to the libraries listed below
- ☆37Updated last year
- ☆29Updated 10 months ago
- This is the official repo for Towards Uncertainty-Aware Language Agent.☆24Updated 7 months ago
- Restore safety in fine-tuned language models through task arithmetic☆27Updated last year
- Is In-Context Learning Sufficient for Instruction Following in LLMs? [ICLR 2025]☆29Updated 2 months ago
- Directional Preference Alignment☆56Updated 6 months ago
- [ICML 2024] Junk DNA Hypothesis: A Task-Centric Angle of LLM Pre-trained Weights through Sparsity; Lu Yin*, Ajay Jaiswal*, Shiwei Liu, So…☆16Updated 9 months ago
- A Kernel-Based View of Language Model Fine-Tuning https://arxiv.org/abs/2210.05643☆74Updated last year
- Code for ICLR 2025 Paper "What is Wrong with Perplexity for Long-context Language Modeling?"☆44Updated last month
- Align your LM to express calibrated verbal statements of confidence in its long-form generations.☆22Updated 9 months ago
- Source codes for "Preference-grounded Token-level Guidance for Language Model Fine-tuning" (NeurIPS 2023).☆15Updated 2 months ago
- The code of “Improving Weak-to-Strong Generalization with Scalable Oversight and Ensemble Learning”☆16Updated last year
- Analyzing LLM Alignment via Token distribution shift☆15Updated last year
- [NeurIPS 2023] Github repository for "Composing Parameter-Efficient Modules with Arithmetic Operations"☆60Updated last year
- ☆25Updated 2 years ago
- A Mechanistic Understanding of Alignment Algorithms: A Case Study on DPO and Toxicity.☆69Updated 2 weeks ago
- EMNLP 2024: Model Editing Harms General Abilities of Large Language Models: Regularization to the Rescue☆35Updated 4 months ago
- ☆65Updated 3 years ago
- [NeurIPS 2024 Spotlight] Code and data for the paper "Finding Transformer Circuits with Edge Pruning".☆47Updated 2 weeks ago
- Official implementation of Bootstrapping Language Models via DPO Implicit Rewards☆43Updated 7 months ago
- Self-Supervised Alignment with Mutual Information☆16Updated 10 months ago
- ☆50Updated last year
- ☆12Updated 4 months ago
- This is an official implementation of the Reward rAnked Fine-Tuning Algorithm (RAFT), also known as iterative best-of-n fine-tuning or re…☆26Updated 6 months ago
- ☆14Updated 5 months ago
- Preprint: Asymmetry in Low-Rank Adapters of Foundation Models☆35Updated last year
- ☆9Updated 11 months ago
- ☆43Updated last year
- Official code for "Decoding-Time Language Model Alignment with Multiple Objectives".☆19Updated 4 months ago
- Code for "Universal Adversarial Triggers Are Not Universal."☆16Updated 10 months ago