tml-epfl / long-is-more-for-alignment
Long Is More for Alignment: A Simple but Tough-to-Beat Baseline for Instruction Fine-Tuning [ICML 2024]
☆17Updated 9 months ago
Alternatives and similar repositories for long-is-more-for-alignment:
Users that are interested in long-is-more-for-alignment are comparing it to the libraries listed below
- A Kernel-Based View of Language Model Fine-Tuning https://arxiv.org/abs/2210.05643☆74Updated last year
- ☆27Updated 3 months ago
- ☆34Updated last year
- Restore safety in fine-tuned language models through task arithmetic☆26Updated 10 months ago
- Codebase for Hyperdecoders https://arxiv.org/abs/2203.08304☆11Updated 2 years ago
- ☆25Updated last year
- Is In-Context Learning Sufficient for Instruction Following in LLMs? [ICLR 2025]☆29Updated 3 weeks ago
- Official implementation of Bootstrapping Language Models via DPO Implicit Rewards☆42Updated 6 months ago
- GSM-Plus: Data, Code, and Evaluation for Enhancing Robust Mathematical Reasoning in Math Word Problems.☆55Updated 7 months ago
- Align your LM to express calibrated verbal statements of confidence in its long-form generations.☆22Updated 8 months ago
- ☆30Updated 9 months ago
- Repository for "Propagating Knowledge Updates to LMs Through Distillation" (NeurIPS 2023).☆25Updated 5 months ago
- The code of “Improving Weak-to-Strong Generalization with Scalable Oversight and Ensemble Learning”☆15Updated 11 months ago
- Code for "Tracing Knowledge in Language Models Back to the Training Data"☆37Updated 2 years ago
- [NeurIPS 2024 Spotlight] Code and data for the paper "Finding Transformer Circuits with Edge Pruning".☆46Updated 2 months ago
- [ICML 2024] Junk DNA Hypothesis: A Task-Centric Angle of LLM Pre-trained Weights through Sparsity; Lu Yin*, Ajay Jaiswal*, Shiwei Liu, So…☆16Updated 8 months ago
- Code for "Universal Adversarial Triggers Are Not Universal."☆16Updated 9 months ago
- Codebase for decoding compressed trust.☆23Updated 9 months ago
- Directional Preference Alignment☆56Updated 4 months ago
- ☆19Updated last year
- EMNLP 2024: Model Editing Harms General Abilities of Large Language Models: Regularization to the Rescue☆35Updated 3 months ago
- This is the official repo for Towards Uncertainty-Aware Language Agent.☆24Updated 6 months ago
- ☆32Updated last year
- Test-time-training on nearest neighbors for large language models☆37Updated 10 months ago
- official code for paper Probing the Decision Boundaries of In-context Learning in Large Language Models. https://arxiv.org/abs/2406.11233…☆16Updated 5 months ago
- ☆14Updated 11 months ago
- ☆64Updated 2 years ago