tml-epfl / long-is-more-for-alignment
Long Is More for Alignment: A Simple but Tough-to-Beat Baseline for Instruction Fine-Tuning [ICML 2024]
☆17Updated 11 months ago
Alternatives and similar repositories for long-is-more-for-alignment:
Users that are interested in long-is-more-for-alignment are comparing it to the libraries listed below
- Restore safety in fine-tuned language models through task arithmetic☆28Updated last year
- ☆40Updated last year
- A Kernel-Based View of Language Model Fine-Tuning https://arxiv.org/abs/2210.05643☆75Updated last year
- This is the official repo for Towards Uncertainty-Aware Language Agent.☆24Updated 8 months ago
- ☆14Updated last year
- Is In-Context Learning Sufficient for Instruction Following in LLMs? [ICLR 2025]☆29Updated 3 months ago
- Align your LM to express calibrated verbal statements of confidence in its long-form generations.☆22Updated 10 months ago
- [ICML 2024] Junk DNA Hypothesis: A Task-Centric Angle of LLM Pre-trained Weights through Sparsity; Lu Yin*, Ajay Jaiswal*, Shiwei Liu, So…☆16Updated 10 months ago
- ☆29Updated 11 months ago
- ☆14Updated 6 months ago
- Analyzing LLM Alignment via Token distribution shift☆16Updated last year
- Directional Preference Alignment☆57Updated 7 months ago
- [NeurIPS 2023] Github repository for "Composing Parameter-Efficient Modules with Arithmetic Operations"☆60Updated last year
- Codebase for Hyperdecoders https://arxiv.org/abs/2203.08304☆11Updated 2 years ago
- Official implementation of Bootstrapping Language Models via DPO Implicit Rewards☆43Updated last week
- ☆12Updated 4 months ago
- official code for paper Probing the Decision Boundaries of In-context Learning in Large Language Models. https://arxiv.org/abs/2406.11233…☆17Updated 7 months ago
- Code for "Tracing Knowledge in Language Models Back to the Training Data"☆37Updated 2 years ago
- ☆15Updated last week
- Code for "Universal Adversarial Triggers Are Not Universal."☆17Updated 11 months ago
- GSM-Plus: Data, Code, and Evaluation for Enhancing Robust Mathematical Reasoning in Math Word Problems.☆59Updated 9 months ago
- [NeurIPS 2024 Spotlight] Code and data for the paper "Finding Transformer Circuits with Edge Pruning".☆52Updated last month
- The code of “Improving Weak-to-Strong Generalization with Scalable Oversight and Ensemble Learning”☆16Updated last year
- ☆66Updated 3 years ago
- ☆9Updated last year
- [ICLR'25 Spotlight] Min-K%++: Improved baseline for detecting pre-training data of LLMs☆37Updated 2 months ago
- Learning adapter weights from task descriptions☆16Updated last year
- Test-time-training on nearest neighbors for large language models☆40Updated last year
- ☆93Updated last year
- ☆25Updated 2 years ago