DeqingFu / transformers-icl-second-order
Official repository for our paper, Transformers Learn Higher-Order Optimization Methods for In-Context Learning: A Study with Linear Models.
☆16Updated 5 months ago
Alternatives and similar repositories for transformers-icl-second-order:
Users that are interested in transformers-icl-second-order are comparing it to the libraries listed below
- ☆40Updated last year
- Rewarded soups official implementation☆58Updated last year
- official code for paper Probing the Decision Boundaries of In-context Learning in Large Language Models. https://arxiv.org/abs/2406.11233…☆17Updated 7 months ago
- Align your LM to express calibrated verbal statements of confidence in its long-form generations.☆23Updated 10 months ago
- ☆31Updated last year
- A Mechanistic Understanding of Alignment Algorithms: A Case Study on DPO and Toxicity.☆72Updated last month
- What Makes a Reward Model a Good Teacher? An Optimization Perspective☆23Updated 2 weeks ago
- ☆79Updated last year
- [ICLR 2025] Unintentional Unalignment: Likelihood Displacement in Direct Preference Optimization☆24Updated 3 months ago
- Code for Paper (Policy Optimization in RLHF: The Impact of Out-of-preference Data)☆28Updated last year
- ☆25Updated last year
- Source codes for "Preference-grounded Token-level Guidance for Language Model Fine-tuning" (NeurIPS 2023).☆16Updated 3 months ago
- Lightweight Adapting for Black-Box Large Language Models☆22Updated last year
- ☆28Updated last year
- Long Is More for Alignment: A Simple but Tough-to-Beat Baseline for Instruction Fine-Tuning [ICML 2024]☆17Updated 11 months ago
- official implementation of ICLR'2025 paper: Rethinking Bradley-Terry Models in Preference-based Reward Modeling: Foundations, Theory, and…☆54Updated 3 weeks ago
- Code release for "Debating with More Persuasive LLMs Leads to More Truthful Answers"☆103Updated last year
- ☆18Updated 9 months ago
- ☆50Updated 2 weeks ago
- ☆23Updated 2 months ago
- ☆93Updated last year
- Preprint: Asymmetry in Low-Rank Adapters of Foundation Models☆36Updated last year
- ☆90Updated 9 months ago
- ☆13Updated last year
- ☆17Updated last year
- Code for "Reasoning to Learn from Latent Thoughts"☆91Updated 3 weeks ago
- ☆30Updated 5 months ago
- Code for the paper "The Journey, Not the Destination: How Data Guides Diffusion Models"☆22Updated last year
- ☆12Updated 10 months ago
- ☆14Updated 2 months ago