DeqingFu / transformers-icl-second-orderLinks
Official repository for our paper, Transformers Learn Higher-Order Optimization Methods for In-Context Learning: A Study with Linear Models.
☆18Updated 11 months ago
Alternatives and similar repositories for transformers-icl-second-order
Users that are interested in transformers-icl-second-order are comparing it to the libraries listed below
Sorting:
- ☆23Updated 8 months ago
- ☆107Updated 8 months ago
- ☆45Updated last year
- Universal Neurons in GPT2 Language Models☆30Updated last year
- ☆185Updated last year
- Rewarded soups official implementation☆60Updated 2 years ago
- A library for efficient patching and automatic circuit discovery.☆78Updated 3 months ago
- ☆52Updated 6 months ago
- ☆103Updated last year
- Code release for "Debating with More Persuasive LLMs Leads to More Truthful Answers"☆117Updated last year
- A Mechanistic Understanding of Alignment Algorithms: A Case Study on DPO and Toxicity.☆82Updated 7 months ago
- Sparse Autoencoder Training Library☆55Updated 5 months ago
- ☆23Updated 10 months ago
- Code for "Echo Chamber: RL Post-training Amplifies Behaviors Learned in Pretraining"☆22Updated last week
- ☆50Updated last year
- ☆83Updated 2 years ago
- ☆53Updated last year
- ☆34Updated 2 years ago
- [NeurIPS 2023 Spotlight] Temperature Balancing, Layer-wise Weight Analysis, and Neural Network Training☆35Updated 6 months ago
- This repository contains the code used for the experiments in the paper "Fine-Tuning Enhances Existing Mechanisms: A Case Study on Entity…☆28Updated last year
- Gemstones: A Model Suite for Multi-Faceted Scaling Laws (NeurIPS 2025)☆29Updated 3 weeks ago
- Code for my NeurIPS 2024 ATTRIB paper titled "Attribution Patching Outperforms Automated Circuit Discovery"☆43Updated last year
- ☆240Updated last year
- Lightweight Adapting for Black-Box Large Language Models☆23Updated last year
- ☆16Updated last year
- ☆32Updated last year
- Official implementation of Bootstrapping Language Models via DPO Implicit Rewards☆44Updated 6 months ago
- Code for "Reasoning to Learn from Latent Thoughts"☆121Updated 6 months ago
- ☆86Updated 6 months ago
- ☆20Updated last year