allenbai01 / transformers-as-statisticiansLinks
☆32Updated last year
Alternatives and similar repositories for transformers-as-statisticians
Users that are interested in transformers-as-statisticians are comparing it to the libraries listed below
Sorting:
- Official repository for our paper, Transformers Learn Higher-Order Optimization Methods for In-Context Learning: A Study with Linear Mode…☆16Updated 6 months ago
- ☆18Updated last year
- Code and data for the paper "Understanding Hidden Context in Preference Learning: Consequences for RLHF"☆29Updated last year
- ☆67Updated 5 months ago
- Rewarded soups official implementation☆58Updated last year
- ☆40Updated last year
- What Makes a Reward Model a Good Teacher? An Optimization Perspective☆31Updated last month
- A modern look at the relationship between sharpness and generalization [ICML 2023]☆43Updated last year
- Code for the paper: Why Transformers Need Adam: A Hessian Perspective☆59Updated 2 months ago
- Preprint: Asymmetry in Low-Rank Adapters of Foundation Models☆35Updated last year
- Code for "The Expressive Power of Low-Rank Adaptation".☆20Updated last year
- Code for Paper (Policy Optimization in RLHF: The Impact of Out-of-preference Data)☆28Updated last year
- Revisiting Efficient Training Algorithms For Transformer-based Language Models (NeurIPS 2023)☆80Updated last year
- Provably (and non-vacuously) bounding test error of deep neural networks under distribution shift with unlabeled test data.☆10Updated last year
- Code for the paper "Pretraining task diversity and the emergence of non-Bayesian in-context learning for regression"☆21Updated last year
- Distributional and Outlier Robust Optimization (ICML 2021)☆27Updated 3 years ago
- Deep Learning & Information Bottleneck☆60Updated last year
- [NeurIPS 2023 Spotlight] Temperature Balancing, Layer-wise Weight Analysis, and Neural Network Training☆35Updated last month
- This is an official repository for "LAVA: Data Valuation without Pre-Specified Learning Algorithms" (ICLR2023).☆48Updated last year
- ☆30Updated 10 months ago
- ☆15Updated 6 months ago
- This is the repository for "Model Merging by Uncertainty-Based Gradient Matching", ICLR 2024.☆27Updated last year
- Lightweight Adapting for Black-Box Large Language Models☆22Updated last year
- official code for paper Probing the Decision Boundaries of In-context Learning in Large Language Models. https://arxiv.org/abs/2406.11233…☆18Updated 9 months ago
- ☆31Updated 7 months ago
- Code for Accelerated Linearized Laplace Approximation for Bayesian Deep Learning (ELLA, NeurIPS 22')☆16Updated 2 years ago
- ☆29Updated 2 months ago
- ☆60Updated 3 years ago
- Gradient Estimation with Discrete Stein Operators (NeurIPS 2022)☆17Updated last year
- Experiments and code to generate the GINC small-scale in-context learning dataset from "An Explanation for In-context Learning as Implici…☆106Updated last year