chengxiang / LinearTransformer
Pytorch code for experiments on Linear Transformers
☆13Updated 10 months ago
Related projects ⓘ
Alternatives and complementary repositories for LinearTransformer
- Welcome to the 'In Context Learning Theory' Reading Group☆22Updated last week
- ☆59Updated 3 years ago
- This repo contains papers, books, tutorials and resources on Riemannian optimization.☆18Updated last week
- Efficient empirical NTKs in PyTorch☆16Updated 2 years ago
- Bayesian Low-Rank Adaptation for Large Language Models☆28Updated 4 months ago
- Neural Tangent Kernel Papers☆94Updated 8 months ago
- Towards Understanding Sharpness-Aware Minimization [ICML 2022]☆35Updated 2 years ago
- This is an official repository for "LAVA: Data Valuation without Pre-Specified Learning Algorithms" (ICLR2023).☆44Updated 5 months ago
- (ICML 2023) Feature learning in deep classifiers through Intermediate Neural Collapse: Accompanying code☆13Updated last year
- ☆58Updated 2 years ago
- Revisiting Efficient Training Algorithms For Transformer-based Language Models (NeurIPS 2023)☆79Updated last year
- Deep Learning & Information Bottleneck☆50Updated last year
- Code for the paper: Why Transformers Need Adam: A Hessian Perspective☆42Updated 6 months ago
- Source code of "What can linearized neural networks actually say about generalization?☆18Updated 3 years ago
- A modern look at the relationship between sharpness and generalization [ICML 2023]☆43Updated last year
- Simple CIFAR10 ResNet example with JAX.☆21Updated 3 years ago
- This repository includes code to reproduce the tables in "Loss Landscapes are All You Need: Neural Network Generalization Can Be Explaine…☆34Updated last year
- Official repository for our paper, Transformers Learn Higher-Order Optimization Methods for In-Context Learning: A Study with Linear Mode…☆13Updated this week
- Bayesian low-rank adaptation for large language models☆23Updated 6 months ago
- ☆58Updated 2 years ago
- [NeurIPS 2021] A Geometric Analysis of Neural Collapse with Unconstrained Features☆53Updated 2 years ago
- ☆33Updated 9 months ago
- Influence Functions with (Eigenvalue-corrected) Kronecker-Factored Approximate Curvature☆104Updated 3 months ago
- Welcome to the Awesome Feature Learning in Deep Learning Thoery Reading Group! This repository serves as a collaborative platform for sch…☆143Updated 3 weeks ago
- Sharpness-Aware Minimization Leads to Low-Rank Features [NeurIPS 2023]☆25Updated last year
- Code for the paper "Pretraining task diversity and the emergence of non-Bayesian in-context learning for regression"☆20Updated last year
- unofficial re-implementation of "Grokking: Generalization Beyond Overfitting on Small Algorithmic Datasets"☆63Updated 2 years ago
- Pytorch code for "Improving Self-Supervised Learning by Characterizing Idealized Representations"☆40Updated last year
- ☆13Updated 6 months ago
- ☆26Updated last year