chengxiang / LinearTransformer

Related projects ⓘ

Alternatives and complementary repositories for LinearTransformer

• locuslab / edge-of-stability
  ☆59Updated 3 years ago
• WeiHuang05 / Awesome_Large_Foundation_Model_Theory
  Welcome to the 'In Context Learning Theory' Reading Group
  ☆22Updated this week
• aw31 / empirical-ntks
  Efficient empirical NTKs in PyTorch
  ☆16Updated 2 years ago
• kwignb / NeuralTangentKernel-Papers
  Neural Tangent Kernel Papers
  ☆92Updated 8 months ago
• MaximeRobeyns / bayesian_lora
  Bayesian Low-Rank Adaptation for Large Language Models
  ☆27Updated 4 months ago
• tml-epfl / understanding-sam
  Towards Understanding Sharpness-Aware Minimization [ICML 2022]
  ☆35Updated 2 years ago
• KindXiaoming / Omnigrok
  Omnigrok: Grokking Beyond Algorithmic Data
  ☆49Updated last year
• tding1 / Neural-Collapse
  [NeurIPS 2021] A Geometric Analysis of Neural Collapse with Unconstrained Features
  ☆53Updated 2 years ago
• gortizji / tangent_task_arithmetic
  Source code of "Task arithmetic in the tangent space: Improved editing of pre-trained models".
  ☆84Updated last year
• gortizji / linearized-networks
  Source code of "What can linearized neural networks actually say about generalization?
  ☆18Updated 3 years ago
• adamxyang / laplace-lora
  Bayesian low-rank adaptation for large language models
  ☆23Updated 6 months ago
• mueller-mp / SAM-ON
  ☆32Updated 9 months ago
• reds-lab / LAVA
  This is an official repository for "LAVA: Data Valuation without Pre-Specified Learning Algorithms" (ICLR2023).
  ☆44Updated 5 months ago
• tml-epfl / sharpness-vs-generalization
  A modern look at the relationship between sharpness and generalization [ICML 2023]
  ☆42Updated last year
• mariuslindegaard / Intermediate_Neural_Collapse
  (ICML 2023) Feature learning in deep classifiers through Intermediate Neural Collapse: Accompanying code
  ☆13Updated last year
• allenbai01 / transformers-as-statisticians
  ☆26Updated last year
• dtsip / in-context-learning
  ☆197Updated 6 months ago
• xu-ji / information-bottleneck
  Deep Learning & Information Bottleneck
  ☆50Updated last year
• andyjm3 / Awesome-Riemannian-Optimization
  This repo contains papers, books, tutorials and resources on Riemannian optimization.
  ☆15Updated this week
• JeanKaddour / NoTrainNoGain
  Revisiting Efficient Training Algorithms For Transformer-based Language Models (NeurIPS 2023)
  ☆79Updated last year
• hushon / JAX-ResNet-CIFAR10
  Simple CIFAR10 ResNet example with JAX.
  ☆21Updated 3 years ago
• mansheej / icl-task-diversity
  Code for the paper "Pretraining task diversity and the emergence of non-Bayesian in-context learning for regression"
  ☆20Updated last year
• zyushun / hessian-spectrum
  Code for the paper: Why Transformers Need Adam: A Hessian Perspective
  ☆40Updated 6 months ago
• tml-epfl / sam-low-rank-features
  Sharpness-Aware Minimization Leads to Low-Rank Features [NeurIPS 2023]
  ☆25Updated last year
• AngusDujw / SAF
  ☆32Updated last year
• MadryLab / failure-directions
  Distilling Model Failures as Directions in Latent Space
  ☆45Updated last year
• pomonam / kronfluence
  Influence Functions with (Eigenvalue-corrected) Kronecker-Factored Approximate Curvature
  ☆100Updated 3 months ago
• huaxiuyao / Wild-Time
  Benchmark for Natural Temporal Distribution Shift (NeurIPS 2022)
  ☆61Updated last year
• google-research / jax-influence
  ☆59Updated 2 years ago
• Varal7 / conformal-language-modeling
  Conformal Language Modeling
  ☆22Updated 10 months ago