Alternatives and similar repositories for Riemannian_Preconditioned_LoRA:

Users that are interested in Riemannian_Preconditioned_LoRA are comparing it to the libraries listed below

• chengxiang / LinearTransformer
  Pytorch code for experiments on Linear Transformers
  ☆18Updated last year
• gortizji / linearized-networks
  Source code of "What can linearized neural networks actually say about generalization?
  ☆20Updated 3 years ago
• MaximeRobeyns / bayesian_lora
  Bayesian Low-Rank Adaptation for Large Language Models
  ☆29Updated 7 months ago
• tml-epfl / sharpness-vs-generalization
  A modern look at the relationship between sharpness and generalization [ICML 2023]
  ☆43Updated last year
• xu-ji / information-bottleneck
  Deep Learning & Information Bottleneck
  ☆56Updated last year
• andyjm3 / SLTrain
  SLTrain: a sparse plus low-rank approach for parameter and memory efficient pretraining (NeurIPS 2024)
  ☆30Updated 3 months ago
• cjyaras / deep-lora-transformers
  Compressible Dynamics in Deep Overparameterized Low-Rank Learning & Adaptation (ICML'24 Oral)
  ☆14Updated 6 months ago
• locuslab / edge-of-stability
  ☆63Updated 2 months ago
• mueller-mp / SAM-ON
  ☆34Updated last year
• Wang-ML-Lab / bayesian-peft
  [NeurIPS 2024] BLoB: Bayesian Low-Rank Adaptation by Backpropagation for Large Language Models
  ☆23Updated 3 weeks ago
• zzp1012 / LLFC
  [NeurIPS 2023] Code release for "Going Beyond Linear Mode Connectivity: The Layerwise Linear Feature Connectivity"
  ☆17Updated last year
• r-three / mats
  ☆28Updated 7 months ago
• AvivNavon / DWSNets
  Official implementation for Equivariant Architectures for Learning in Deep Weight Spaces [ICML 2023]
  ☆86Updated last year
• tanganke / peta
  Code for paper "Parameter Efficient Multi-task Model Fusion with Partial Linearization"
  ☆18Updated 5 months ago
• hendrydong / NTK-and-MF-examples
  Visualization of mean field and neural tangent kernel regime
  ☆21Updated 6 months ago
• tml-epfl / sam-low-rank-features
  Sharpness-Aware Minimization Leads to Low-Rank Features [NeurIPS 2023]
  ☆27Updated last year
• ablghtianyi / ICL_Modular_Arithmetic
  ☆18Updated 3 months ago
• JonasGeiping / dataaugs
  ☆17Updated 2 years ago
• Ping-C / optimizer
  This repository includes code to reproduce the tables in "Loss Landscapes are All You Need: Neural Network Generalization Can Be Explaine…
  ☆35Updated last year
• allenbai01 / transformers-as-statisticians
  ☆28Updated last year
• WeiHuang05 / Awesome_Large_Foundation_Model_Theory
  Welcome to the 'In Context Learning Theory' Reading Group
  ☆28Updated 3 months ago
• yolky / RFAD
  Code for the paper "Efficient Dataset Distillation using Random Feature Approximation"
  ☆37Updated last year
• nik-dim / tall_masks
  Official repository of "Localizing Task Information for Improved Model Merging and Compression" [ICML 2024]
  ☆39Updated 3 months ago
• stephane-rivaud / ForwardLocalGradient
  This is the official implementation of the ICML 2023 paper - Can Forward Gradient Match Backpropagation ?
  ☆12Updated last year
• tml-epfl / understanding-sam
  Towards Understanding Sharpness-Aware Minimization [ICML 2022]
  ☆35Updated 2 years ago
• team-approx-bayes / bayesian-sam
  Code for "SAM as an Optimal Relaxation of Bayes", ICLR 2023.
  ☆25Updated last year
• MadryLab / journey-TRAK
  Code for the paper "The Journey, Not the Destination: How Data Guides Diffusion Models"
  ☆21Updated last year
• KellerJordan / REPAIR
  Code release for REPAIR: REnormalizing Permuted Activations for Interpolation Repair
  ☆46Updated last year
• mpagli / Agree-to-Disagree
  Repo for the paper: "Agree to Disagree: Diversity through Disagreement for Better Transferability"
  ☆35Updated 2 years ago
• Jiacheng-Zhu-AIML / AsymmetryLoRA
  Preprint: Asymmetry in Low-Rank Adapters of Foundation Models
  ☆34Updated 11 months ago