Alternatives and similar repositories for Riemannian_Preconditioned_LoRA:

Users that are interested in Riemannian_Preconditioned_LoRA are comparing it to the libraries listed below

• cjyaras / deep-lora-transformers
  Compressible Dynamics in Deep Overparameterized Low-Rank Learning & Adaptation (ICML'24 Oral)
  ☆14Updated 9 months ago
• gortizji / linearized-networks
  Source code of "What can linearized neural networks actually say about generalization?
  ☆20Updated 3 years ago
• andyjm3 / SLTrain
  SLTrain: a sparse plus low-rank approach for parameter and memory efficient pretraining (NeurIPS 2024)
  ☆30Updated 5 months ago
• tml-epfl / sharpness-vs-generalization
  A modern look at the relationship between sharpness and generalization [ICML 2023]
  ☆43Updated last year
• xu-ji / information-bottleneck
  Deep Learning & Information Bottleneck
  ☆60Updated last year
• yolky / RFAD
  Code for the paper "Efficient Dataset Distillation using Random Feature Approximation"
  ☆37Updated 2 years ago
• stephane-rivaud / ForwardLocalGradient
  This is the official implementation of the ICML 2023 paper - Can Forward Gradient Match Backpropagation ?
  ☆12Updated last year
• YiteWang / NTK-SAP
  [ICLR2023] NTK-SAP: Improving neural network pruning by aligning training dynamics
  ☆18Updated last year
• locuslab / edge-of-stability
  ☆67Updated 4 months ago
• ablghtianyi / ICL_Modular_Arithmetic
  ☆18Updated last month
• tml-epfl / understanding-sam
  Towards Understanding Sharpness-Aware Minimization [ICML 2022]
  ☆35Updated 2 years ago
• hendrydong / NTK-and-MF-examples
  Visualization of mean field and neural tangent kernel regime
  ☆20Updated 9 months ago
• formll / resolving-scaling-law-discrepancies
  ☆18Updated 9 months ago
• MadryLab / journey-TRAK
  Code for the paper "The Journey, Not the Destination: How Data Guides Diffusion Models"
  ☆22Updated last year
• AngusDujw / SAF
  ☆35Updated 2 years ago
• r-three / mats
  ☆30Updated 9 months ago
• IRMBed / IRMBed
  This is the project for IRM methods
  ☆12Updated 3 years ago
• Ping-C / optimizer
  This repository includes code to reproduce the tables in "Loss Landscapes are All You Need: Neural Network Generalization Can Be Explaine…
  ☆36Updated 2 years ago
• mueller-mp / SAM-ON
  ☆34Updated last year
• MaximeRobeyns / bayesian_lora
  Bayesian Low-Rank Adaptation for Large Language Models
  ☆31Updated 10 months ago
• chengxiang / LinearTransformer
  Pytorch code for experiments on Linear Transformers
  ☆20Updated last year
• tding1 / Neural-Collapse
  [NeurIPS 2021] A Geometric Analysis of Neural Collapse with Unconstrained Features
  ☆56Updated 2 years ago
• graldij / transformer-fusion
  Official repository of the "Transformer Fusion with Optimal Transport" paper, published as a conference paper at ICLR 2024.
  ☆27Updated last year
• pnnl / torchntk
  ☆27Updated 2 years ago
• Model-GLUE / Model-GLUE
  ☆13Updated 8 months ago
• IBM / model-reprogramming
  Repository for research works and resources related to model reprogramming <https://arxiv.org/abs/2202.10629>
  ☆61Updated last year
• Jiacheng-Zhu-AIML / AsymmetryLoRA
  Preprint: Asymmetry in Low-Rank Adapters of Foundation Models
  ☆36Updated last year
• JonasGeiping / dataaugs
  ☆17Updated 2 years ago
• fKunstner / noise-sgd-adam-sign
  ☆16Updated last year
• allenbai01 / transformers-as-statisticians
  ☆31Updated last year