Alternatives and similar repositories for Riemannian_Preconditioned_LoRA

Users that are interested in Riemannian_Preconditioned_LoRA are comparing it to the libraries listed below

• cjyaras / deep-lora-transformers
  Compressible Dynamics in Deep Overparameterized Low-Rank Learning & Adaptation (ICML'24 Oral)
  ☆14Updated 9 months ago
• andyjm3 / SLTrain
  SLTrain: a sparse plus low-rank approach for parameter and memory efficient pretraining (NeurIPS 2024)
  ☆31Updated 6 months ago
• team-approx-bayes / bayesian-sam
  Code for "SAM as an Optimal Relaxation of Bayes", ICLR 2023.
  ☆25Updated last year
• MaximeRobeyns / bayesian_lora
  Bayesian Low-Rank Adaptation for Large Language Models
  ☆33Updated 10 months ago
• xu-ji / information-bottleneck
  Deep Learning & Information Bottleneck
  ☆60Updated last year
• tml-epfl / sharpness-vs-generalization
  A modern look at the relationship between sharpness and generalization [ICML 2023]
  ☆43Updated last year
• ablghtianyi / ICL_Modular_Arithmetic
  ☆18Updated last month
• r-three / mats
  ☆30Updated 10 months ago
• allenbai01 / transformers-as-statisticians
  ☆31Updated last year
• Model-GLUE / Model-GLUE
  ☆13Updated 8 months ago
• yolky / RFAD
  Code for the paper "Efficient Dataset Distillation using Random Feature Approximation"
  ☆37Updated 2 years ago
• tanganke / peta
  Code for paper "Parameter Efficient Multi-task Model Fusion with Partial Linearization"
  ☆21Updated 8 months ago
• formll / resolving-scaling-law-discrepancies
  ☆19Updated 10 months ago
• Ping-C / optimizer
  This repository includes code to reproduce the tables in "Loss Landscapes are All You Need: Neural Network Generalization Can Be Explaine…
  ☆36Updated 2 years ago
• locuslab / edge-of-stability
  ☆67Updated 5 months ago
• mueller-mp / SAM-ON
  ☆34Updated last year
• Wang-ML-Lab / bayesian-peft
  [NeurIPS 2024] BLoB: Bayesian Low-Rank Adaptation by Backpropagation for Large Language Models
  ☆27Updated 3 months ago
• dydjw9 / Efficient_SAM
  ☆58Updated 2 years ago
• MadryLab / journey-TRAK
  Code for the paper "The Journey, Not the Destination: How Data Guides Diffusion Models"
  ☆22Updated last year
• Jiachen-T-Wang / GREATS
  ☆13Updated last month
• MarlonBecker / MSAM
  ☆18Updated last year
• UKPLab / iclr2024-model-merging
  This is the repository for "Model Merging by Uncertainty-Based Gradient Matching", ICLR 2024.
  ☆27Updated last year
• radarFudan / Curse-of-memory
  Curse-of-memory phenomenon of RNNs in sequence modelling
  ☆19Updated last week
• yaoyao-liu / online-hyperparameter-optimization
  PyTorch implementation of "Online Hyperparameter Optimization for Class-Incremental Learning" (AAAI 2023 Oral)
  ☆17Updated last year
• gortizji / linearized-networks
  Source code of "What can linearized neural networks actually say about generalization?
  ☆20Updated 3 years ago
• JonasGeiping / dataaugs
  ☆17Updated 2 years ago
• DaShenZi721 / HRA
  ☆28Updated 2 months ago
• stan-anony / derivative_free_lora_rank
  ☆16Updated last year
• VijayLingam95 / SVFT
  ☆28Updated 3 months ago
• facebookresearch / ModelRatatouille
  Recycling diverse models
  ☆44Updated 2 years ago