Alternatives and similar repositories for Riemannian_Preconditioned_LoRA:

Users that are interested in Riemannian_Preconditioned_LoRA are comparing it to the libraries listed below

• MaximeRobeyns / bayesian_lora
  Bayesian Low-Rank Adaptation for Large Language Models
  ☆29Updated 6 months ago
• andyjm3 / SLTrain
  SLTrain: a sparse plus low-rank approach for parameter and memory efficient pretraining (NeurIPS 2024)
  ☆27Updated 2 months ago
• ablghtianyi / ICL_Modular_Arithmetic
  ☆16Updated 2 months ago
• cjyaras / deep-lora-transformers
  Compressible Dynamics in Deep Overparameterized Low-Rank Learning & Adaptation (ICML'24 Oral)
  ☆13Updated 5 months ago
• Model-GLUE / Model-GLUE
  ☆10Updated 4 months ago
• xavihart / PDM-Pure
  PDM-based Purifier
  ☆19Updated 2 months ago
• yossigandelsman / second_order_lens
  Official pytorch implementation of "Interpreting the Second-Order Effects of Neurons in CLIP"
  ☆31Updated 2 months ago
• uclaml / PDE
  Official repo of Progressive Data Expansion: data, code and evaluation
  ☆27Updated last year
• tml-epfl / sharpness-vs-generalization
  A modern look at the relationship between sharpness and generalization [ICML 2023]
  ☆43Updated last year
• gortizji / linearized-networks
  Source code of "What can linearized neural networks actually say about generalization?
  ☆19Updated 3 years ago
• xu-ji / information-bottleneck
  Deep Learning & Information Bottleneck
  ☆53Updated last year
• MadryLab / dataset-interfaces
  Dataset Interfaces: Diagnosing Model Failures Using Controllable Counterfactual Generation
  ☆44Updated last year
• formll / resolving-scaling-law-discrepancies
  ☆16Updated 6 months ago
• Wuyxin / DISC
  Discover and Cure: Concept-aware Mitigation of Spurious Correlation (ICML 2023)
  ☆40Updated 9 months ago
• ML-GSAI / RADD
  Official PyTorch implementation for "Your Absorbing Discrete Diffusion Secretly Models the Conditional Distributions of Clean Data"
  ☆24Updated 4 months ago
• AvivNavon / DWSNets
  Official implementation for Equivariant Architectures for Learning in Deep Weight Spaces [ICML 2023]
  ☆86Updated last year
• Wang-ML-Lab / bayesian-peft
  [NeurIPS 2024] BLoB: Bayesian Low-Rank Adaptation by Backpropagation for Large Language Models
  ☆21Updated 3 weeks ago
• YiteWang / NTK-SAP
  [ICLR2023] NTK-SAP: Improving neural network pruning by aligning training dynamics
  ☆18Updated last year
• r-three / mats
  ☆27Updated 6 months ago
• VITA-Group / Junk_DNA_Hypothesis
  [ICML 2024] Junk DNA Hypothesis: A Task-Centric Angle of LLM Pre-trained Weights through Sparsity; Lu Yin*, Ajay Jaiswal*, Shiwei Liu, So…
  ☆16Updated 7 months ago
• rtaori / data_feedback
  Code for the paper "Data Feedback Loops: Model-driven Amplification of Dataset Biases"
  ☆15Updated 2 years ago
• tml-epfl / sam-low-rank-features
  Sharpness-Aware Minimization Leads to Low-Rank Features [NeurIPS 2023]
  ☆25Updated last year
• allenbai01 / transformers-as-statisticians
  ☆27Updated last year
• peterljq / Parsimonious-Concept-Engineering
  Implementation of PaCE: Parsimonious Concept Engineering for Large Language Models (NeurIPS 2024)
  ☆31Updated 2 months ago
• stan-anony / derivative_free_lora_rank
  ☆15Updated 11 months ago
• erosenfeld / disagree_discrep
  Provably (and non-vacuously) bounding test error of deep neural networks under distribution shift with unlabeled test data.
  ☆9Updated 10 months ago
• mpagli / Agree-to-Disagree
  Repo for the paper: "Agree to Disagree: Diversity through Disagreement for Better Transferability"
  ☆35Updated 2 years ago
• tanganke / peta
  Code for paper "Parameter Efficient Multi-task Model Fusion with Partial Linearization"
  ☆17Updated 4 months ago
• hendrydong / NTK-and-MF-examples
  Visualization of mean field and neural tangent kernel regime
  ☆21Updated 5 months ago
• yolky / RFAD
  Code for the paper "Efficient Dataset Distillation using Random Feature Approximation"
  ☆37Updated last year