Alternatives and similar repositories for Riemannian_Preconditioned_LoRA

Users that are interested in Riemannian_Preconditioned_LoRA are comparing it to the libraries listed below

• andyjm3 / SLTrain
  SLTrain: a sparse plus low-rank approach for parameter and memory efficient pretraining (NeurIPS 2024)
  ☆34Updated 10 months ago
• xu-ji / information-bottleneck
  Deep Learning & Information Bottleneck
  ☆61Updated 2 years ago
• sail-sg / D-TRAK
  Intriguing Properties of Data Attribution on Diffusion Models (ICLR 2024)
  ☆33Updated last year
• DaShenZi721 / HRA
  ☆31Updated 3 months ago
• MaximeRobeyns / bayesian_lora
  Bayesian Low-Rank Adaptation for Large Language Models
  ☆35Updated last year
• tml-epfl / sharpness-vs-generalization
  A modern look at the relationship between sharpness and generalization [ICML 2023]
  ☆43Updated 2 years ago
• fangyuan-ksgk / selective-attention-transformer
  Unofficial Implementation of Selective Attention Transformer
  ☆17Updated 10 months ago
• formll / resolving-scaling-law-discrepancies
  ☆20Updated last year
• OPTML-Group / DP4TL
  [NeurIPS2023] "Selectivity Drives Productivity: Efficient Dataset Pruning for Enhanced Transfer Learning" by Yihua Zhang*, Yimeng Zhang*,…
  ☆13Updated last year
• r-three / mats
  ☆31Updated last year
• Wuyxin / DISC
  (ICML 2023) Discover and Cure: Concept-aware Mitigation of Spurious Correlation
  ☆41Updated last year
• cjyaras / deep-lora-transformers
  Compressible Dynamics in Deep Overparameterized Low-Rank Learning & Adaptation (ICML'24 Oral)
  ☆13Updated last year
• peterljq / Parsimonious-Concept-Engineering
  PaCE: Parsimonious Concept Engineering for Large Language Models (NeurIPS 2024)
  ☆39Updated 10 months ago
• AvivNavon / DWSNets
  Official implementation for Equivariant Architectures for Learning in Deep Weight Spaces [ICML 2023]
  ☆89Updated 2 years ago
• allenbai01 / transformers-as-statisticians
  ☆33Updated 2 years ago
• Ping-C / optimizer
  This repository includes code to reproduce the tables in "Loss Landscapes are All You Need: Neural Network Generalization Can Be Explaine…
  ☆38Updated 2 years ago
• sjunhongshen / ORCA
  Official implementation of ORCA proposed in the paper "Cross-Modal Fine-Tuning: Align then Refine"
  ☆72Updated last year
• Wang-ML-Lab / bayesian-peft
  [NeurIPS 2024] BLoB: Bayesian Low-Rank Adaptation by Backpropagation for Large Language Models
  ☆28Updated last month
• zzp1012 / LLFC
  [NeurIPS 2023] Code release for "Going Beyond Linear Mode Connectivity: The Layerwise Linear Feature Connectivity"
  ☆19Updated last year
• Model-GLUE / Model-GLUE
  ☆15Updated last year
• PKU-ML / non_neg
  Official Code for ICLR 2024 Paper: Non-negative Contrastive Learning
  ☆45Updated last year
• IRMBed / IRMBed
  This is the project for IRM methods
  ☆13Updated 4 years ago
• yolky / RFAD
  Code for the paper "Efficient Dataset Distillation using Random Feature Approximation"
  ☆37Updated 2 years ago
• VITA-Group / Junk_DNA_Hypothesis
  [ICML 2024] Junk DNA Hypothesis: A Task-Centric Angle of LLM Pre-trained Weights through Sparsity; Lu Yin*, Ajay Jaiswal*, Shiwei Liu, So…
  ☆16Updated 4 months ago
• ycjing / Awesome-Model-Merging
  A curated list of Model Merging methods.
  ☆92Updated last year
• JeanKaddour / NoTrainNoGain
  Revisiting Efficient Training Algorithms For Transformer-based Language Models (NeurIPS 2023)
  ☆81Updated 2 years ago
• HSG-AIML / NeurIPS_2022-Generative_Hyper_Representations
  Code Repository for the NeurIPS 2022 paper: "Hyper-Representations as Generative Models: Sampling Unseen Neural Network Weights".
  ☆16Updated last year
• gortizji / tangent_task_arithmetic
  Source code of "Task arithmetic in the tangent space: Improved editing of pre-trained models".
  ☆104Updated 2 years ago
• MadryLab / dataset-interfaces
  Dataset Interfaces: Diagnosing Model Failures Using Controllable Counterfactual Generation
  ☆45Updated 2 years ago
• harryjo97 / RDLM
  Official Code Repository for the paper "Continuous Diffusion Model for Language Modeling".
  ☆40Updated 6 months ago