[ICML2025 Oral] LoRA-One: One-Step Full Gradient Could Suffice for Fine-Tuning Large Language Models, Provably and Efficiently
☆35Oct 22, 2025Updated 9 months ago
Alternatives and similar repositories for LoRA-One
Users that are interested in LoRA-One are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Official code for our paper, "LoRA-Pro: Are Low-Rank Adapters Properly Optimized? "☆150Apr 8, 2025Updated last year
- source code for paper "Riemannian Preconditioned LoRA for Fine-Tuning Foundation Models"☆39Jun 20, 2024Updated 2 years ago
- ☆17Mar 14, 2024Updated 2 years ago
- The repo for HiRA paper☆38Jan 9, 2026Updated 7 months ago
- A generalized framework for subspace tuning methods in parameter efficient fine-tuning.☆182Jan 29, 2026Updated 6 months ago
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- Code for AAAI 2024 paper: CR-SAM: Curvature Regularized Sharpness-Aware Minimization☆12Nov 29, 2024Updated last year
- ☆45Jul 22, 2024Updated 2 years ago
- [TMLR 2024] Revisiting Random Weight Perturbation for Efficiently Improving Generalization☆12Oct 18, 2024Updated last year
- Github repo for ICLR-2025 paper, Fine-tuning Large Language Models with Sparse Matrices☆26Feb 2, 2026Updated 6 months ago
- Multiple Generalized Additive Models implemented in Python (EBM, XGB, Spline, FLAM). Code for our KDD 2021 paper "How Interpretable and T…☆14Aug 15, 2021Updated 4 years ago
- [ICLR25] Official Implementation of "Decoupling Angles and Strength in Low-rank Adaptation"☆15Dec 12, 2025Updated 8 months ago
- Investigating Cultural Alignment of Large Language Models☆13Aug 14, 2024Updated last year
- [ICML24] Official Implementation of "ETHER: Efficient Finetuning of Large-Scale Models with Hyperplane Reflections"☆16May 31, 2024Updated 2 years ago
- ☆33Jul 8, 2024Updated 2 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- code released for our TIP 2021 paper "Adversarial Domain Adaptation with Prototype-based Normalized Output Conditioner"☆15May 24, 2023Updated 3 years ago
- Official implementation of ICLR 2025 'LORO: Parameter and Memory Efficient Pretraining via Low-rank Riemannian Optimization'☆17Apr 24, 2025Updated last year
- Workable training script for ControlNet tile☆35May 2, 2024Updated 2 years ago
- Active Learning in the era of Foundation Models☆14Apr 16, 2025Updated last year
- implementations sde-net☆14Dec 8, 2020Updated 5 years ago
- Code for experiments on transformers using Markovian data.☆22Nov 22, 2024Updated last year
- ICML-2025 (Spotlight) "From Weight-Based to State-Based Fine-Tuning: Further Memory Reduction on LoRA with Parallel Control"☆15May 7, 2026Updated 3 months ago
- LoRAFusion: Efficient LoRA Fine-Tuning for LLMs☆29Jul 2, 2026Updated last month
- Cloud Computing course project. Online Document Collaborative Editing Platform Based on Self-built Distributed File System(write a GFS in…☆18Sep 25, 2021Updated 4 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Tuning-Free Image Editing with Fidelity and Editability via Unified Latent Diffusion Model☆13Dec 29, 2024Updated last year
- Co-DETR (Detection Transformer) compiled from PyTorch to NVIDIA TensorRT☆21Apr 19, 2025Updated last year
- Official implementation of COLosSAL [MICCAI 2023]☆15Jul 22, 2023Updated 3 years ago
- ☆12Feb 15, 2024Updated 2 years ago
- ☆14Mar 25, 2023Updated 3 years ago
- ☆13Dec 13, 2022Updated 3 years ago
- [ICML2026] The first, fully verified, sorry-free, large-scale Lean 4 library for statistical learning theory, covering infrastructures fo…☆116Jul 15, 2026Updated 3 weeks ago
- ☆20Mar 12, 2025Updated last year
- ICLR 2025☆30May 21, 2025Updated last year
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- ☆17Apr 5, 2026Updated 4 months ago
- Natural Language Processing (NLP) and Large Language Models (LLM) with Fine-Tuning LLM and make Chatbot Question answering (QA) with LoRA…☆12Jan 20, 2024Updated 2 years ago
- Just a helper script for invoking kohya converter (and maybe a cheeky inferencer to check it worked okay)☆11Aug 26, 2023Updated 2 years ago
- A minimal re-implementation of orthogonal fine-tuning (OFT), a diffusion method, for LLMs. Based on nanoGPT and minLoRA.☆14Nov 17, 2023Updated 2 years ago
- Quantized Evolution Strategies: High-precision Fine-tuning of Quantized LLMs at Low-precision Cost☆20May 14, 2026Updated 2 months ago
- ☆12Aug 31, 2022Updated 3 years ago
- [CVPR 2024] Friendly Sharpness-Aware Minimization☆37Oct 29, 2024Updated last year