[NeurIPS 2024] Low rank memory efficient optimizer without SVD
☆34Jul 1, 2025Updated last year
Alternatives and similar repositories for Online-Subspace-Descent
Users that are interested in Online-Subspace-Descent are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- computational physics (Chungbuk National University, Korea)☆10May 26, 2022Updated 4 years ago
- ☆14May 4, 2026Updated 6 months ago
- torch implementation of diloco☆30Jul 17, 2026Updated 3 months ago
- Code for "The Surprising Agreement Between Convex Optimization Theory and Learning-Rate Scheduling for Large Model Training"☆11Feb 4, 2026Updated 9 months ago
- An agent-first design tool for the .pen format, enabling export to SwiftUI and React☆12Oct 28, 2026Updated last week
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- ☆15Sep 24, 2023Updated 3 years ago
- Software for calculating IORT treatments with a LIAC HWL linac, based on precalculated Monte Carlo dose distributions in water.☆13Oct 28, 2026Updated last week
- GaLore: Memory-Efficient LLM Training by Gradient Low-Rank Projection☆1,712Oct 28, 2024Updated 2 years ago
- [ICML 2026] Memory-Efficient LLM Pretraining via Minimalist Optimizer Design☆24May 26, 2026Updated 5 months ago
- ☆12Jun 30, 2024Updated 2 years ago
- An extention to the GaLore paper, to perform Natural Gradient Descent in low rank subspace☆19Oct 21, 2024Updated 2 years ago
- [ICML‘24] Official code for the paper "Revisiting Zeroth-Order Optimization for Memory-Efficient LLM Fine-Tuning: A Benchmark ".☆131Jul 6, 2025Updated last year
- [ICML 2025] From Low Rank Gradient Subspace Stabilization to Low-Rank Weights: Observations, Theories and Applications☆52Oct 30, 2025Updated last year
- Medical Physics Module of Computing Methods for Experimental Physics and Data Analysis☆10Apr 15, 2026Updated 6 months ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Official repository Flash Local Linear Attention☆40May 28, 2026Updated 5 months ago
- [ICLR 2026] When it comes to optimizers, it's always better to be safe than sorry☆421Sep 26, 2025Updated last year
- Pytorch implementation of preconditioned stochastic gradient descent (Kron and affine preconditioner, low-rank approximation precondition…☆208May 30, 2026Updated 5 months ago
- Lecciones de Introducción a Física de Partículas☆14Oct 26, 2026Updated last week
- This repository contains code for the MicroAdam paper.☆21Dec 14, 2024Updated last year
- Code for reproducing our paper "Low Rank Adapting Models for Sparse Autoencoder Features"☆17Mar 31, 2025Updated last year
- ☆12Jul 15, 2020Updated 6 years ago
- Bagua tutorials.☆13Sep 4, 2022Updated 4 years ago
- ☆63Oct 3, 2024Updated 2 years ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- Code of "Regularized Best-of-N Sampling with Minimum Bayes Risk Objective for Language Model Alignment" (2025).☆14Apr 4, 2025Updated last year
- Computing the greatest common divisor with transformers, source code for the paper https//arxiv.org/abs/2308.15594☆14Aug 11, 2025Updated last year
- Neutrino research☆11May 3, 2022Updated 4 years ago
- ☆11Jul 9, 2024Updated 2 years ago
- Official code for our paper, "LoRA-Pro: Are Low-Rank Adapters Properly Optimized? "☆150Apr 8, 2025Updated last year
- A fast code for long-baseline neutrino oscillation probabilities in matter☆15Jun 29, 2026Updated 4 months ago
- Faster Pytorch bitsandbytes 4bit fp4 nn.Linear ops☆30Mar 16, 2024Updated 2 years ago
- LISA: Layerwise Importance Sampling for Memory-Efficient Large Language Model Fine-Tuning☆39Apr 4, 2024Updated 2 years ago
- ☆15Jan 27, 2025Updated last year
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- code for EMNLP 2024 paper: Interpreting Arithmetic Mechanism in Large Language Models through Comparative Neuron Analysis☆12Nov 17, 2024Updated last year
- Graduate school applications for fall 2020 admission 🎓☆11Oct 16, 2022Updated 4 years ago
- The official repo for "LLoCo: Learning Long Contexts Offline"☆118Jun 15, 2024Updated 2 years ago
- Latex source for material related to nuclear physics☆14Jun 9, 2016Updated 10 years ago
- ☆24Aug 19, 2025Updated last year
- Machine Learning DAS Short Exercise with CMS Open Data☆12Oct 12, 2026Updated 3 weeks ago
- [TMLR] "Can You Win Everything with Lottery Ticket?" by Tianlong Chen, Zhenyu Zhang, Jun Wu, Randy Huang, Sijia Liu, Shiyu Chang, Zhangy…☆10Sep 8, 2022Updated 4 years ago