Official implementation of ICLR 2025 'LORO: Parameter and Memory Efficient Pretraining via Low-rank Riemannian Optimization'
☆17Apr 24, 2025Updated last year
Alternatives and similar repositories for LORO-main
Users that are interested in LORO-main are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Zeroth-Order Fine-Tuning of LLMs in Random Subspaces (ICCV 2025)☆20Nov 22, 2024Updated last year
- Exploring the minimal architecture required for coherent English language generation.☆14Jun 11, 2026Updated last month
- [EMNLP 2024] Quantize LLM to extremely low-bit, and finetune the quantized LLMs☆15Jul 18, 2024Updated 2 years ago
- The code for Joint Neural Architecture Search and Quantization☆14Apr 10, 2019Updated 7 years ago
- Long-Tailed Visual Recognition via Self-Heterogeneous Integration with Knowledge Excavation (CVPR 2023)☆41Mar 9, 2024Updated 2 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- [ICML'24 Oral] The official code of "DiJiang: Efficient Large Language Models through Compact Kernelization", a novel DCT-based linear at…☆103Jun 14, 2024Updated 2 years ago
- Implement Retrospective Reader for Machine Reading Comprehension with 🤗 transformers and datasets☆19Jun 7, 2022Updated 4 years ago
- Code for the article "Accelerated Forward-Backward Optimization using Deep Learning"☆12Sep 15, 2021Updated 4 years ago
- ☆15Jan 1, 2026Updated 6 months ago
- ☆19Dec 7, 2025Updated 7 months ago
- An extention to the GaLore paper, to perform Natural Gradient Descent in low rank subspace☆19Oct 21, 2024Updated last year
- ☆16Sep 9, 2024Updated last year
- TorusE☆15Apr 10, 2019Updated 7 years ago
- ICLR 2025☆30May 21, 2025Updated last year
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- A minimal re-implementation of orthogonal fine-tuning (OFT), a diffusion method, for LLMs. Based on nanoGPT and minLoRA.☆14Nov 17, 2023Updated 2 years ago
- Code Repository for the EMCL-PKDD 2021 "Multitask Recalibrated Aggregation Network for Medical Code Prediction)☆13Sep 7, 2021Updated 4 years ago
- Hessian trace estimation using PyTorch and Hutch++☆20Oct 29, 2020Updated 5 years ago
- The present project aims to predict air pollution in Beijing, China, using the data set "Beijing Multi-Site Air-Quality Data Data Set"☆15Jul 1, 2023Updated 3 years ago
- [ICLR'25] R-Sparse: Rank-Aware Activation Sparsity for Efficient LLM Inference☆21Apr 28, 2025Updated last year
- [ICML2025] Official code for "Reinforced Lifelong Editing for Language Models"☆23Feb 23, 2025Updated last year
- ☆11Feb 26, 2024Updated 2 years ago
- ☆19Jan 4, 2024Updated 2 years ago
- Experimental deep learning framework written in Rust☆15Nov 2, 2022Updated 3 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Official implementation of the transformer (TF) architecture suggested in a paper entitled "Looped Transformers as Programmable Computers…☆42Apr 8, 2023Updated 3 years ago
- Work in progress.☆80Nov 25, 2025Updated 8 months ago
- Repository to run the Tensor Convolutional Dictionary Learning with FISTA (TC-FISTA) algorithm☆12Jun 22, 2022Updated 4 years ago
- tensor rank learning in CP decomposition via convolutional neural network☆11Apr 19, 2018Updated 8 years ago
- This is the example code for H2T☆19Mar 22, 2025Updated last year
- ☆23Nov 26, 2025Updated 8 months ago
- [CVPR 2025] LoRA Recycle: Unlocking Tuning-Free Few-Shot Adaptability in Visual Foundation Models by Recycling Pre-Tuned LoRAs☆14Jun 20, 2025Updated last year
- [ICLR 2025] Official PyTorch implementation of our paper for general continual learning "Advancing Prompt-Based Methods for Replay-Indepe…☆18Dec 21, 2025Updated 7 months ago
- ☆22Sep 6, 2021Updated 4 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- The code for the ICML 2021 paper "Graph Neural Networks Inspired by Classical Iterative Algorithms".☆43Jun 9, 2021Updated 5 years ago
- Official Repo for SparseLLM: Global Pruning of LLMs (NeurIPS 2024)☆70Mar 27, 2025Updated last year
- Source code for the COLING 2022 paper "KGE-CL: Contrastive Learning of Tensor Decomposition Based Knowledge Graph Embeddings".☆24Oct 29, 2022Updated 3 years ago
- ☆48May 25, 2025Updated last year
- ☆19Apr 16, 2025Updated last year
- ☆15Mar 11, 2023Updated 3 years ago
- ☆14Apr 12, 2026Updated 3 months ago