[NeurIPS 2024] VeLoRA : Memory Efficient Training using Rank-1 Sub-Token Projections
☆21Oct 15, 2024Updated last year
Alternatives and similar repositories for VeLoRA
Users that are interested in VeLoRA are comparing it to the libraries listed below
Sorting:
- [CVPR 2024] VkD : Improving Knowledge Distillation using Orthogonal Projections☆57Oct 21, 2024Updated last year
- [AAAI 2024] Understanding the Role of the Projector in Knowledge Distillation☆20Feb 13, 2024Updated 2 years ago
- Official Code for What Makes and Breaks Safety Fine-tuning? A Mechanistic Study (NeurIPS 2024)☆12Oct 31, 2024Updated last year
- ☆13Aug 19, 2024Updated last year
- ☆16Sep 1, 2025Updated 6 months ago
- NeurIPS22 "RankFeat: Rank-1 Feature Removal for Out-of-distribution Detection" and T-PAMI Extension☆20Feb 21, 2025Updated last year
- ☆17Jun 11, 2025Updated 8 months ago
- Official codebase for "Analyzing the Generalization and Reliability of Steering Vectors"☆19Dec 14, 2024Updated last year
- (ICLR24) A Lie Group Approach to Riemannian Batch Normalization.☆22Mar 2, 2025Updated last year
- Learning adapter weights from task descriptions☆19Nov 12, 2023Updated 2 years ago
- The open-source materials for paper "Sparsing Law: Towards Large Language Models with Greater Activation Sparsity".☆30Nov 12, 2024Updated last year
- [ ICLR 2025 ] Making LLMs More Effective with Hierarchical Mixture of LoRA Experts☆28Oct 9, 2025Updated 4 months ago
- ☆22Nov 19, 2024Updated last year
- [ECCV2024 - Oral] Adaptive Parametric Activation☆54Nov 18, 2025Updated 3 months ago
- Motion flow and corresponding blurry image synthesis. Training data generation for "From Motion Blur to Motion Flow: A Deep Learning Solu…☆48May 18, 2018Updated 7 years ago
- LLM-Check: Investigating Detection of Hallucinations in Large Language Models (NeurIPS 2024)☆36Dec 8, 2024Updated last year
- ICLR22 "Fast Differentiable Matrix Square Root" and T-PAMI extension☆67Nov 18, 2024Updated last year
- Code for "Seeking Neural Nuggets: Knowledge Transfer in Large Language Models from a Parametric Perspective"☆33May 9, 2024Updated last year
- Code for ICLR 2022 Paper, "Controlling Directions Orthogonal to a Classifier"☆35Jun 6, 2023Updated 2 years ago
- HiFi-SR is a Python-based pipeline for the detection of plant mitochondrial structural rearrangements based on the mapping of PacBio high…☆10Apr 15, 2025Updated 10 months ago
- ☆13Oct 5, 2025Updated 4 months ago
- Implementation of DropCov as described in DropCov: A Simple yet Effective Method for Improving Deep Architectures☆10Oct 15, 2022Updated 3 years ago
- Official code for "Understanding and Mitigating Overfitting in Prompt Tuning for Vision-Language Models" (TCSVT'2023)☆29Dec 27, 2023Updated 2 years ago
- [CVPR2024] The code of "UniPT: Universal Parallel Tuning for Transfer Learning with Efficient Parameter and Memory"☆69Oct 15, 2024Updated last year
- [NeurIPS 2024 Main Track] Code for the paper titled "Instruction Tuning With Loss Over Instructions"☆38May 24, 2024Updated last year
- A collection of differentiable SVD methods and ICCV21 "Why Approximate Matrix Square Root Outperforms Accurate SVD in Global Covariance P…☆79Oct 20, 2023Updated 2 years ago
- Activation-aware Singular Value Decomposition for Compressing Large Language Models☆88Oct 22, 2024Updated last year
- ☆11Jun 20, 2023Updated 2 years ago
- This is the official implementation of paper, as was used for the paper.☆20Jul 20, 2025Updated 7 months ago
- Build an AI bot in Discord to serve user's personalized reports on what's up in tech☆28Sep 14, 2025Updated 5 months ago
- Code for ACL 2024 accepted paper titled "SAPT: A Shared Attention Framework for Parameter-Efficient Continual Learning of Large Language …☆38Jan 13, 2025Updated last year
- Distribution-Aware Prompt Tuning for Vision-Language Models (ICCV 2023)☆45Dec 11, 2023Updated 2 years ago
- my profile readme☆14Updated this week
- Official PyTorch implementation of The Linear Attention Resurrection in Vision Transformer☆16Sep 7, 2024Updated last year
- Reference implementation of Thin and Deep Gaussian Processes (NeurIPS 2023)☆14Nov 25, 2024Updated last year
- [ICLR 2026] Thinking on the Fly: Test-Time Reasoning Enhancement via Latent Thought Policy Optimization☆18Feb 14, 2026Updated 2 weeks ago
- ☆12Jun 26, 2024Updated last year
- This repo contains the source code for VB-LoRA: Extreme Parameter Efficient Fine-Tuning with Vector Banks (NeurIPS 2024).☆42Oct 15, 2024Updated last year
- [ECCV 2024] Official Release of SILC: Improving vision language pretraining with self-distillation☆47Oct 3, 2024Updated last year