[NeurIPS 2024] VeLoRA : Memory Efficient Training using Rank-1 Sub-Token Projections
☆22Oct 15, 2024Updated 2 years ago
Alternatives and similar repositories for VeLoRA
Users that are interested in VeLoRA are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- [BMVC 2022] Information Theoretic Representation Distillation☆19Oct 6, 2023Updated 3 years ago
- [CVPR 2024] VkD : Improving Knowledge Distillation using Orthogonal Projections☆59Oct 21, 2024Updated 2 years ago
- [AAAI 2024] Understanding the Role of the Projector in Knowledge Distillation☆20Feb 13, 2024Updated 2 years ago
- [NeurIPS'24] Multilinear Mixture of Experts: Scalable Expert Specialization through Factorization☆41Sep 30, 2024Updated 2 years ago
- ICCV23 "Householder Projector for Unsupervised Latent Semantics Discovery"☆16Oct 16, 2026Updated 2 weeks ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- [EMNLP 2024] Quantize LLM to extremely low-bit, and finetune the quantized LLMs☆17Jul 18, 2024Updated 2 years ago
- [ICLR'26] Beyond Linear Probes: Dynamic Safety Monitoring for Language Models☆13Oct 1, 2025Updated last year
- NeurIPS22 "RankFeat: Rank-1 Feature Removal for Out-of-distribution Detection" and T-PAMI Extension☆20Feb 21, 2025Updated last year
- ☆12Oct 22, 2024Updated 2 years ago
- ☆13Aug 19, 2024Updated 2 years ago
- ECCV22 Paper "Batch-efficient EigenDecomposition for Small and Medium Matrices"☆20Feb 4, 2023Updated 3 years ago
- (ICLR24) A Lie Group Approach to Riemannian Batch Normalization.☆22Mar 2, 2025Updated last year
- Official Code for What Makes and Breaks Safety Fine-tuning? A Mechanistic Study (NeurIPS 2024)☆11Oct 31, 2024Updated 2 years ago
- Learning adapter weights from task descriptions☆21Nov 12, 2023Updated 2 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- [ECCV2024 - Oral] Adaptive Parametric Activation☆53Nov 18, 2025Updated 11 months ago
- Code for ICLR 2022 Paper, "Controlling Directions Orthogonal to a Classifier"☆35Jun 6, 2023Updated 3 years ago
- ICLR22 "Fast Differentiable Matrix Square Root" and T-PAMI extension☆67Nov 18, 2024Updated last year
- [ECCV 2024] Official Release of SILC: Improving vision language pretraining with self-distillation☆48Oct 3, 2024Updated 2 years ago
- ICML23 "Latent Traversals in Generative Models as Potential Flows"☆28Oct 23, 2023Updated 3 years ago
- ECCV22 "Improving Covariance Conditioning of the SVD Meta-layer by Orthogonality" and T-PAMI extension☆12Dec 13, 2022Updated 3 years ago
- Pytorch implementation of "Transforming Vision Transformer: Towards Efficient Multi-Task Asynchronous Learning", accepted at 38th Confere…☆12Apr 26, 2025Updated last year
- Activation-aware Singular Value Decomposition for Compressing Large Language Models☆95Oct 22, 2024Updated 2 years ago
- 🐝 Explore Trending Long-Tail Papers at CVPR and ICCV☆10Nov 24, 2022Updated 3 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- The official repo for DARG: Dynamic Evaluation of Large Language Models via Adaptive Reasoning Graph☆19Oct 13, 2024Updated 2 years ago
- Code for "Seeking Neural Nuggets: Knowledge Transfer in Large Language Models from a Parametric Perspective"☆33May 9, 2024Updated 2 years ago
- ☆13Apr 18, 2023Updated 3 years ago
- [NeurIPS 2023] Make Your Pre-trained Model Reversible: From Parameter to Memory Efficient Fine-Tuning☆33Jun 2, 2023Updated 3 years ago
- Implementation of the paper "Learning to Prompt CLIP for Monocular Depth Estimation: Exploring the Limits of Human Language", ICCV Worksh…☆11Nov 8, 2023Updated 2 years ago
- ☆10Apr 16, 2024Updated 2 years ago
- [NeurIPS'25] Towards Interpretability Without Sacrifice: Faithful Dense Layer Decomposition with Mixture of Decoders☆16May 28, 2025Updated last year
- A collection of differentiable SVD methods and ICCV21 "Why Approximate Matrix Square Root Outperforms Accurate SVD in Global Covariance P…☆82Oct 20, 2023Updated 3 years ago
- [NeurIPS '24 Spotlight] PertEval: Unveiling Real Knowledge Capacity of LLMs via Knowledge-invariant Perturbations☆14Oct 30, 2024Updated 2 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Official PyTorch code for UAI 2023 paper "Concurrent Misclassification and Out-of-Distribution Detection for Semantic Segmentation via En…☆12Nov 10, 2023Updated 2 years ago
- ☆11Aug 14, 2024Updated 2 years ago
- The official PyTorch implementation of ALRIGHT and MAXRIGHT algorithms for efficient trade-off in LLM post-training☆13Nov 11, 2025Updated 11 months ago
- [ ICLR 2025 ] Making LLMs More Effective with Hierarchical Mixture of LoRA Experts☆32Oct 9, 2025Updated last year
- POMA-3D: The Point Map Way to 3D Scene Understanding.☆16Nov 9, 2025Updated 11 months ago
- An implementation is provided here for the NeurIPS2024 paper "MemoryFormer : Minimize Transformer Computation by Removing Fully-Connected…☆16Mar 24, 2026Updated 7 months ago
- ☆13Mar 30, 2021Updated 5 years ago