KD-LoRA: A Hybrid Approach to Efficient Fine-Tuning with LoRA and Knowledge Distillation
☆24Nov 3, 2024Updated last year
Alternatives and similar repositories for KD-LoRA
Users that are interested in KD-LoRA are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Official implementation for "Knowledge Distillation with Refined Logits".☆24Aug 26, 2024Updated last year
- Dynamic mode decomposition in Python☆13Jun 9, 2015Updated 11 years ago
- A Lightweight Multi-modality Image Segmentation Network via Domain Adaptation using Gradient Magnitude and Shape Constraint☆10Apr 3, 2023Updated 3 years ago
- ☆13Dec 2, 2024Updated last year
- The open source implementation of the multi grouped query attention by the paper "GQA: Training Generalized Multi-Query Transformer Model…☆17Dec 11, 2023Updated 2 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Code for PCA-OGD (AISTATS 2021)☆11Mar 16, 2021Updated 5 years ago
- Toolkit for Bayesian scaling analysis☆14Sep 8, 2022Updated 3 years ago
- Code for the CVPR '23 paper, "Defending Against Patch-based Backdoor Attacks on Self-Supervised Learning"☆10Jun 9, 2023Updated 3 years ago
- [ICML 2022] Learning Efficient and Robust Ordinary Differential \\ Equations via Invertible Neural Networks☆11Apr 14, 2023Updated 3 years ago
- This repository demonstrates the application of our proposed task-free continual learning method on a synthetic experiment.☆13Jun 24, 2019Updated 7 years ago
- ☆16Nov 12, 2024Updated last year
- The first range filter to simultaneously offer dynamicity, fast operations, and a robust false positive rate for any workload.☆13Jul 15, 2025Updated last year
- ☆13Aug 6, 2025Updated last year
- ScisciJP2024で行ったチュートリアル。過去の論文で取り扱われることの多いトピックを取り上げ、定義、適用、注意点についてまとめ、再現実験のpythonコードを合わせて載せた☆17Jan 27, 2026Updated 6 months ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- Revolutionize geospatial analysis with Swin-UNet – a cutting-edge solution for satellite imagery segmentation using Swin Transformers and…☆17Jun 6, 2026Updated 2 months ago
- Pytorch implementation of 'Improving Self-supervised Lightweight Model Learning via Hard-aware Metric Distillation. In ECCV 2022'☆11Mar 22, 2023Updated 3 years ago
- ☆14Oct 14, 2021Updated 4 years ago
- This repository contains the pytorch attempts to replicate the results from the recent DeepMind Paper, "On the Effectiveness of Interval …☆10May 27, 2019Updated 7 years ago
- Original code base for On Pretraining Data Diversity for Self-Supervised Learning☆14Dec 30, 2024Updated last year
- Supervision by Fusion: Towards Unsupervised Learning of Deep Salient Object Detector☆11Jun 24, 2023Updated 3 years ago
- Concise tutorials for distributed training using PyTorch☆10Apr 18, 2023Updated 3 years ago
- A pytorch implementation of the ICCV2021 workshop paper SimDis: Simple Distillation Baselines for Improving Small Self-supervised Models☆14Jul 15, 2021Updated 5 years ago
- [TMLR] CoDeC: Communication-Efficient Decentralized Continual Learning☆13Apr 17, 2024Updated 2 years ago
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- This is the official code for the paper Learning Represenations with Contrastive Self-Supervised Learning for Histopathology Applications☆13Aug 17, 2022Updated 4 years ago
- [AAAI2021] Automated Model Design and Benchmarking of 3D Deep Learning Models for COVID-19 Detection with Chest CT Scans☆13Mar 30, 2024Updated 2 years ago
- [ICML'25] "Rethinking Addressing in Language Models via Contextualized Equivariant Positional Encoding" by Jiajun Zhu, Peihao Wang, Ruisi…☆15Jun 6, 2025Updated last year
- Surrogate-based Multi-Objective Optimization Tool☆12Jan 17, 2023Updated 3 years ago
- Datasets for Hyperparameter Optimization of Neural Machine Translation☆10Aug 19, 2024Updated last year
- Generate interleaved text and image content in a structured format you can directly pass to downstream APIs.☆29Oct 18, 2024Updated last year
- Code for NeurIPS 2021 paper "Flattening Sharpness for Dynamic Gradient Projection Memory Benefits Continual Learning".☆16Oct 18, 2021Updated 4 years ago
- ☆10Mar 30, 2025Updated last year
- ☆16Mar 7, 2024Updated 2 years ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- [NeurIPS 2024] | An Efficient Recipe for Long Context Extension via Middle-Focused Positional Encoding☆22Oct 10, 2024Updated last year
- ☆10Mar 11, 2023Updated 3 years ago
- Algorithms for approximate attention in LLMs☆22Apr 14, 2025Updated last year
- Linguistics-aware Masked Image Modeling for Self-supervised Scene Text Recognition☆15Oct 26, 2025Updated 9 months ago
- ☆13Nov 6, 2021Updated 4 years ago
- Python script that uses the scapy library to create and send pings of death.☆14Feb 11, 2021Updated 5 years ago
- This Repository is project directory of the Distance Regression and Classification Network (DRCA-Net).DRCA-net is convolutional neural ne…☆13Jan 29, 2021Updated 5 years ago