KD-LoRA: A Hybrid Approach to Efficient Fine-Tuning with LoRA and Knowledge Distillation
☆24Nov 3, 2024Updated last year
Alternatives and similar repositories for KD-LoRA
Users that are interested in KD-LoRA are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- The code for paper "LLM-Neo: Parameter Efficient Knowledge Distillation for Large Language Models"☆15Mar 2, 2025Updated last year
- Source code for the BMVC-2021 paper "SimReg: Regression as a Simple Yet Effective Tool for Self-supervised Knowledge Distillation".☆16Jan 20, 2022Updated 4 years ago
- A partial collection of courses with related files held in SJTU-UMJI☆38Aug 10, 2022Updated 3 years ago
- 小车端app，主要负责视频录制和传输。☆12Dec 8, 2017Updated 8 years ago
- ☆15Apr 13, 2025Updated last year
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Official implementation for "Knowledge Distillation with Refined Logits".☆23Aug 26, 2024Updated last year
- Neural network compatible DDEs☆13Apr 8, 2025Updated last year
- Dynamic mode decomposition in Python☆13Jun 9, 2015Updated 11 years ago
- A toolkit implementing advanced methods to transfer models and model knowledge across tokenizers.☆69Jul 6, 2025Updated last year
- EraseDiff: Erasing Data Influence in Diffusion Models☆14Nov 20, 2024Updated last year
- The open source implementation of the multi grouped query attention by the paper "GQA: Training Generalized Multi-Query Transformer Model…☆17Dec 11, 2023Updated 2 years ago
- A multiphase field model based on machine learning method☆49Feb 10, 2022Updated 4 years ago
- Code for PCA-OGD (AISTATS 2021)☆11Mar 16, 2021Updated 5 years ago
- Toolkit for Bayesian scaling analysis☆14Sep 8, 2022Updated 3 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Code for the CVPR '23 paper, "Defending Against Patch-based Backdoor Attacks on Self-Supervised Learning"☆10Jun 9, 2023Updated 3 years ago
- The codes of our paper "EasyInv: Toward Fast and Better DDIM Inversion"☆14Jun 1, 2025Updated last year
- [ICML 2022] Learning Efficient and Robust Ordinary Differential \\ Equations via Invertible Neural Networks☆11Apr 14, 2023Updated 3 years ago
- This repository demonstrates the application of our proposed task-free continual learning method on a synthetic experiment.☆13Jun 24, 2019Updated 7 years ago
- ☆16Nov 12, 2024Updated last year
- Links to recourses for the Lean Theorem Prover☆13Dec 3, 2019Updated 6 years ago
- ScisciJP2024で行ったチュートリアル 。過去の論文で取り扱われることの多いトピックを取り上げ、定義、適用、注意点についてまとめ、再現実験のpythonコードを合わせて載せた☆17Jan 27, 2026Updated 6 months ago
- Tensorflow Custom Callbacks in Custom Training Loop☆10Apr 8, 2021Updated 5 years ago
- Code for PHATGOOSE introduced in "Learning to Route Among Specialized Experts for Zero-Shot Generalization"☆93Feb 27, 2024Updated 2 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Revolutionize geospatial analysis with Swin-UNet – a cutting-edge solution for satellite imagery segmentation using Swin Transformers and…☆16Jun 6, 2026Updated last month
- Pytorch implementation of 'Improving Self-supervised Lightweight Model Learning via Hard-aware Metric Distillation. In ECCV 2022'☆11Mar 22, 2023Updated 3 years ago
- ☆13Oct 14, 2021Updated 4 years ago
- This repository including most of cnn visualizations techniques using pytorch☆14Apr 14, 2020Updated 6 years ago
- This repository contains the pytorch attempts to replicate the results from the recent DeepMind Paper, "On the Effectiveness of Interval …☆10May 27, 2019Updated 7 years ago
- Original code base for On Pretraining Data Diversity for Self-Supervised Learning☆14Dec 30, 2024Updated last year
- 基于树莓派、esp8266硬件模块 通过Python、Django、lua、mqtt消息队列协议、mjpg_streamer 构建web远程控制平台：可控制小车移动、可视频实时查看☆13Oct 6, 2016Updated 9 years ago
- This is the official code for the paper Learning Represenations with Contrastive Self-Supervised Learning for Histopathology Applications☆13Aug 17, 2022Updated 3 years ago
- [AAAI2021] Automated Model Design and Benchmarking of 3D Deep Learning Models for COVID-19 Detection with Chest CT Scans☆13Mar 30, 2024Updated 2 years ago
- Simple, predictable pricing with DigitalOcean hosting • AdAlways know what you'll pay with monthly caps and flat pricing. Enterprise-grade infrastructure trusted by 600k+ customers.
- [ICML'25] "Rethinking Addressing in Language Models via Contextualized Equivariant Positional Encoding" by Jiajun Zhu, Peihao Wang, Ruisi…☆15Jun 6, 2025Updated last year
- Surrogate-based Multi-Objective Optimization Tool☆12Jan 17, 2023Updated 3 years ago
- Datasets for Hyperparameter Optimization of Neural Machine Translation☆10Aug 19, 2024Updated last year
- This is the official implementation of our PrOmpt cLass lEarning (POLE).☆12Jan 21, 2024Updated 2 years ago
- Reinforcement Learning agents for a selection Hyper-Heuristic☆11Sep 10, 2022Updated 3 years ago
- コンピュータビジョン研究コミュニティcvpaper.challengeのサマリ。サーベイ資料や研究成果など。☆12Jan 20, 2021Updated 5 years ago
- Generate interleaved text and image content in a structured format you can directly pass to downstream APIs.☆29Oct 18, 2024Updated last year