mit-han-lab / offsite-tuningLinks
Offsite-Tuning: Transfer Learning without Full Model
☆384Updated 2 years ago
Alternatives and similar repositories for offsite-tuning
Users that are interested in offsite-tuning are comparing it to the libraries listed below
Sorting:
- Shepherd: A foundational framework enabling federated instruction tuning for large language models☆249Updated 2 years ago
- ☆203Updated last year
- [COLM 2024] LoraHub: Efficient Cross-Task Generalization via Dynamic LoRA Composition☆665Updated last year
- A framework for merging models solving different tasks with different initializations into one multi-task model without any additional tr…☆309Updated last year
- AdaLoRA: Adaptive Budget Allocation for Parameter-Efficient Fine-Tuning (ICLR 2023).☆364Updated 2 years ago
- Official code for our CVPR'22 paper “Vision Transformer Slimming: Multi-Dimension Searching in Continuous Optimization Space”☆251Updated 4 months ago
- Official PyTorch implementation of QA-LoRA☆145Updated last year
- ☆235Updated last year
- Official code for ReLoRA from the paper Stack More Layers Differently: High-Rank Training Through Low-Rank Updates☆473Updated last year
- OpenICL is an open-source framework to facilitate research, development, and prototyping of in-context learning.☆583Updated 2 years ago
- DSIR large-scale data selection framework for language model training☆268Updated last year
- A simple and effective LLM pruning approach.☆836Updated last year
- Scaling Data-Constrained Language Models☆343Updated 6 months ago
- A curated list of Model Merging methods.☆94Updated last month
- Code for "SemDeDup", a simple method for identifying and removing semantic duplicates from a dataset (data pairs which are semantically s…☆151Updated 2 years ago
- [NeurIPS 2022] A Fast Post-Training Pruning Framework for Transformers☆192Updated 2 years ago
- Simple Parameter-efficient Fine-tuning for Transformer-based Masked Language-models☆143Updated 3 years ago
- This is the implementation of the paper AdaMix: Mixture-of-Adaptations for Parameter-efficient Model Tuning (https://arxiv.org/abs/2205.1…☆136Updated 2 years ago
- ☆274Updated 2 years ago
- Code accompanying the paper "Massive Activations in Large Language Models"☆191Updated last year
- AutoPEFT: Automatic Configuration Search for Parameter-Efficient Fine-Tuning (Zhou et al.; TACL 2024)☆50Updated last year
- Official repository of NEFTune: Noisy Embeddings Improves Instruction Finetuning☆410Updated last year
- Collection of Tools and Papers related to Adapters / Parameter-Efficient Transfer Learning/ Fine-Tuning☆201Updated last year
- PyTorch codes for "LST: Ladder Side-Tuning for Parameter and Memory Efficient Transfer Learning"☆242Updated 2 years ago
- Code release for Dataless Knowledge Fusion by Merging Weights of Language Models (https://openreview.net/forum?id=FCnohuR6AnM)☆92Updated 2 years ago
- Editing Models with Task Arithmetic☆524Updated 2 years ago
- Code for T-Few from "Few-Shot Parameter-Efficient Fine-Tuning is Better and Cheaper than In-Context Learning"☆458Updated 2 years ago
- Official implementation of TransNormerLLM: A Faster and Better LLM☆248Updated last year
- This PyTorch package implements MoEBERT: from BERT to Mixture-of-Experts via Importance-Guided Adaptation (NAACL 2022).☆113Updated 3 years ago
- Explorations into some recent techniques surrounding speculative decoding☆295Updated last year