mit-han-lab / offsite-tuningLinks
Offsite-Tuning: Transfer Learning without Full Model
☆374Updated last year
Alternatives and similar repositories for offsite-tuning
Users that are interested in offsite-tuning are comparing it to the libraries listed below
Sorting:
- [COLM 2024] LoraHub: Efficient Cross-Task Generalization via Dynamic LoRA Composition☆640Updated 11 months ago
- Shepherd: A foundational framework enabling federated instruction tuning for large language models☆237Updated 2 years ago
- ☆183Updated last year
- Official code for our CVPR'22 paper “Vision Transformer Slimming: Multi-Dimension Searching in Continuous Optimization Space”☆250Updated last year
- A framework for merging models solving different tasks with different initializations into one multi-task model without any additional tr…☆301Updated last year
- DSIR large-scale data selection framework for language model training☆252Updated last year
- Collection of Tools and Papers related to Adapters / Parameter-Efficient Transfer Learning/ Fine-Tuning☆194Updated last year
- Editing Models with Task Arithmetic☆482Updated last year
- Scaling Data-Constrained Language Models☆338Updated 2 weeks ago
- AdaLoRA: Adaptive Budget Allocation for Parameter-Efficient Fine-Tuning (ICLR 2023).☆336Updated 2 years ago
- ☆223Updated last year
- A curated list of Model Merging methods.☆92Updated 10 months ago
- ☆266Updated last year
- Official PyTorch implementation of QA-LoRA☆138Updated last year
- Code for "SemDeDup", a simple method for identifying and removing semantic duplicates from a dataset (data pairs which are semantically s…☆138Updated last year
- OpenICL is an open-source framework to facilitate research, development, and prototyping of in-context learning.☆569Updated last year
- Repo for Rho-1: Token-level Data Selection & Selective Pretraining of LLMs.☆427Updated last year
- Unofficial implementation for the paper "Mixture-of-Depths: Dynamically allocating compute in transformer-based language models"☆167Updated last year
- Code accompanying the paper "Massive Activations in Large Language Models"☆170Updated last year
- Model soups: averaging weights of multiple fine-tuned models improves accuracy without increasing inference time☆474Updated last year
- Simple Parameter-efficient Fine-tuning for Transformer-based Masked Language-models☆142Updated 2 years ago
- This is the implementation of the paper AdaMix: Mixture-of-Adaptations for Parameter-efficient Model Tuning (https://arxiv.org/abs/2205.1…☆132Updated last year
- Explorations into some recent techniques surrounding speculative decoding☆272Updated 6 months ago
- A simple and effective LLM pruning approach.☆775Updated 11 months ago
- The official implementation of the paper "What Matters in Transformers? Not All Attention is Needed".☆174Updated 3 months ago
- [ICLR 2023] "Learning to Grow Pretrained Models for Efficient Transformer Training" by Peihao Wang, Rameswar Panda, Lucas Torroba Hennige…☆92Updated last year
- Official implementation of TransNormerLLM: A Faster and Better LLM☆247Updated last year
- An Extensible Continual Learning Framework Focused on Language Models (LMs)☆282Updated last year
- Code for T-Few from "Few-Shot Parameter-Efficient Fine-Tuning is Better and Cheaper than In-Context Learning"☆452Updated last year
- [ICCV2023] Dataset Quantization☆259Updated last year