mit-han-lab / offsite-tuningLinks
Offsite-Tuning: Transfer Learning without Full Model
☆377Updated last year
Alternatives and similar repositories for offsite-tuning
Users that are interested in offsite-tuning are comparing it to the libraries listed below
Sorting:
- [COLM 2024] LoraHub: Efficient Cross-Task Generalization via Dynamic LoRA Composition☆649Updated last year
- ☆188Updated last year
- Shepherd: A foundational framework enabling federated instruction tuning for large language models☆241Updated 2 years ago
- Official code for our CVPR'22 paper “Vision Transformer Slimming: Multi-Dimension Searching in Continuous Optimization Space”☆250Updated last week
- ☆270Updated last year
- A framework for merging models solving different tasks with different initializations into one multi-task model without any additional tr…☆306Updated last year
- AdaLoRA: Adaptive Budget Allocation for Parameter-Efficient Fine-Tuning (ICLR 2023).☆344Updated 2 years ago
- Official repository of NEFTune: Noisy Embeddings Improves Instruction Finetuning☆400Updated last year
- OpenICL is an open-source framework to facilitate research, development, and prototyping of in-context learning.☆570Updated last year
- DSIR large-scale data selection framework for language model training☆258Updated last year
- Editing Models with Task Arithmetic☆495Updated last year
- ☆227Updated last year
- Code for "SemDeDup", a simple method for identifying and removing semantic duplicates from a dataset (data pairs which are semantically s…☆139Updated last year
- A simple and effective LLM pruning approach.☆793Updated last year
- A curated list of Model Merging methods.☆92Updated 11 months ago
- Code release for Dataless Knowledge Fusion by Merging Weights of Language Models (https://openreview.net/forum?id=FCnohuR6AnM)☆90Updated 2 years ago
- Simple Parameter-efficient Fine-tuning for Transformer-based Masked Language-models☆142Updated 2 years ago
- Collection of Tools and Papers related to Adapters / Parameter-Efficient Transfer Learning/ Fine-Tuning☆197Updated last year
- Scaling Data-Constrained Language Models☆340Updated 2 months ago
- Official PyTorch implementation of QA-LoRA☆140Updated last year
- Official implementation of "DoRA: Weight-Decomposed Low-Rank Adaptation"☆124Updated last year
- Simple next-token-prediction for RLHF☆227Updated last year
- ☆73Updated 3 years ago
- Repo for Rho-1: Token-level Data Selection & Selective Pretraining of LLMs.☆432Updated last year
- Official implementation of TransNormerLLM: A Faster and Better LLM☆247Updated last year
- This repository provides an original implementation of Detecting Pretraining Data from Large Language Models by *Weijia Shi, *Anirudh Aji…☆230Updated last year
- This repository contains code to quantitatively evaluate instruction-tuned models such as Alpaca and Flan-T5 on held-out tasks.☆547Updated last year
- Unofficial implementation for the paper "Mixture-of-Depths: Dynamically allocating compute in transformer-based language models"☆170Updated last year
- Official code for ReLoRA from the paper Stack More Layers Differently: High-Rank Training Through Low-Rank Updates☆462Updated last year
- This is the implementation of the paper AdaMix: Mixture-of-Adaptations for Parameter-efficient Model Tuning (https://arxiv.org/abs/2205.1…☆132Updated 2 years ago