Alternatives and similar repositories for offsite-tuning:

Users that are interested in offsite-tuning are comparing it to the libraries listed below

• sail-sg / lorahub
  [COLM 2024] LoraHub: Efficient Cross-Task Generalization via Dynamic LoRA Composition
  ☆614Updated 7 months ago
• p-lambda / dsir
  DSIR large-scale data selection framework for language model training
  ☆241Updated 10 months ago
• benzakenelad / BitFit
  Simple Parameter-efficient Fine-tuning for Transformer-based Masked Language-models
  ☆138Updated 2 years ago
• Shark-NLP / OpenICL
  OpenICL is an open-source framework to facilitate research, development, and prototyping of in-context learning.
  ☆546Updated last year
• r-three / t-few
  Code for T-Few from "Few-Shot Parameter-Efficient Fine-Tuning is Better and Cheaper than In-Context Learning"
  ☆443Updated last year
• Guitaricet / relora
  Official code for ReLoRA from the paper Stack More Layers Differently: High-Rank Training Through Low-Rank Updates
  ☆444Updated 10 months ago
• neelsjain / NEFTune
  Official repository of NEFTune: Noisy Embeddings Improves Instruction Finetuning
  ☆389Updated 9 months ago
• huggingface / datablations
  Scaling Data-Constrained Language Models
  ☆333Updated 5 months ago
• locuslab / wanda
  A simple and effective LLM pruning approach.
  ☆712Updated 6 months ago
• yuhuixu1993 / qa-lora
  Official PyTorch implementation of QA-LoRA
  ☆126Updated 11 months ago
• txsun1997 / Black-Box-Tuning
  ICML'2022: Black-Box Tuning for Language-Model-as-a-Service & EMNLP'2022: BBTv2: Towards a Gradient-Free Future with Large Language Model…
  ☆265Updated 2 years ago
• JayZhang42 / FederatedGPT-Shepherd
  Shepherd: A foundational framework enabling federated instruction tuning for large language models
  ☆222Updated last year
• epfLLM / Megatron-LLM
  distributed trainer for LLMs
  ☆558Updated 9 months ago
• mlfoundations / task_vectors
  Editing Models with Task Arithmetic
  ☆451Updated last year
• yxli2123 / LoftQ
  ☆217Updated 8 months ago
• AGI-Edgerunners / LLM-Adapters
  Code for our EMNLP 2023 Paper: "LLM-Adapters: An Adapter Family for Parameter-Efficient Fine-Tuning of Large Language Models"
  ☆1,127Updated 11 months ago
• GanjinZero / RRHF
  [NIPS2023] RRHF & Wombat
  ☆799Updated last year
• QingruZhang / AdaLoRA
  AdaLoRA: Adaptive Budget Allocation for Parameter-Efficient Fine-Tuning (ICLR 2023).
  ☆292Updated last year
• prateeky2806 / ties-merging
  ☆166Updated last year
• thunlp / DeltaPapers
  Must-read Papers of Parameter-Efficient Tuning (Delta Tuning) Methods on Pre-trained Models.
  ☆281Updated last year
• microsoft / Tutel
  Tutel MoE: An Optimized Mixture-of-Experts Implementation
  ☆766Updated this week
• princeton-nlp / LLM-Shearing
  [ICLR 2024] Sheared LLaMA: Accelerating Language Model Pre-training via Structured Pruning
  ☆585Updated 11 months ago
• RenzeLou / awesome-instruction-learning
  Papers and Datasets on Instruction Tuning and Following. ✨✨✨
  ☆481Updated 10 months ago
• sangmichaelxie / doremi
  Pytorch implementation of DoReMi, a method for optimizing the data mixture weights in language modeling datasets
  ☆312Updated last year
• for-ai / parameter-efficient-moe
  ☆251Updated last year
• haoliuhl / chain-of-hindsight
  Simple next-token-prediction for RLHF
  ☆222Updated last year
• ylsung / Ladder-Side-Tuning
  PyTorch codes for "LST: Ladder Side-Tuning for Parameter and Memory Efficient Transfer Learning"
  ☆234Updated 2 years ago
• declare-lab / instruct-eval
  This repository contains code to quantitatively evaluate instruction-tuned models such as Alpaca and Flan-T5 on held-out tasks.
  ☆541Updated 11 months ago
• princeton-nlp / LESS
  [ICML 2024] LESS: Selecting Influential Data for Targeted Instruction Tuning
  ☆412Updated 4 months ago
• kaistAI / CoT-Collection
  [EMNLP 2023] The CoT Collection: Improving Zero-shot and Few-shot Learning of Language Models via Chain-of-Thought Fine-Tuning
  ☆229Updated last year