Alternatives and similar repositories for offsite-tuning:

Users that are interested in offsite-tuning are comparing it to the libraries listed below

• sail-sg / lorahub
  [COLM 2024] LoraHub: Efficient Cross-Task Generalization via Dynamic LoRA Composition
  ☆623Updated 8 months ago
• JayZhang42 / FederatedGPT-Shepherd
  Shepherd: A foundational framework enabling federated instruction tuning for large language models
  ☆228Updated last year
• txsun1997 / Black-Box-Tuning
  ICML'2022: Black-Box Tuning for Language-Model-as-a-Service & EMNLP'2022: BBTv2: Towards a Gradient-Free Future with Large Language Model…
  ☆267Updated 2 years ago
• p-lambda / dsir
  DSIR large-scale data selection framework for language model training
  ☆244Updated 11 months ago
• princeton-nlp / CoFiPruning
  [ACL 2022] Structured Pruning Learns Compact and Accurate Models https://arxiv.org/abs/2204.00408
  ☆196Updated last year
• benzakenelad / BitFit
  Simple Parameter-efficient Fine-tuning for Transformer-based Masked Language-models
  ☆140Updated 2 years ago
• r-three / t-few
  Code for T-Few from "Few-Shot Parameter-Efficient Fine-Tuning is Better and Cheaper than In-Context Learning"
  ☆447Updated last year
• yuhuixu1993 / qa-lora
  Official PyTorch implementation of QA-LoRA
  ☆129Updated last year
• SimiaoZuo / MoEBERT
  This PyTorch package implements MoEBERT: from BERT to Mixture-of-Experts via Importance-Guided Adaptation (NAACL 2022).
  ☆103Updated 2 years ago
• Arnav0400 / ViT-Slim
  Official code for our CVPR'22 paper “Vision Transformer Slimming: Multi-Dimension Searching in Continuous Optimization Space”
  ☆249Updated last year
• prateeky2806 / ties-merging
  ☆172Updated last year
• locuslab / wanda
  A simple and effective LLM pruning approach.
  ☆727Updated 7 months ago
• thunlp / DeltaPapers
  Must-read Papers of Parameter-Efficient Tuning (Delta Tuning) Methods on Pre-trained Models.
  ☆281Updated last year
• yxli2123 / LoftQ
  ☆220Updated 9 months ago
• magic-research / Dataset_Quantization
  [ICCV2023] Dataset Quantization
  ☆258Updated last year
• llm-efficiency-challenge / neurips_llm_efficiency_challenge
  NeurIPS Large Language Model Efficiency Challenge: 1 LLM + 1GPU + 1Day
  ☆255Updated last year
• QingruZhang / AdaLoRA
  AdaLoRA: Adaptive Budget Allocation for Parameter-Efficient Fine-Tuning (ICLR 2023).
  ☆311Updated last year
• huggingface / datablations
  Scaling Data-Constrained Language Models
  ☆335Updated 6 months ago
• neelsjain / NEFTune
  Official repository of NEFTune: Noisy Embeddings Improves Instruction Finetuning
  ☆394Updated 10 months ago
• for-ai / parameter-efficient-moe
  ☆253Updated last year
• Shark-NLP / OpenICL
  OpenICL is an open-source framework to facilitate research, development, and prototyping of in-context learning.
  ☆554Updated last year
• astramind-ai / Mixture-of-depths
  Unofficial implementation for the paper "Mixture-of-Depths: Dynamically allocating compute in transformer-based language models"
  ☆155Updated 9 months ago
• haochengxi / Train_Transformers_with_INT4
  ☆145Updated last year
• calpt / awesome-adapter-resources
  Collection of Tools and Papers related to Adapters / Parameter-Efficient Transfer Learning/ Fine-Tuning
  ☆188Updated 10 months ago
• OpenNLPLab / TransnormerLLM
  Official implementation of TransNormerLLM: A Faster and Better LLM
  ☆243Updated last year
• neelsjain / BYOD
  The Official Repository for "Bring Your Own Data! Self-Supervised Evaluation for Large Language Models"
  ☆108Updated last year
• lucidrains / speculative-decoding
  Explorations into some recent techniques surrounding speculative decoding
  ☆250Updated 3 months ago
• ycjing / Awesome-Model-Merging
  A curated list of Model Merging methods.
  ☆91Updated 6 months ago
• ylsung / Ladder-Side-Tuning
  PyTorch codes for "LST: Ladder Side-Tuning for Parameter and Memory Efficient Transfer Learning"
  ☆236Updated 2 years ago
• CASE-Lab-UMD / LLM-Drop
  The official implementation of the paper "What Matters in Transformers? Not All Attention is Needed".
  ☆165Updated this week