Alternatives and similar repositories for offsite-tuning:

Users that are interested in offsite-tuning are comparing it to the libraries listed below

• sail-sg / lorahub
  [COLM 2024] LoraHub: Efficient Cross-Task Generalization via Dynamic LoRA Composition
  ☆630Updated 9 months ago
• JayZhang42 / FederatedGPT-Shepherd
  Shepherd: A foundational framework enabling federated instruction tuning for large language models
  ☆229Updated last year
• benzakenelad / BitFit
  Simple Parameter-efficient Fine-tuning for Transformer-based Masked Language-models
  ☆141Updated 2 years ago
• locuslab / wanda
  A simple and effective LLM pruning approach.
  ☆738Updated 8 months ago
• neelsjain / NEFTune
  Official repository of NEFTune: Noisy Embeddings Improves Instruction Finetuning
  ☆395Updated 11 months ago
• txsun1997 / Black-Box-Tuning
  ICML'2022: Black-Box Tuning for Language-Model-as-a-Service & EMNLP'2022: BBTv2: Towards a Gradient-Free Future with Large Language Model…
  ☆268Updated 2 years ago
• prateeky2806 / ties-merging
  ☆175Updated last year
• neelsjain / BYOD
  The Official Repository for "Bring Your Own Data! Self-Supervised Evaluation for Large Language Models"
  ☆108Updated last year
• huggingface / datablations
  Scaling Data-Constrained Language Models
  ☆334Updated 7 months ago
• Shark-NLP / OpenICL
  OpenICL is an open-source framework to facilitate research, development, and prototyping of in-context learning.
  ☆556Updated last year
• p-lambda / dsir
  DSIR large-scale data selection framework for language model training
  ☆246Updated last year
• Cohere-Labs-Community / parameter-efficient-moe
  ☆255Updated last year
• magic-research / Dataset_Quantization
  [ICCV2023] Dataset Quantization
  ☆259Updated last year
• yuhuixu1993 / qa-lora
  Official PyTorch implementation of QA-LoRA
  ☆131Updated last year
• locuslab / massive-activations
  Code accompanying the paper "Massive Activations in Large Language Models"
  ☆156Updated last year
• AGI-Edgerunners / LLM-Adapters
  Code for our EMNLP 2023 Paper: "LLM-Adapters: An Adapter Family for Parameter-Efficient Fine-Tuning of Large Language Models"
  ☆1,154Updated last year
• thunlp / DeltaPapers
  Must-read Papers of Parameter-Efficient Tuning (Delta Tuning) Methods on Pre-trained Models.
  ☆282Updated last year
• microsoft / rho
  Repo for Rho-1: Token-level Data Selection & Selective Pretraining of LLMs.
  ☆406Updated last year
• haoliuhl / chain-of-hindsight
  Simple next-token-prediction for RLHF
  ☆225Updated last year
• ycjing / Awesome-Model-Merging
  A curated list of Model Merging methods.
  ☆91Updated 7 months ago
• princeton-nlp / CoFiPruning
  [ACL 2022] Structured Pruning Learns Compact and Accurate Models https://arxiv.org/abs/2204.00408
  ☆195Updated last year
• declare-lab / instruct-eval
  This repository contains code to quantitatively evaluate instruction-tuned models such as Alpaca and Flan-T5 on held-out tasks.
  ☆546Updated last year
• nbasyl / DoRA
  Official implementation of "DoRA: Weight-Decomposed Low-Rank Adaptation"
  ☆123Updated last year
• facebookresearch / LLM-QAT
  Code repo for the paper "LLM-QAT Data-Free Quantization Aware Training for Large Language Models"
  ☆284Updated last month
• Arnav0400 / ViT-Slim
  Official code for our CVPR'22 paper “Vision Transformer Slimming: Multi-Dimension Searching in Continuous Optimization Space”
  ☆248Updated last year
• alon-albalak / data-selection-survey
  A Survey on Data Selection for Language Models
  ☆225Updated 6 months ago
• kaistAI / CoT-Collection
  [EMNLP 2023] The CoT Collection: Improving Zero-shot and Few-shot Learning of Language Models via Chain-of-Thought Fine-Tuning
  ☆238Updated last year
• QingruZhang / AdaLoRA
  AdaLoRA: Adaptive Budget Allocation for Parameter-Efficient Fine-Tuning (ICLR 2023).
  ☆320Updated last year
• thunlp / MoEfication
  ☆129Updated 9 months ago
• lucidrains / speculative-decoding
  Explorations into some recent techniques surrounding speculative decoding
  ☆259Updated 4 months ago