mit-han-lab / offsite-tuning

Related projects ⓘ

Alternatives and complementary repositories for offsite-tuning

• JayZhang42 / FederatedGPT-Shepherd
  Shepherd: A foundational framework enabling federated instruction tuning for large language models
  ☆204Updated last year
• sail-sg / lorahub
  [COLM 2024] LoraHub: Efficient Cross-Task Generalization via Dynamic LoRA Composition
  ☆598Updated 4 months ago
• prateeky2806 / ties-merging
  ☆153Updated 9 months ago
• yuhuixu1993 / qa-lora
  Official PyTorch implementation of QA-LoRA
  ☆117Updated 8 months ago
• neelsjain / NEFTune
  Official repository of NEFTune: Noisy Embeddings Improves Instruction Finetuning
  ☆384Updated 6 months ago
• calpt / awesome-adapter-resources
  Collection of Tools and Papers related to Adapters / Parameter-Efficient Transfer Learning/ Fine-Tuning
  ☆176Updated 6 months ago
• locuslab / wanda
  A simple and effective LLM pruning approach.
  ☆672Updated 3 months ago
• QingruZhang / AdaLoRA
  AdaLoRA: Adaptive Budget Allocation for Parameter-Efficient Fine-Tuning (ICLR 2023).
  ☆278Updated last year
• p-lambda / dsir
  DSIR large-scale data selection framework for language model training
  ☆231Updated 7 months ago
• astramind-ai / Mixture-of-depths
  Unofficial implementation for the paper "Mixture-of-Depths: Dynamically allocating compute in transformer-based language models"
  ☆135Updated 5 months ago
• EnnengYang / Awesome-Model-Merging-Methods-Theories-Applications
  Model Merging in LLMs, MLLMs, and Beyond: Methods, Theories, Applications and Opportunities. arXiv:2408.07666.
  ☆220Updated this week
• yxli2123 / LoftQ
  ☆199Updated 5 months ago
• HenryHZY / Awesome-Multimodal-LLM
  Research Trends in LLM-guided Multimodal Learning.
  ☆355Updated last year
• CASE-Lab-UMD / LLM-Drop
  The official implementation of the paper "What Matters in Transformers? Not All Attention is Needed".
  ☆143Updated last week
• thunlp / DeltaPapers
  Must-read Papers of Parameter-Efficient Tuning (Delta Tuning) Methods on Pre-trained Models.
  ☆277Updated last year
• princeton-nlp / LLM-Shearing
  [ICLR 2024] Sheared LLaMA: Accelerating Language Model Pre-training via Structured Pruning
  ☆560Updated 8 months ago
• facebookresearch / LLM-QAT
  Code repo for the paper "LLM-QAT Data-Free Quantization Aware Training for Large Language Models"
  ☆254Updated 2 months ago
• huggingface / datablations
  Scaling Data-Constrained Language Models
  ☆321Updated 2 months ago
• declare-lab / instruct-eval
  This repository contains code to quantitatively evaluate instruction-tuned models such as Alpaca and Flan-T5 on held-out tasks.
  ☆530Updated 8 months ago
• locuslab / massive-activations
  Code accompanying the paper "Massive Activations in Large Language Models"
  ☆123Updated 8 months ago
• mlfoundations / task_vectors
  Editing Models with Task Arithmetic
  ☆430Updated 10 months ago
• UIC-Liu-Lab / ContinualLM
  An Extensible Continual Learning Framework Focused on Language Models (LMs)
  ☆253Updated 9 months ago
• Shark-NLP / OpenICL
  OpenICL is an open-source framework to facilitate research, development, and prototyping of in-context learning.
  ☆541Updated last year
• OpenNLPLab / TransnormerLLM
  Official implementation of TransNormerLLM: A Faster and Better LLM
  ☆229Updated 10 months ago
• bojone / rerope
  Rectified Rotary Position Embeddings
  ☆341Updated 6 months ago
• ycjing / Awesome-Model-Merging
  A curated list of Model Merging methods.
  ☆83Updated 2 months ago
• haoliuhl / chain-of-hindsight
  Simple next-token-prediction for RLHF
  ☆220Updated last year
• google-research / vmoe
  ☆575Updated last week
• kaistAI / CoT-Collection
  [EMNLP 2023] The CoT Collection: Improving Zero-shot and Few-shot Learning of Language Models via Chain-of-Thought Fine-Tuning
  ☆214Updated last year
• benzakenelad / BitFit
  Simple Parameter-efficient Fine-tuning for Transformer-based Masked Language-models
  ☆133Updated 2 years ago