snu-mllab / LayerMerge

Related projects ⓘ

Alternatives and complementary repositories for LayerMerge

• yyyyychen / LowMemoryBP
  The official implementation of the paper "Reducing Fine-Tuning Memory Overhead by Approximate and Memory-Sharing Backpropagation"
  ☆16Updated 4 months ago
• Qichuzyy / POA
  Official implementation of ECCV24 paper: POA
  ☆24Updated 3 months ago
• NVlabs / STL
  Official Pytorch Implementation of Self-emerging Token Labeling
  ☆30Updated 7 months ago
• Optimization-AI / fast_clip
  ☆19Updated last month
• philippe-eecs / small-vision
  A big_vision inspired repo that implements a generic Auto-Encoder class capable in representation learning and generative modeling.
  ☆30Updated 4 months ago
• OliverRensu / MVAR
  ☆40Updated this week
• RobertCsordas / moe_attention
  Official repository for the paper "SwitchHead: Accelerating Transformers with Mixture-of-Experts Attention"
  ☆92Updated last month
• csarron / PuMer
  [ACL 2023] PuMer: Pruning and Merging Tokens for Efficient Vision Language Models
  ☆28Updated last month
• ThisisBillhe / EfficientDM
  [ICLR 2024 Spotlight] This is the official PyTorch implementation of "EfficientDM: Efficient Quantization-Aware Fine-Tuning of Low-Bit Di…
  ☆50Updated 5 months ago
• OpenGVLab / LLMPrune-BESA
  BESA is a differentiable weight pruning technique for large language models.
  ☆14Updated 8 months ago
• LiqunMa / FBI-LLM
  FBI-LLM: Scaling Up Fully Binarized LLMs from Scratch via Autoregressive Distillation
  ☆46Updated 4 months ago
• VILA-Lab / GBLM-Pruner
  Are gradient information useful for pruning of LLMs?
  ☆38Updated 7 months ago
• Christina200 / Online-LoRA-official
  [WACV 2025] Official implementation of "Online-LoRA: Task-free Online Continual Learning via Low Rank Adaptation" by Xiwen Wei, Guihong L…
  ☆22Updated last week
• NVlabs / SMCP
  ☆20Updated 2 years ago
• savadikarc / gift
  GIFT: Generative Interpretable Fine-Tuning
  ☆18Updated last month
• Skhaki18 / optin-transformer-pruning
  [ICLR 2024] The Need for Speed: Pruning Transformers with One Recipe
  ☆22Updated 2 months ago
• Huage001 / Paint-Anything
  An interactive demo based on Segment-Anything for stroke-based painting which enables human-like painting.
  ☆34Updated last year
• layer6ai-labs / fusemix
  Data-Efficient Multimodal Fusion on a Single GPU
  ☆47Updated 6 months ago
• mengxiayu / LLMSuperWeight
  Code for studying the super weight in LLM
  ☆16Updated last week
• Roblox / SmoothCache
  Implementation of SmoothCache, a project aimed at speeding-up Diffusion Transformer (DiT) based GenAI models with error-guided caching.
  ☆18Updated this week
• UCDvision / NOLA
  Code for NOLA, an implementation of "nola: Compressing LoRA using Linear Combination of Random Basis"
  ☆49Updated 2 months ago
• GATECH-EIC / Linearized-LLM
  [ICML 2024] When Linear Attention Meets Autoregressive Decoding: Towards More Effective and Efficient Linearized Large Language Models
  ☆26Updated 5 months ago
• ldery / Bonsai
  Code for "Everybody Prune Now: Structured Pruning of LLMs with only Forward Passes"
  ☆28Updated 7 months ago
• facebookresearch / SIEVE
  SIEVE: Multimodal Dataset Pruning using Image-Captioning Models (CVPR 2024)
  ☆14Updated 6 months ago
• CownowAn / DaSS
  Official PyTorch implementation of "Meta-prediction Model for Distillation-Aware NAS on Unseen Datasets" (ICLR 2023 notable top 25%)
  ☆22Updated 8 months ago
• yuzhenmao / IceFormer
  Implementation of IceFormer: Accelerated Inference with Long-Sequence Transformers on CPUs (ICLR 2024).
  ☆20Updated 5 months ago
• kiddyboots216 / lottery-ticket-adaptation
  Lottery Ticket Adaptation
  ☆36Updated last month
• IST-DASLab / RoSA
  ☆35Updated 9 months ago
• kyegomez / MultiQueryAttention
  This is a simple torch implementation of the high performance Multi-Query Attention
  ☆15Updated last year
• kyegomez / MAGVIT2
  Open source community's implementation of the model from "LANGUAGE MODEL BEATS DIFFUSION — TOKENIZER IS KEY TO VISUAL GENERATION"
  ☆15Updated last week