VijayLingam95 / SVFT

Related projects ⓘ

Alternatives and complementary repositories for SVFT

• r-three / smear
  ☆27Updated last year
• VITA-Group / Random-MoE-as-Dropout
  [ICLR 2023] "Sparse MoE as the New Dropout: Scaling Dense and Self-Slimmable Transformers" by Tianlong Chen*, Zhenyu Zhang*, Ajay Jaiswal…
  ☆44Updated last year
• raymin0223 / fast_robust_early_exit
  Fast and Robust Early-Exiting Framework for Autoregressive Language Models with Synchronized Parallel Decoding (EMNLP 2023 Long)
  ☆52Updated last month
• wang-kee / LiNeS
  ☆20Updated last week
• mmatena / model_merging
  ☆61Updated 2 years ago
• ldery / Bonsai
  Code for "Everybody Prune Now: Structured Pruning of LLMs with only Forward Passes"
  ☆28Updated 7 months ago
• IST-DASLab / RoSA
  ☆34Updated 8 months ago
• nik-dim / tall_masks
  Official repository of "Localizing Task Information for Improved Model Merging and Compression" [ICML 2024]
  ☆34Updated 2 weeks ago
• activatedgeek / calibration-tuning
  ☆34Updated 3 months ago
• RobertCsordas / moeut
  ☆61Updated 2 months ago
• FeiyuZhang98 / IncreLoRA
  ☆29Updated last year
• lucidrains / pause-transformer
  Yet another random morning idea to be quickly tried and architecture shared if it works; to allow the transformer to pause for any amount…
  ☆49Updated last year
• EnnengYang / AdaMerging
  AdaMerging: Adaptive Model Merging for Multi-Task Learning. ICLR, 2024.
  ☆49Updated 2 weeks ago
• berlino / seq_icl
  ☆50Updated 5 months ago
• Thartvigsen / GRACE
  [NeurIPS'23] Aging with GRACE: Lifelong Model Editing with Discrete Key-Value Adaptors
  ☆69Updated 8 months ago
• JeanKaddour / NoTrainNoGain
  Revisiting Efficient Training Algorithms For Transformer-based Language Models (NeurIPS 2023)
  ☆79Updated last year
• adymaharana / d2pruning
  ☆31Updated last year
• sail-sg / Attention-Sink
  [ATTRIB @ NeurIPS 2024] When Attention Sink Emerges in Language Models: An Empirical View
  ☆27Updated 3 weeks ago
• gortizji / tangent_task_arithmetic
  Source code of "Task arithmetic in the tangent space: Improved editing of pre-trained models".
  ☆84Updated last year
• OpenNLPLab / HGRN2
  HGRN2: Gated Linear RNNs with State Expansion
  ☆49Updated 2 months ago
• locuslab / massive-activations
  Code accompanying the paper "Massive Activations in Large Language Models"
  ☆121Updated 8 months ago
• UKPLab / iclr2024-model-merging
  This is the repository for "Model Merging by Uncertainty-Based Gradient Matching", ICLR 2024.
  ☆20Updated 5 months ago
• prateeky2806 / ties-merging
  ☆149Updated 9 months ago
• ZhengxiangShi / InstructionModelling
  [NeurIPS 2024 Main Track] Code for the paper titled "Instruction Tuning With Loss Over Instructions"
  ☆25Updated 5 months ago
• zjunlp / ModelKinship
  Exploring Model Kinship for Merging Large Language Models
  ☆18Updated last week
• ZhengxiangShi / DePT
  [ICLR 2024] This is the repository for the paper titled "DePT: Decomposed Prompt Tuning for Parameter-Efficient Fine-tuning"
  ☆95Updated 7 months ago
• epfml / schedules-and-scaling
  ☆50Updated last week
• abhishekpanigrahi1996 / transformer_in_transformer
  ☆44Updated last year
• CASE-Lab-UMD / Unified-MoE-Compression
  The official implementation of the paper "Demystifying the Compression of Mixture-of-Experts Through a Unified Framework".
  ☆48Updated 2 weeks ago
• epfml / pam
  ☆14Updated 11 months ago