Alternatives and similar repositories for rethinking-LLM-pruning

Users that are interested in rethinking-LLM-pruning are comparing it to the libraries listed below

• LOG-postech / Sassha
  Official Pytorch code for "SASSHA: Sharpness-aware Adaptive Second-order Optimization With Stable Hessian Approximation"
  ☆12Updated last month
• LOG-postech / SAM-overparam
  Code for UAI 2025 paper "Critical Influence of Overparameterization on Sharpness-aware Minimization"
  ☆18Updated this week
• LOG-postech / ZIP
  ☆13Updated 2 months ago
• edong6768 / Malet
  🔨 Malet (Machine Learning Experiment Tool) is a tool for efficient machine learning experiment execution, logging, analysis, and plot ma…
  ☆17Updated 3 weeks ago
• kimyuji / EvolvingQA_benchmark
  Code and Dataset release of "Carpe Diem: On the Evaluation of World Knowledge in Lifelong Language Models" (NAACL 2024)
  ☆10Updated 7 months ago
• ssbin4 / Closer-Intervention-CBM
  ☆24Updated last year
• gortizji / tangent_task_arithmetic
  Source code of "Task arithmetic in the tangent space: Improved editing of pre-trained models".
  ☆100Updated last year
• snu-mllab / Bayesian-Red-Teaming
  About Official PyTorch implementation of "Query-Efficient Black-Box Red Teaming via Bayesian Optimization" (ACL'23)
  ☆14Updated last year
• zyxxmu / DSnoT
  Official Pytorch Implementation of Our Paper Accepted at ICLR 2024-- Dynamic Sparse No Training: Training-Free Fine-tuning for Sparse LLM…
  ☆47Updated last year
• SempraETY / Pruning-via-Merging
  ☆18Updated 5 months ago
• joonkeekim / Instructive-Decoding
  Official repository of "Distort, Distract, Decode: Instruction-Tuned Model Can Refine its Response from Noisy Instructions", ICLR 2024 Sp…
  ☆20Updated last year
• mmatena / model_merging
  ☆66Updated 3 years ago
• jiwonsong-dev / SLEB
  Official Implementation of SLEB: Streamlining LLMs through Redundancy Verification and Elimination of Transformer Blocks
  ☆37Updated 3 months ago
• goddoe / simple-r1
  ☆15Updated 2 months ago
• joeljang / temporalwiki
  [EMNLP 2022] TemporalWiki: A Lifelong Benchmark for Training and Evaluating Ever-Evolving Language Models
  ☆71Updated last year
• MANGA-UOFA / fdistill
  ☆22Updated last year
• tanganke / peta
  Code for paper "Parameter Efficient Multi-task Model Fusion with Partial Linearization"
  ☆21Updated 8 months ago
• VITA-Group / Junk_DNA_Hypothesis
  [ICML 2024] Junk DNA Hypothesis: A Task-Centric Angle of LLM Pre-trained Weights through Sparsity; Lu Yin*, Ajay Jaiswal*, Shiwei Liu, So…
  ☆16Updated 3 weeks ago
• Shwai-He / SparseAdapter
  Source code of EMNLP 2022 Findings paper "SparseAdapter: An Easy Approach for Improving the Parameter-Efficiency of Adapters"
  ☆18Updated last year
• yxli2123 / LoSparse
  ☆51Updated last year
• UKPLab / iclr2024-model-merging
  This is the repository for "Model Merging by Uncertainty-Based Gradient Matching", ICLR 2024.
  ☆27Updated last year
• sail-sg / lm-random-memory-access
  ☆14Updated last year
• tml-epfl / long-is-more-for-alignment
  Long Is More for Alignment: A Simple but Tough-to-Beat Baseline for Instruction Fine-Tuning [ICML 2024]
  ☆17Updated last year
• QingruZhang / PLATON
  This pytorch package implements PLATON: Pruning Large Transformer Models with Upper Confidence Bound of Weight Importance (ICML 2022).
  ☆46Updated 2 years ago
• joeljang / knowledge-unlearning
  [ACL 2023] Knowledge Unlearning for Mitigating Privacy Risks in Language Models
  ☆81Updated 8 months ago
• p1nksnow / MoICE
  Official implementation for "Mixture of In-Context Experts Enhance LLMs’ Awareness of Long Contexts" (Accepted by Neurips2024)
  ☆12Updated 4 months ago
• ETRI-XAINLP / KorFactScore
  한국어 생성 문서의 원소 사실 관계에 대한 설명 기술
  ☆16Updated 5 months ago
• cjyaras / deep-lora-transformers
  Compressible Dynamics in Deep Overparameterized Low-Rank Learning & Adaptation (ICML'24 Oral)
  ☆14Updated 9 months ago
• nik-dim / tall_masks
  Official repository of "Localizing Task Information for Improved Model Merging and Compression" [ICML 2024]
  ☆44Updated 6 months ago
• jongwooko / NASH-Pruning-Official
  About Code for the paper "NASH: A Simple Unified Framework of Structured Pruning for Accelerating Encoder-Decoder Language Models" (EMNLP…
  ☆16Updated last year