Alternatives and similar repositories for rethinking-LLM-pruning

Users that are interested in rethinking-LLM-pruning are comparing it to the libraries listed below

• kimyuji / EvolvingQA_benchmark
  Code and Dataset release of "Carpe Diem: On the Evaluation of World Knowledge in Lifelong Language Models" (NAACL 2024)
  ☆10Updated 9 months ago
• Nota-NetsPresso / shortened-llm
  Compressed LLMs for Efficient Text Generation [ICLR'24 Workshop]
  ☆84Updated 10 months ago
• edong6768 / Malet
  🔨 Malet (Machine Learning Experiment Tool) is a tool for efficient machine learning experiment execution, logging, analysis, and plot ma…
  ☆17Updated 2 months ago
• hdong920 / LESS
  ☆50Updated last year
• Jingyu6 / speculative_prefill
  ☆34Updated 2 months ago
• MattYoon / reasoning-models-confidence
  Code for the paper "Reasoning Models Better Express Their Confidence"
  ☆15Updated last month
• SempraETY / Pruning-via-Merging
  ☆18Updated 7 months ago
• raymin0223 / fast_robust_early_exit
  Fast and Robust Early-Exiting Framework for Autoregressive Language Models with Synchronized Parallel Decoding (EMNLP 2023 Long)
  ☆60Updated 9 months ago
• goddoe / simple-r1
  ☆15Updated last month
• mmatena / model_merging
  ☆70Updated 3 years ago
• yangyifei729 / LaCo
  Official implementation for LaCo (EMNLP 2024 Findings)
  ☆17Updated 9 months ago
• alvin-zyl / CoLA
  Implementation of CoLA: Compute-Efficient Pre-Training of LLMs via Low-Rank Activation
  ☆23Updated 5 months ago
• zyxxmu / DSnoT
  Official Pytorch Implementation of Our Paper Accepted at ICLR 2024-- Dynamic Sparse No Training: Training-Free Fine-tuning for Sparse LLM…
  ☆49Updated last year
• princeton-pli / LongProc
  LongProc: Benchmarking Long-Context Language Models on Long Procedural Generation
  ☆26Updated 3 weeks ago
• LOG-postech / Sassha
  Official Pytorch code for "SASSHA: Sharpness-aware Adaptive Second-order Optimization With Stable Hessian Approximation"
  ☆14Updated 3 months ago
• jiwonsong-dev / SLEB
  Official Implementation of SLEB: Streamlining LLMs through Redundancy Verification and Elimination of Transformer Blocks
  ☆36Updated 5 months ago
• joeljang / knowledge-unlearning
  [ACL 2023] Knowledge Unlearning for Mitigating Privacy Risks in Language Models
  ☆82Updated 10 months ago
• hdong920 / GRIFFIN
  ☆38Updated 10 months ago
• joonkeekim / Instructive-Decoding
  Official repository of "Distort, Distract, Decode: Instruction-Tuned Model Can Refine its Response from Noisy Instructions", ICLR 2024 Sp…
  ☆20Updated last year
• PositionalHidden / PositionalHidden
  To mitigate position bias in LLMs, especially in long-context scenarios, we scale only one dimension of LLMs, reducing position bias and …
  ☆11Updated last year
• LOG-postech / SAM-overparam
  Code for UAI 2025 paper "Critical Influence of Overparameterization on Sharpness-aware Minimization"
  ☆19Updated 2 months ago
• kssteven418 / BigLittleDecoder
  [NeurIPS'23] Speculative Decoding with Big Little Decoder
  ☆93Updated last year
• sail-sg / lm-random-memory-access
  ☆14Updated last year
• joeljang / continual-knowledge-learning
  [ICLR 2022] Towards Continual Knowledge Learning of Language Models
  ☆92Updated 2 years ago
• joeljang / temporalwiki
  [EMNLP 2022] TemporalWiki: A Lifelong Benchmark for Training and Evaluating Ever-Evolving Language Models
  ☆72Updated last year
• yxli2123 / LoSparse
  ☆58Updated last year
• UtkarshSaxena1 / EigenAttn
  ☆16Updated 9 months ago
• liyunqianggyn / Awesome-LLMs-Pruning
  Awesome LLM pruning papers all-in-one repository with integrating all useful resources and insights.
  ☆96Updated 7 months ago
• chujiezheng / LLM-MCQ-Bias
  Official repository for ICLR 2024 Spotlight paper "Large Language Models Are Not Robust Multiple Choice Selectors"
  ☆39Updated last month
• MANGA-UOFA / fdistill
  ☆23Updated last year