Alternatives and similar repositories for EigenAttn:

Users that are interested in EigenAttn are comparing it to the libraries listed below

• ArminAzizi98 / LaMDA
  ☆15Updated 5 months ago
• FeiyuZhang98 / IncreLoRA
  ☆31Updated last year
• zyxxmu / DSnoT
  Official Pytorch Implementation of Our Paper Accepted at ICLR 2024-- Dynamic Sparse No Training: Training-Free Fine-tuning for Sparse LLM…
  ☆47Updated last year
• SempraETY / Pruning-via-Merging
  ☆18Updated 4 months ago
• ldery / Bonsai
  Code for "Everybody Prune Now: Structured Pruning of LLMs with only Forward Passes"
  ☆27Updated last year
• VITA-Group / Junk_DNA_Hypothesis
  [ICML 2024] Junk DNA Hypothesis: A Task-Centric Angle of LLM Pre-trained Weights through Sparsity; Lu Yin*, Ajay Jaiswal*, Shiwei Liu, So…
  ☆16Updated 10 months ago
• uservan / ThinkPO
  ☆20Updated last month
• dongwonjo / FastKV
  Official Implementation of FastKV: KV Cache Compression for Fast Long-Context Processing with Token-Selective Propagation
  ☆17Updated last week
• jiwonsong-dev / SLEB
  Official Implementation of SLEB: Streamlining LLMs through Redundancy Verification and Elimination of Transformer Blocks
  ☆36Updated 2 months ago
• yxli2123 / LoSparse
  ☆50Updated last year
• harveyhuang18 / EMR_Merging
  [NeurIPS 2024 Spotlight] EMR-Merging: Tuning-Free High-Performance Model Merging
  ☆56Updated last month
• MrGGLS / BlockPruner
  A block pruning framework for LLMs.
  ☆22Updated 9 months ago
• VijayLingam95 / SVFT
  ☆27Updated 2 months ago
• BaohaoLiao / ApiQ
  [EMNLP 2024] Quantize LLM to extremely low-bit, and finetune the quantized LLMs
  ☆12Updated 9 months ago
• raymin0223 / fast_robust_early_exit
  Fast and Robust Early-Exiting Framework for Autoregressive Language Models with Synchronized Parallel Decoding (EMNLP 2023 Long)
  ☆57Updated 6 months ago
• hahnyuan / ASVD4LLM
  Activation-aware Singular Value Decomposition for Compressing Large Language Models
  ☆62Updated 5 months ago
• princeton-nlp / Edge-Pruning
  [NeurIPS 2024 Spotlight] Code and data for the paper "Finding Transformer Circuits with Edge Pruning".
  ☆50Updated last month
• TaiMingLu / know-dont-tell
  ☆14Updated 6 months ago
• ylsung / rsq
  Code for "RSQ: Learning from Important Tokens Leads to Better Quantized LLMs"
  ☆14Updated last month
• peijunallin / alphalora
  ☆17Updated 5 months ago
• pixeli99 / OwLore
  Official Pytorch Implementation of "OwLore: Outlier-weighed Layerwise Sampled Low-Rank Projection for Memory-Efficient LLM Fine-tuning" b…
  ☆31Updated 10 months ago
• tanganke / opcm
  ☆10Updated 2 months ago
• wzhuang-xmu / LoSA
  [ICLR 2025] The official pytorch implement of "Dynamic Low-Rank Sparse Adaptation for Large Language Models".
  ☆16Updated last month
• IST-DASLab / RoSA
  Official implementation of the ICML 2024 paper RoSA (Robust Adaptation)
  ☆40Updated last year
• osehmathias / lisa
  LISA: Layerwise Importance Sampling for Memory-Efficient Large Language Model Fine-Tuning
  ☆31Updated last year
• gortizji / tangent_task_arithmetic
  Source code of "Task arithmetic in the tangent space: Improved editing of pre-trained models".
  ☆101Updated last year
• UCSB-NLP-Chang / ThinkPrune
  ☆14Updated this week
• Infini-AI-Lab / S2FT
  ☆17Updated 3 months ago
• VITA-Group / Random-MoE-as-Dropout
  [ICLR 2023] "Sparse MoE as the New Dropout: Scaling Dense and Self-Slimmable Transformers" by Tianlong Chen*, Zhenyu Zhang*, Ajay Jaiswal…
  ☆50Updated 2 years ago
• abdelfattah-lab / TokenButler
  ☆20Updated 2 weeks ago