Alternatives and similar repositories for LLM-AttentionPredictor

Users that are interested in LLM-AttentionPredictor are comparing it to the libraries listed below

• lliai / D2MoE
  D^2-MoE: Delta Decompression for MoE-based LLMs Compression
  ☆72Updated 9 months ago
• wzhuang-xmu / LoSA
  [ICLR 2025] Official implementation of paper "Dynamic Low-Rank Sparse Adaptation for Large Language Models".
  ☆23Updated 10 months ago
• SempraETY / Pruning-via-Merging
  ☆23Updated last year
• BaiTheBest / SparseLLM
  Official Repo for SparseLLM: Global Pruning of LLMs (NeurIPS 2024)
  ☆67Updated 9 months ago
• ArminAzizi98 / LaMDA
  ☆15Updated last year
• alessiodevoto / l2compress
  Code for the EMNLP24 paper "A simple and effective L2 norm based method for KV Cache compression."
  ☆18Updated last year
• abdelfattah-lab / TokenButler
  ☆27Updated last month
• BaohaoLiao / ApiQ
  [EMNLP 2024] Quantize LLM to extremely low-bit, and finetune the quantized LLMs
  ☆15Updated last year
• ROIM1998 / APT
  [ICML'24 Oral] APT: Adaptive Pruning and Tuning Pretrained Language Models for Efficient Training and Inference
  ☆46Updated last year
• hemingkx / SWIFT
  [ICLR 2025] SWIFT: On-the-Fly Self-Speculative Decoding for LLM Inference Acceleration
  ☆61Updated 11 months ago
• Dominic789654 / LongGenBench
  Source code for the paper "LongGenBench: Long-context Generation Benchmark"
  ☆24Updated last year
• SqueezeAILab / SqueezedAttention
  [ACL 2025] Squeezed Attention: Accelerating Long Prompt LLM Inference
  ☆55Updated last year
• AkideLiu / MiniCache
  ☆11Updated last year
• Lucky-Lance / SPP
  [ICML 2024] SPP: Sparsity-Preserved Parameter-Efficient Fine-Tuning for Large Language Models
  ☆21Updated last year
• dongwonjo / FastKV
  Official Implementation of FastKV: Decoupling of Context Reduction and KV Cache Compression for Prefill-Decoding Acceleration
  ☆29Updated last month
• zyxxmu / cam
  Pytorch implementation of our paper accepted by ICML 2024 -- CaM: Cache Merging for Memory-efficient LLMs Inference
  ☆48Updated last year
• DavidFanzz / SCMoE
  ☆28Updated last year
• UCSB-NLP-Chang / ThinkPrune
  ☆46Updated 3 months ago
• FFY0 / AdaKV
  The Official Implementation of Ada-KV [NeurIPS 2025]
  ☆125Updated last month
• htqin / IR-QLoRA
  [ICML 2024 Oral] This project is the official implementation of our Accurate LoRA-Finetuning Quantization of LLMs via Information Retenti…
  ☆67Updated last year
• OpenSparseLLMs / Linearization
  ☆62Updated 6 months ago
• ASISys / AdaSkip
  AdaSkip: Adaptive Sublayer Skipping for Accelerating Long-Context LLM Inference
  ☆20Updated 11 months ago
• Jikai0Wang / OPT-Tree
  ☆29Updated 7 months ago
• CASIA-LMC-Lab / FLAP
  [AAAI 2024] Fluctuation-based Adaptive Structured Pruning for Large Language Models
  ☆68Updated 2 years ago
• yifanycc / loretta
  [NAACL 24 Oral] LoRETTA: Low-Rank Economic Tensor-Train Adaptation for Ultra-Low-Parameter Fine-Tuning of Large Language Models
  ☆39Updated last year
• AIoT-MLSys-Lab / MEDA
  [NAACL 2025🔥] MEDA: Dynamic KV Cache Allocation for Efficient Multimodal Long-Context Inference
  ☆16Updated 7 months ago
• horseee / CoT-Valve
  CoT-Valve: Length-Compressible Chain-of-Thought Tuning
  ☆89Updated 11 months ago
• sail-sg / LongSpec
  LongSpec: Long-Context Lossless Speculative Decoding with Efficient Drafting and Verification
  ☆73Updated 6 months ago
• abdelfattah-lab / SplitReason
  ☆21Updated last month
• OpenSparseLLMs / LLaMA-MoE-v2
  🚀 LLaMA-MoE v2: Exploring Sparsity of LLaMA from Perspective of Mixture-of-Experts with Post-Training
  ☆91Updated last year