Alternatives and similar repositories for AdapMoE:

Users that are interested in AdapMoE are comparing it to the libraries listed below

• DerrickYLJ / TidalDecode
  [ICLR 2025] TidalDecode: A Fast and Accurate LLM Decoding with Position Persistent Sparse Attention
  ☆29Updated last week
• pku-liang / ArkVale
  ArkVale: Efficient Generative LLM Inference with Recallable Key-Value Eviction (NIPS'24)
  ☆30Updated 2 months ago
• aiha-lab / MX-QLLM
  LLM Inference with Microscaling Format
  ☆19Updated 4 months ago
• d-matrix-ai / keyformer-llm
  ☆52Updated 11 months ago
• zyxxmu / cam
  Pytorch implementation of our paper accepted by ICML 2024 -- CaM: Cache Merging for Memory-efficient LLMs Inference
  ☆33Updated 8 months ago
• cat538 / SKVQ
  SKVQ: Sliding-window Key and Value Cache Quantization for Large Language Models
  ☆16Updated 5 months ago
• mit-han-lab / spatten
  [HPCA'21] SpAtten: Efficient Sparse Attention Architecture with Cascade Token and Head Pruning
  ☆83Updated 6 months ago
• SqueezeAILab / SqueezedAttention
  SQUEEZED ATTENTION: Accelerating Long Prompt LLM Inference
  ☆44Updated 3 months ago
• snu-comparch / Tender
  Tender: Accelerating Large Language Models via Tensor Decompostion and Runtime Requantization (ISCA'24)
  ☆13Updated 8 months ago
• feifeibear / ChituAttention
  Quantized Attention on GPU
  ☆45Updated 3 months ago
• LeiWang1999 / Stream-k.tvm
  ☆19Updated 5 months ago
• ScalingIntelligence / CATS
  ☆23Updated 4 months ago
• imagination-research / EEP
  Efficient Expert Pruning for Sparse Mixture-of-Experts Language Models: Enhancing Performance and Reducing Inference Costs
  ☆15Updated 3 months ago
• thu-ml / Jetfire-INT8Training
  ☆37Updated 7 months ago
• LiuXiaoxuanPKU / OSD
  ☆44Updated 3 months ago
• thu-nics / qllm-eval
  Code Repository of Evaluating Quantized Large Language Models
  ☆116Updated 6 months ago
• opengear-project / GEAR
  GEAR: An Efficient KV Cache Compression Recipefor Near-Lossless Generative Inference of LLM
  ☆157Updated 8 months ago
• VITA-Group / Q-Hitter
  ☆12Updated 9 months ago
• luliyucoordinate / cute-flash-attention
  Implement Flash Attention using Cute.
  ☆71Updated 2 months ago
• hao-ai-lab / vllm-ltr
  [NeurIPS 2024] Efficient LLM Scheduling by Learning to Rank
  ☆41Updated 4 months ago
• pku-liang / MAGIS
  MAGIS: Memory Optimization via Coordinated Graph Transformation and Scheduling for DNN (ASPLOS'24)
  ☆49Updated 9 months ago
• AboveParadise / LLMCBench
  ☆20Updated 3 months ago
• IST-DASLab / EvoPress
  ☆19Updated last month
• zhangsichengsjtu / AFPQ
  AFPQ code implementation
  ☆20Updated last year
• Qualcomm-AI-research / gptvq
  ☆27Updated 11 months ago
• PingchengDong / GQA-LUT
  The official implementation of the DAC 2024 paper GQA-LUT
  ☆14Updated 2 months ago
• GATECH-EIC / Edge-LLM
  [DAC 2024] EDGE-LLM: Enabling Efficient Large Language Model Adaptation on Edge Devices via Layerwise Unified Compression and Adaptive La…
  ☆46Updated 8 months ago
• cornell-zhang / llm-datatypes
  Codebase for ICML'24 paper: Learning from Students: Applying t-Distributions to Explore Accurate and Efficient Formats for LLMs
  ☆25Updated 8 months ago
• hahnyuan / ASVD4LLM
  Activation-aware Singular Value Decomposition for Compressing Large Language Models
  ☆57Updated 4 months ago
• Aaronhuang-778 / SliM-LLM
  SliM-LLM: Salience-Driven Mixed-Precision Quantization for Large Language Models
  ☆27Updated 7 months ago