Alternatives and similar repositories for MobileBench

Users that are interested in MobileBench are comparing it to the libraries listed below

• lliai / D2MoE
  D^2-MoE: Delta Decompression for MoE-based LLMs Compression
  ☆65Updated 5 months ago
• sii-research / siiRL
  siiRL: Shanghai Innovation Institute RL Framework for Advanced LLMs and Multi-Agent Systems
  ☆179Updated this week
• UNITES-Lab / HEXA-MoE
  Official code for the paper "HEXA-MoE: Efficient and Heterogeneous-Aware MoE Acceleration with Zero Computation Redundancy"
  ☆13Updated 5 months ago
• JarvisPei / CMoE
  Implementation for the paper: CMoE: Fast Carving of Mixture-of-Experts for Efficient LLM Inference
  ☆24Updated 5 months ago
• Gaffey / ExCP
  Official implementation of ICML 2024 paper "ExCP: Extreme LLM Checkpoint Compression via Weight-Momentum Joint Shrinking".
  ☆48Updated last year
• insuhan / calibquant
  ☆18Updated 5 months ago
• pprp / Pruner-Zero
  [ICML24] Pruner-Zero: Evolving Symbolic Pruning Metric from scratch for LLMs
  ☆92Updated 9 months ago
• Tencent / AngelSlim
  Model compression toolkit engineered for enhanced usability, comprehensiveness, and efficiency.
  ☆100Updated this week
• LiqunMa / FBI-LLM
  FBI-LLM: Scaling Up Fully Binarized LLMs from Scratch via Autoregressive Distillation
  ☆51Updated last week
• YuchuanTian / RethinkTinyLM
  [ICML'24] The official implementation of “Rethinking Optimization and Architecture for Tiny Language Models”
  ☆123Updated 7 months ago
• thu-nics / MoA
  [CoLM'25] The official implementation of the paper <MoA: Mixture of Sparse Attention for Automatic Large Language Model Compression>
  ☆145Updated last month
• krafton-ai / lexico
  KV cache compression via sparse coding
  ☆12Updated 3 months ago
• ruikangliu / IntactKV
  [ACL 2024] Official PyTorch implementation of "IntactKV: Improving Large Language Model Quantization by Keeping Pivot Tokens Intact"
  ☆47Updated last year
• Tencent / llm.hunyuan.T1
  ☆80Updated 5 months ago
• htqin / IR-QLoRA
  [ICML 2024 Oral] This project is the official implementation of our Accurate LoRA-Finetuning Quantization of LLMs via Information Retenti…
  ☆67Updated last year
• pprp / Awesome-Efficient-MoE
  Efficient Mixture of Experts for LLM Paper List
  ☆118Updated this week
• ModelTC / QLLM
  [ICLR 2024] This is the official PyTorch implementation of "QLLM: Accurate and Efficient Low-Bitwidth Quantization for Large Language Mod…
  ☆39Updated last year
• ZunhaiSu / Super-Experts-Profilling
  Unveiling Super Experts in Mixture-of-Experts Large Language Models
  ☆22Updated last month
• plm-team / PLM
  PLM: Efficient Peripheral Language Models Hardware-Co-Designed for Ubiquitous Computing
  ☆19Updated 5 months ago
• rayleizhu / vllm-ra
  [ACL 2024] RelayAttention for Efficient Large Language Model Serving with Long System Prompts
  ☆40Updated last year
• huangyuxiang03 / Locret
  ☆13Updated 11 months ago
• thu-nics / MBQ
  The code repository of "MBQ: Modality-Balanced Quantization for Large Vision-Language Models"
  ☆55Updated 5 months ago
• liangyuwang / zo2
  ZO2 (Zeroth-Order Offloading): Full Parameter Fine-Tuning 175B LLMs with 18GB GPU Memory
  ☆180Updated last month
• Linking-ai / SCOPE
  (ACL 2025 oral) SCOPE: Optimizing KV Cache Compression in Long-context Generation
  ☆32Updated 3 months ago
• abdelfattah-lab / SplitReason
  ☆18Updated 2 months ago
• MoonshotAI / Kimi-Researcher
  ☆69Updated 2 months ago
• ruikangliu / Quantized-Reasoning-Models
  [COLM 2025] Official PyTorch implementation of "Quantization Hurts Reasoning? An Empirical Study on Quantized Reasoning Models"
  ☆47Updated last month
• JT-Ushio / MHA2MLA
  Towards Economical Inference: Enabling DeepSeek's Multi-Head Latent Attention in Any Transformer-based LLMs
  ☆189Updated 2 months ago
• JieShibo / MoLE
  [ICML 2025 Oral] Mixture of Lookup Experts
  ☆51Updated 3 months ago
• attention-survey / Efficient_Attention_Survey
  A Survey of Efficient Attention Methods: Hardware-efficient, Sparse, Compact, and Linear Attention
  ☆172Updated last week