Alternatives and similar repositories for PhoneLM

Users that are interested in PhoneLM are comparing it to the libraries listed below

• saic-fi / MobileQuant
  [EMNLP Findings 2024] MobileQuant: Mobile-friendly Quantization for On-device Language Models
  ☆68Updated last year
• powerserve-project / PowerServe
  High-speed and easy-use LLM serving framework for local deployment
  ☆145Updated 6 months ago
• stevelaskaridis / awesome-mobile-llm
  Awesome Mobile LLMs
  ☆301Updated 2 months ago
• UbiquitousLearning / SLM_Survey
  ☆102Updated last year
• xuyuzhuang11 / OneBit
  The homepage of OneBit model quantization framework.
  ☆200Updated last year
• tiiuae / onebitllms
  Lightweight toolkit package to train and fine-tune 1.58bit Language models
  ☆110Updated 8 months ago
• microsoft / LongRoPE
  LongRoPE is a novel method that can extends the context window of pre-trained LLMs to an impressive 2048k tokens.
  ☆277Updated 3 months ago
• 18907305772 / FuseAI
  FuseAI Project
  ☆87Updated last year
• hao-ai-lab / Dynasor
  [NeurIPS 2025] Simple extension on vLLM to help you speed up reasoning model without training.
  ☆218Updated 8 months ago
• antimatter15 / reverse-engineering-gemma-3n
  Reverse Engineering Gemma 3n: Google's New Edge-Optimized Language Model
  ☆262Updated 8 months ago
• NickL77 / BaldEagle
  3x Faster Inference; Unofficial implementation of EAGLE Speculative Decoding
  ☆83Updated 7 months ago
• OpenBMB / CPM.cu
  CPM.cu is a lightweight, high-performance CUDA implementation for LLMs, optimized for end-device inference and featuring cutting-edge tec…
  ☆225Updated 3 weeks ago
• hahnyuan / PB-LLM
  PB-LLM: Partially Binarized Large Language Models
  ☆157Updated 2 years ago
• YuchuanTian / RethinkTinyLM
  [ICML'24] The official implementation of “Rethinking Optimization and Architecture for Tiny Language Models”
  ☆126Updated last year
• gabrielolympie / moe-pruner
  A repository aimed at pruning DeepSeek V3, R1 and R1-zero to a usable size
  ☆82Updated 5 months ago
• Tencent / AngelSlim
  Model compression toolkit engineered for enhanced usability, comprehensiveness, and efficiency.
  ☆314Updated this week
• NVlabs / MaskLLM
  [NeurIPS 24 Spotlight] MaskLLM: Learnable Semi-structured Sparsity for Large Language Models
  ☆185Updated last year
• wdlctc / headinfer
  ☆64Updated 8 months ago
• IsaacRe / vllm-kvcompress
  KV cache compression for high-throughput LLM inference
  ☆151Updated last year
• GAIR-NLP / PC-Agent-E
  [ICLR 2026] Efficient Agent Training for Computer Use
  ☆135Updated 5 months ago
• inclusionAI / Ling-V2
  Ling-V2 is a MoE LLM provided and open-sourced by InclusionAI.
  ☆253Updated 4 months ago
• mistralai / mistral-evals
  ☆82Updated 2 months ago
• FasterDecoding / BitDelta
  ☆203Updated last year
• thu-nics / MoA
  [CoLM'25] The official implementation of the paper <MoA: Mixture of Sparse Attention for Automatic Large Language Model Compression>
  ☆155Updated 3 weeks ago
• wejoncy / QLLM
  A general 2-8 bits quantization toolbox with GPTQ/AWQ/HQQ/VPTQ, and export to onnx/onnx-runtime easily.
  ☆184Updated 10 months ago
• pprp / Pruner-Zero
  [ICML24] Pruner-Zero: Evolving Symbolic Pruning Metric from scratch for LLMs
  ☆98Updated last year
• imagination-research / sot
  [ICLR 2024] Skeleton-of-Thought: Prompting LLMs for Efficient Parallel Generation
  ☆184Updated last year
• inferflow / inferflow
  Inferflow is an efficient and highly configurable inference engine for large language models (LLMs).
  ☆251Updated last year
• PhoneLLM / Awesome-LLM-Powered-Phone-GUI-Agents
  [TMLR] LLM-Powered GUI Agents in Phone Automation: Surveying Progress and Prospects
  ☆148Updated 2 months ago
• z-lab / dflash
  Block Diffusion for Ultra-Fast Speculative Decoding
  ☆459Updated this week