Alternatives and similar repositories for PhoneLM

Users that are interested in PhoneLM are comparing it to the libraries listed below

• xuyuzhuang11 / OneBit
  The homepage of OneBit model quantization framework.
  ☆193Updated 9 months ago
• stevelaskaridis / awesome-mobile-llm
  Awesome Mobile LLMs
  ☆267Updated 3 weeks ago
• OpenGVLab / EfficientQAT
  [ACL 2025 Main] EfficientQAT: Efficient Quantization-Aware Training for Large Language Models
  ☆309Updated 5 months ago
• UbiquitousLearning / SLM_Survey
  ☆98Updated last year
• tiiuae / onebitllms
  Lightweight toolkit package to train and fine-tune 1.58bit Language models
  ☆97Updated 5 months ago
• YuchuanTian / RethinkTinyLM
  [ICML'24] The official implementation of “Rethinking Optimization and Architecture for Tiny Language Models”
  ☆124Updated 9 months ago
• 18907305772 / FuseAI
  FuseAI Project
  ☆87Updated 9 months ago
• powerserve-project / PowerServe
  High-speed and easy-use LLM serving framework for local deployment
  ☆130Updated 3 months ago
• antimatter15 / reverse-engineering-gemma-3n
  Reverse Engineering Gemma 3n: Google's New Edge-Optimized Language Model
  ☆250Updated 5 months ago
• ServiceNow / Fast-LLM
  Accelerating your LLM training to full speed! Made with ❤️ by ServiceNow Research
  ☆258Updated this week
• microsoft / LongRoPE
  LongRoPE is a novel method that can extends the context window of pre-trained LLMs to an impressive 2048k tokens.
  ☆264Updated last week
• IsaacRe / vllm-kvcompress
  KV cache compression for high-throughput LLM inference
  ☆144Updated 9 months ago
• saic-fi / MobileQuant
  [EMNLP Findings 2024] MobileQuant: Mobile-friendly Quantization for On-device Language Models
  ☆68Updated last year
• NVlabs / Minitron
  A family of compressed models obtained via pruning and knowledge distillation
  ☆355Updated 11 months ago
• FasterDecoding / BitDelta
  ☆202Updated 11 months ago
• wejoncy / QLLM
  A general 2-8 bits quantization toolbox with GPTQ/AWQ/HQQ/VPTQ, and export to onnx/onnx-runtime easily.
  ☆180Updated 7 months ago
• astramind-ai / Mixture-of-depths
  Unofficial implementation for the paper "Mixture-of-Depths: Dynamically allocating compute in transformer-based language models"
  ☆175Updated last year
• hao-ai-lab / Dynasor
  [NeurIPS 2025] Simple extension on vLLM to help you speed up reasoning model without training.
  ☆201Updated 5 months ago
• NVlabs / MaskLLM
  [NeurIPS 24 Spotlight] MaskLLM: Learnable Semi-structured Sparsity for Large Language Models
  ☆179Updated 10 months ago
• metame-ai / awesome-llm-plaza
  awesome llm plaza: daily tracking all sorts of awesome topics of llm, e.g. llm for coding, robotics, reasoning, multimod etc.
  ☆209Updated last week
• DeepAuto-AI / hip-attention
  Training-free Post-training Efficient Sub-quadratic Complexity Attention. Implemented with OpenAI Triton.
  ☆148Updated last week
• Cornell-RelaxML / qtip
  ☆152Updated 4 months ago
• JackZeng0208 / llama.cpp-android-tutorial
  llama.cpp tutorial on Android phone
  ☆134Updated 6 months ago
• GAIR-NLP / PC-Agent-E
  Efficient Agent Training for Computer Use
  ☆132Updated 2 months ago
• hetailang / SqueezeAttention
  ☆38Updated last year
• dust-tt / llama-ssp
  Experiments on speculative sampling with Llama models
  ☆126Updated 2 years ago
• LLM360 / amber-data-prep
  Data preparation code for Amber 7B LLM
  ☆93Updated last year
• SalesforceAIResearch / Elastic-Reasoning
  Make reasoning models scalable
  ☆47Updated 5 months ago
• GreenBitAI / low_bit_llama
  Advanced Ultra-Low Bitrate Compression Techniques for the LLaMA Family of LLMs
  ☆110Updated last year
• snu-mllab / KVzip
  [NeurIPS'25 Oral] Query-agnostic KV cache eviction: 3–4× reduction in memory and 2× decrease in latency (Qwen3/2.5, Gemma3, LLaMA3)
  ☆128Updated last week