Alternatives and similar repositories for PhoneLM

Users that are interested in PhoneLM are comparing it to the libraries listed below

• UbiquitousLearning / SLM_Survey
  ☆102Updated last year
• saic-fi / MobileQuant
  [EMNLP Findings 2024] MobileQuant: Mobile-friendly Quantization for On-device Language Models
  ☆68Updated last year
• ServiceNow / Fast-LLM
  Accelerating your LLM training to full speed! Made with ❤️ by ServiceNow Research
  ☆276Updated this week
• stevelaskaridis / awesome-mobile-llm
  Awesome Mobile LLMs
  ☆290Updated last month
• xuyuzhuang11 / OneBit
  The homepage of OneBit model quantization framework.
  ☆197Updated 11 months ago
• microsoft / LongRoPE
  LongRoPE is a novel method that can extends the context window of pre-trained LLMs to an impressive 2048k tokens.
  ☆276Updated 2 months ago
• tiiuae / onebitllms
  Lightweight toolkit package to train and fine-tune 1.58bit Language models
  ☆104Updated 7 months ago
• 18907305772 / FuseAI
  FuseAI Project
  ☆88Updated 11 months ago
• YuchuanTian / RethinkTinyLM
  [ICML'24] The official implementation of “Rethinking Optimization and Architecture for Tiny Language Models”
  ☆126Updated 11 months ago
• hao-ai-lab / Dynasor
  [NeurIPS 2025] Simple extension on vLLM to help you speed up reasoning model without training.
  ☆216Updated 7 months ago
• imagination-research / sot
  [ICLR 2024] Skeleton-of-Thought: Prompting LLMs for Efficient Parallel Generation
  ☆183Updated last year
• JackZeng0208 / llama.cpp-android-tutorial
  llama.cpp tutorial on Android phone
  ☆140Updated 8 months ago
• InternLM / SWE-Fixer
  ☆130Updated 8 months ago
• wdlctc / headinfer
  ☆63Updated 7 months ago
• woct0rdho / transformers-qwen3-moe-fused
  Fused Qwen3 MoE layer for faster training, compatible with HF Transformers, LoRA, 4-bit quant, Unsloth
  ☆223Updated this week
• powerserve-project / PowerServe
  High-speed and easy-use LLM serving framework for local deployment
  ☆141Updated 5 months ago
• mistralai / mistral-evals
  ☆82Updated last month
• NVlabs / MaskLLM
  [NeurIPS 24 Spotlight] MaskLLM: Learnable Semi-structured Sparsity for Large Language Models
  ☆183Updated last year
• nahidalam / maya
  Maya: An Instruction Finetuned Multilingual Multimodal Model using Aya
  ☆123Updated 5 months ago
• zenrran4nlp / Awesome-LLM-Inference-Serving
  ☆47Updated 8 months ago
• THUDM / Android-Lab
  ☆281Updated 4 months ago
• thunlp / APB
  Official Implementation of APB (ACL 2025 main Oral)
  ☆32Updated 10 months ago
• z-lab / dflash
  Block Diffusion for Ultra-Fast Speculative Decoding
  ☆188Updated this week
• IsaacRe / vllm-kvcompress
  KV cache compression for high-throughput LLM inference
  ☆148Updated 11 months ago
• astramind-ai / Mixture-of-depths
  Unofficial implementation for the paper "Mixture-of-Depths: Dynamically allocating compute in transformer-based language models"
  ☆176Updated last year
• Macaronlin / LLaMA3-Quantization
  A repository dedicated to evaluating the performance of quantizied LLaMA3 using various quantization methods..
  ☆198Updated 11 months ago
• PhoneLLM / Awesome-LLM-Powered-Phone-GUI-Agents
  [TMLR] LLM-Powered GUI Agents in Phone Automation: Surveying Progress and Prospects
  ☆142Updated last month
• hahnyuan / PB-LLM
  PB-LLM: Partially Binarized Large Language Models
  ☆157Updated 2 years ago
• hetailang / SqueezeAttention
  ☆38Updated last year
• ltzheng / agent-studio
  [ICLR 2025] A trinity of environments, tools, and benchmarks for general virtual agents
  ☆220Updated 6 months ago