Alternatives and similar repositories for PhoneLM

Users that are interested in PhoneLM are comparing it to the libraries listed below

• saic-fi / MobileQuant
  [EMNLP Findings 2024] MobileQuant: Mobile-friendly Quantization for On-device Language Models
  ☆67Updated 11 months ago
• UbiquitousLearning / SLM_Survey
  ☆96Updated 11 months ago
• tiiuae / onebitllms
  Lightweight toolkit package to train and fine-tune 1.58bit Language models
  ☆85Updated 3 months ago
• hao-ai-lab / Dynasor
  Simple extension on vLLM to help you speed up reasoning model without training.
  ☆181Updated 3 months ago
• xuyuzhuang11 / OneBit
  The homepage of OneBit model quantization framework.
  ☆189Updated 6 months ago
• 18907305772 / FuseAI
  FuseAI Project
  ☆87Updated 7 months ago
• stevelaskaridis / awesome-mobile-llm
  Awesome Mobile LLMs
  ☆239Updated last month
• ServiceNow / Fast-LLM
  Accelerating your LLM training to full speed! Made with ❤️ by ServiceNow Research
  ☆223Updated this week
• hahnyuan / PB-LLM
  PB-LLM: Partially Binarized Large Language Models
  ☆153Updated last year
• OpenGVLab / EfficientQAT
  [ACL 2025 Main] EfficientQAT: Efficient Quantization-Aware Training for Large Language Models
  ☆298Updated 3 months ago
• NVlabs / MaskLLM
  [NeurIPS 24 Spotlight] MaskLLM: Learnable Semi-structured Sparsity for Large Language Models
  ☆177Updated 8 months ago
• antimatter15 / reverse-engineering-gemma-3n
  Reverse Engineering Gemma 3n: Google's New Edge-Optimized Language Model
  ☆242Updated 3 months ago
• IsaacRe / vllm-kvcompress
  KV cache compression for high-throughput LLM inference
  ☆136Updated 6 months ago
• samchaineau / llm_slerp_generation
  Repo hosting codes and materials related to speeding LLMs' inference using token merging.
  ☆36Updated last month
• astramind-ai / Mixture-of-depths
  Unofficial implementation for the paper "Mixture-of-Depths: Dynamically allocating compute in transformer-based language models"
  ☆170Updated last year
• facebookresearch / LayerSkip
  Code for "LayerSkip: Enabling Early Exit Inference and Self-Speculative Decoding", ACL 2024
  ☆331Updated 4 months ago
• imagination-research / sot
  [ICLR 2024] Skeleton-of-Thought: Prompting LLMs for Efficient Parallel Generation
  ☆175Updated last year
• powerserve-project / PowerServe
  High-speed and easy-use LLM serving framework for local deployment
  ☆117Updated 3 weeks ago
• DeepAuto-AI / hip-attention
  Training-free Post-training Efficient Sub-quadratic Complexity Attention. Implemented with OpenAI Triton.
  ☆145Updated this week
• sanyalsunny111 / LLM-Inheritune
  This is the official repository for Inheritune.
  ☆112Updated 6 months ago
• jeffreysijuntan / lloco
  The official repo for "LLoCo: Learning Long Contexts Offline"
  ☆118Updated last year
• wuhy68 / Parameter-Efficient-MoE
  Parameter-Efficient Sparsity Crafting From Dense to Mixture-of-Experts for Instruction Tuning on General Tasks (EMNLP'24)
  ☆147Updated 11 months ago
• Cornell-RelaxML / qtip
  ☆149Updated 2 months ago
• snu-mllab / KVzip
  Query-agnostic KV cache eviction: 3–4× reduction in memory and 2× decrease in latency (Qwen3/2.5, Gemma3, LLaMA3)
  ☆99Updated this week
• eqimp / hogwild_llm
  Official PyTorch implementation for Hogwild! Inference: Parallel LLM Generation with a Concurrent Attention Cache
  ☆121Updated 3 weeks ago
• NickL77 / BaldEagle
  3x Faster Inference; Unofficial implementation of EAGLE Speculative Decoding
  ☆75Updated 2 months ago
• YuchuanTian / RethinkTinyLM
  [ICML'24] The official implementation of “Rethinking Optimization and Architecture for Tiny Language Models”
  ☆123Updated 7 months ago
• IST-DASLab / QuEST
  Work in progress.
  ☆72Updated 2 months ago
• FasterDecoding / BitDelta
  ☆202Updated 8 months ago
• dust-tt / llama-ssp
  Experiments on speculative sampling with Llama models
  ☆128Updated 2 years ago