Alternatives and similar repositories for awesome-mobile-llm

Users that are interested in awesome-mobile-llm are comparing it to the libraries listed below

• powerserve-project / PowerServe
  High-speed and easy-use LLM serving framework for local deployment
  ☆130Updated 3 months ago
• UbiquitousLearning / mllm
  Fast Multimodal LLM on Mobile Devices
  ☆1,156Updated this week
• UbiquitousLearning / PhoneLM
  ☆63Updated 11 months ago
• saic-fi / MobileQuant
  [EMNLP Findings 2024] MobileQuant: Mobile-friendly Quantization for On-device Language Models
  ☆68Updated last year
• mit-han-lab / TinyChatEngine
  TinyChatEngine: On-Device LLM Inference Library
  ☆909Updated last year
• exo-explore / mlx-bitnet
  1.58 Bit LLM on Apple Silicon using MLX
  ☆225Updated last year
• intel / neural-speed
  An innovative library for efficient LLM inference via low-bit quantization
  ☆349Updated last year
• intel / auto-round
  Advanced Quantization Algorithm for LLMs and VLMs, with support for CPU, Intel GPU, CUDA and HPU.
  ☆690Updated this week
• facebookresearch / LayerSkip
  Code for "LayerSkip: Enabling Early Exit Inference and Self-Speculative Decoding", ACL 2024
  ☆344Updated 6 months ago
• microsoft / VPTQ
  VPTQ, A Flexible and Extreme low-bit quantization algorithm
  ☆661Updated 6 months ago
• microsoft / T-MAC
  Low-bit LLM inference on CPU/NPU with lookup table
  ☆884Updated 5 months ago
• ARM-software / kleidiai
  This repository is a read-only mirror of https://gitlab.arm.com/kleidi/kleidiai
  ☆93Updated this week
• lx200916 / ChatBotApp
  ☆41Updated 7 months ago
• pprp / Awesome-LLM-Quantization
  Awesome list for LLM quantization
  ☆334Updated 3 weeks ago
• NVlabs / Minitron
  A family of compressed models obtained via pruning and knowledge distillation
  ☆355Updated 11 months ago
• antimatter15 / reverse-engineering-gemma-3n
  Reverse Engineering Gemma 3n: Google's New Edge-Optimized Language Model
  ☆250Updated 5 months ago
• google-ai-edge / LiteRT-LM
  ☆456Updated this week
• apple / ml-recurrent-drafter
  ☆218Updated 9 months ago
• NVIDIA / Star-Attention
  Efficient LLM Inference over Long Sequences
  ☆390Updated 4 months ago
• IsaacRe / vllm-kvcompress
  KV cache compression for high-throughput LLM inference
  ☆144Updated 9 months ago
• mbzuai-oryx / MobiLlama
  [ICLR-2025-SLLM Spotlight 🔥]MobiLlama : Small Language Model tailored for edge devices
  ☆664Updated 5 months ago
• OpenGVLab / EfficientQAT
  [ACL 2025 Main] EfficientQAT: Efficient Quantization-Aware Training for Large Language Models
  ☆309Updated 5 months ago
• mani-kantap / llm-inference-solutions
  A collection of all available inference solutions for the LLMs
  ☆91Updated 8 months ago
• UbiquitousLearning / SLM_Survey
  ☆98Updated last year
• ModelCloud / GPTQModel
  LLM model quantization (compression) toolkit with hw acceleration support for Nvidia CUDA, AMD ROCm, Intel XPU and Intel/AMD/Apple CPU vi…
  ☆860Updated this week
• ServiceNow / Fast-LLM
  Accelerating your LLM training to full speed! Made with ❤️ by ServiceNow Research
  ☆258Updated this week
• jeho-lee / Awesome-On-Device-AI-Systems
  ☆90Updated 3 weeks ago
• Picovoice / picollm
  On-device LLM Inference Powered by X-Bit Quantization
  ☆272Updated 3 months ago
• huggingface / optimum-executorch
  🤗 Optimum ExecuTorch
  ☆77Updated last week
• Infini-AI-Lab / UMbreLLa
  LLM Inference on consumer devices
  ☆125Updated 7 months ago