Alternatives and similar repositories for PhoneLM

Users that are interested in PhoneLM are comparing it to the libraries listed below

• UbiquitousLearning / SLM_Survey
  ☆95Updated 8 months ago
• LlamaTouch / LlamaTouch
  LlamaTouch: A Faithful and Scalable Testbed for Mobile UI Task Automation
  ☆60Updated 9 months ago
• Infini-AI-Lab / MagicDec
  [ICLR2025] Breaking Throughput-Latency Trade-off for Long Sequences with Speculative Decoding
  ☆116Updated 6 months ago
• saic-fi / MobileQuant
  [EMNLP Findings 2024] MobileQuant: Mobile-friendly Quantization for On-device Language Models
  ☆63Updated 8 months ago
• tiiuae / onebitllms
  Lightweight toolkit package to train and fine-tune 1.58bit Language models
  ☆69Updated 2 weeks ago
• powerserve-project / PowerServe
  High-speed and easy-use LLM serving framework for local deployment
  ☆109Updated 2 months ago
• IsaacRe / vllm-kvcompress
  KV cache compression for high-throughput LLM inference
  ☆129Updated 4 months ago
• YuchuanTian / RethinkTinyLM
  [ICML'24] The official implementation of “Rethinking Optimization and Architecture for Tiny Language Models”
  ☆121Updated 4 months ago
• hao-ai-lab / Dynasor
  Simple extension on vLLM to help you speed up reasoning model without training.
  ☆158Updated this week
• THUDM / Android-Lab
  ☆214Updated 3 weeks ago
• stevelaskaridis / awesome-mobile-llm
  Awesome Mobile LLMs
  ☆199Updated this week
• NolanoOrg / SpectraSuite
  ☆48Updated 10 months ago
• zenrran4nlp / Awesome-LLM-Inference-Serving
  ☆33Updated last month
• 18907305772 / FuseAI
  FuseAI Project
  ☆87Updated 4 months ago
• Cerebras / DocChat
  GPT-4 Level Conversational QA Trained In a Few Hours
  ☆61Updated 9 months ago
• hetailang / SqueezeAttention
  ☆37Updated 7 months ago
• LLM360 / crystalcoder-data-prep
  Data preparation code for CrystalCoder 7B LLM
  ☆44Updated last year
• thunlp / Ouroboros
  Ouroboros: Speculative Decoding with Large Model Enhanced Drafting (EMNLP 2024 main)
  ☆106Updated 2 months ago
• NVlabs / MaskLLM
  [NeurIPS 24 Spotlight] MaskLLM: Learnable Semi-structured Sparsity for Large Language Models
  ☆166Updated 5 months ago
• imagination-research / sot
  [ICLR 2024] Skeleton-of-Thought: Prompting LLMs for Efficient Parallel Generation
  ☆170Updated last year
• pan-x-c / EE-LLM
  EE-LLM is a framework for large-scale training and inference of early-exit (EE) large language models (LLMs).
  ☆63Updated 11 months ago
• OpenGVLab / EfficientQAT
  [ACL 2025 Main] EfficientQAT: Efficient Quantization-Aware Training for Large Language Models
  ☆272Updated 2 weeks ago
• MobileLLM / ChainStream
  A Stream-based LLM Agent Framework for Continuous Context Sensing and Sharing
  ☆38Updated 6 months ago
• JackZeng0208 / llama.cpp-android-tutorial
  llama.cpp tutorial on Android phone
  ☆102Updated last month
• The-Inscrutable-X / TACQ
  Official Repository for Task-Circuit Quantization
  ☆20Updated this week
• mistralai / mistral-evals
  ☆72Updated last month
• CogNLP / CogAGENT
  ☆36Updated 2 years ago
• FasterDecoding / BitDelta
  ☆197Updated 6 months ago
• jeffreysijuntan / lloco
  The official repo for "LLoCo: Learning Long Contexts Offline"
  ☆116Updated 11 months ago
• thepowerfuldeez / OLMo
  My fork os allen AI's OLMo for educational purposes.
  ☆30Updated 6 months ago