Alternatives and similar repositories for PhoneLM:

Users that are interested in PhoneLM are comparing it to the libraries listed below

• UbiquitousLearning / SLM_Survey
  ☆90Updated 6 months ago
• hao-ai-lab / Dynasor
  Simple extension on vLLM to help you speed up reasoning model without training.
  ☆146Updated this week
• InternLM / SWE-Fixer
  ☆85Updated 2 months ago
• saic-fi / MobileQuant
  [EMNLP Findings 2024] MobileQuant: Mobile-friendly Quantization for On-device Language Models
  ☆56Updated 7 months ago
• LLM360 / crystalcoder-data-prep
  Data preparation code for CrystalCoder 7B LLM
  ☆44Updated 11 months ago
• 18907305772 / FuseAI
  FuseAI Project
  ☆85Updated 3 months ago
• Infini-AI-Lab / MagicDec
  [ICLR2025] Breaking Throughput-Latency Trade-off for Long Sequences with Speculative Decoding
  ☆115Updated 4 months ago
• GreenBitAI / green-bit-llm
  A toolkit for fine-tuning, inferencing, and evaluating GreenBitAI's LLMs.
  ☆82Updated last month
• IsaacRe / vllm-kvcompress
  KV cache compression for high-throughput LLM inference
  ☆126Updated 2 months ago
• THUDM / Android-Lab
  ☆214Updated this week
• YuchuanTian / RethinkTinyLM
  [ICML'24] The official implementation of “Rethinking Optimization and Architecture for Tiny Language Models”
  ☆121Updated 3 months ago
• NVlabs / MaskLLM
  [NeurIPS 24 Spotlight] MaskLLM: Learnable Semi-structured Sparsity for Large Language Models
  ☆162Updated 3 months ago
• OpenGVLab / EfficientQAT
  EfficientQAT: Efficient Quantization-Aware Training for Large Language Models
  ☆263Updated 6 months ago
• thu-nics / MoA
  The official implementation of the paper <MoA: Mixture of Sparse Attention for Automatic Large Language Model Compression>
  ☆123Updated 4 months ago
• efeslab / fiddler
  [ICLR'25] Fast Inference of MoE Models with CPU-GPU Orchestration
  ☆208Updated 5 months ago
• AlexCuadron / ThinkingAgent
  Systematic evaluation framework that automatically rates overthinking behavior in large language models.
  ☆86Updated 2 weeks ago
• NolanoOrg / SpectraSuite
  ☆46Updated 9 months ago
• BaohaoLiao / RSD
  Reward-guided Speculative Decoding (RSD) for efficiency and effectiveness.
  ☆25Updated last month
• xuyuzhuang11 / OneBit
  The homepage of OneBit model quantization framework.
  ☆175Updated 2 months ago
• LeanModels / DFloat11
  ☆56Updated last week
• hahnyuan / PB-LLM
  PB-LLM: Partially Binarized Large Language Models
  ☆151Updated last year
• LLM360 / amber-data-prep
  Data preparation code for Amber 7B LLM
  ☆88Updated 11 months ago
• swj0419 / detect-pretrain-code-contamination
  ☆75Updated last year
• tyler-griggs / melange-release
  ☆45Updated 9 months ago
• stevelaskaridis / awesome-mobile-llm
  Awesome Mobile LLMs
  ☆169Updated last month
• jeffreysijuntan / lloco
  The official repo for "LLoCo: Learning Long Contexts Offline"
  ☆116Updated 10 months ago
• astramind-ai / Mixture-of-depths
  Unofficial implementation for the paper "Mixture-of-Depths: Dynamically allocating compute in transformer-based language models"
  ☆158Updated 10 months ago
• dust-tt / llama-ssp
  Experiments on speculative sampling with Llama models
  ☆125Updated last year
• JT-Ushio / MHA2MLA
  Towards Economical Inference: Enabling DeepSeek's Multi-Head Latent Attention in Any Transformer-based LLMs
  ☆161Updated this week
• hetailang / SqueezeAttention
  ☆37Updated 6 months ago