Alternatives and similar repositories for PhoneLM

Users that are interested in PhoneLM are comparing it to the libraries listed below

• 18907305772 / FuseAI
  FuseAI Project
  ☆87Updated 5 months ago
• UbiquitousLearning / SLM_Survey
  ☆95Updated 8 months ago
• hao-ai-lab / Dynasor
  Simple extension on vLLM to help you speed up reasoning model without training.
  ☆161Updated 3 weeks ago
• LlamaTouch / LlamaTouch
  LlamaTouch: A Faithful and Scalable Testbed for Mobile UI Task Automation
  ☆62Updated 10 months ago
• bespokelabsai / verifiers
  Verifiers for LLM Reinforcement Learning
  ☆60Updated 2 months ago
• NVlabs / MaskLLM
  [NeurIPS 24 Spotlight] MaskLLM: Learnable Semi-structured Sparsity for Large Language Models
  ☆168Updated 5 months ago
• tiiuae / onebitllms
  Lightweight toolkit package to train and fine-tune 1.58bit Language models
  ☆80Updated last month
• antimatter15 / reverse-engineering-gemma-3n
  Reverse Engineering Gemma 3n: Google's New Edge-Optimized Language Model
  ☆138Updated 3 weeks ago
• IsaacRe / vllm-kvcompress
  KV cache compression for high-throughput LLM inference
  ☆131Updated 4 months ago
• The-Inscrutable-X / TACQ
  Official Repository for Task-Circuit Quantization
  ☆20Updated 3 weeks ago
• zenrran4nlp / Awesome-LLM-Inference-Serving
  ☆34Updated last month
• LLM360 / crystalcoder-data-prep
  Data preparation code for CrystalCoder 7B LLM
  ☆45Updated last year
• CogNLP / CogAGENT
  ☆36Updated 2 years ago
• hetailang / SqueezeAttention
  ☆37Updated 8 months ago
• Infini-AI-Lab / MagicDec
  [ICLR2025] Breaking Throughput-Latency Trade-off for Long Sequences with Speculative Decoding
  ☆116Updated 6 months ago
• saic-fi / MobileQuant
  [EMNLP Findings 2024] MobileQuant: Mobile-friendly Quantization for On-device Language Models
  ☆63Updated 9 months ago
• GAIR-NLP / PC-Agent-E
  Efficient Agent Training for Computer Use
  ☆106Updated 3 weeks ago
• Cerebras / DocChat
  GPT-4 Level Conversational QA Trained In a Few Hours
  ☆62Updated 10 months ago
• InternLM / SWE-Fixer
  ☆97Updated last month
• YuchuanTian / RethinkTinyLM
  [ICML'24] The official implementation of “Rethinking Optimization and Architecture for Tiny Language Models”
  ☆121Updated 5 months ago
• facebookresearch / RAM
  A framework to study AI models in Reasoning, Alignment, and use of Memory (RAM).
  ☆256Updated last week
• astramind-ai / Mixture-of-depths
  Unofficial implementation for the paper "Mixture-of-Depths: Dynamically allocating compute in transformer-based language models"
  ☆163Updated last year
• OpenBMB / CPM.cu
  CPM.cu is a lightweight, high-performance CUDA implementation for LLMs, optimized for end-device inference and featuring cutting-edge tec…
  ☆151Updated this week
• JackZeng0208 / llama.cpp-android-tutorial
  llama.cpp tutorial on Android phone
  ☆110Updated last month
• YuxiangChai / A3
  ☆26Updated 4 months ago
• samchaineau / llm_slerp_generation
  Repo hosting codes and materials related to speeding LLMs' inference using token merging.
  ☆36Updated last year
• Ag2S1 / Sibyl-System
  ☆121Updated 10 months ago
• Infini-AI-Lab / APE
  ☆28Updated 4 months ago
• wuhy68 / Parameter-Efficient-MoE
  Parameter-Efficient Sparsity Crafting From Dense to Mixture-of-Experts for Instruction Tuning on General Tasks
  ☆144Updated 9 months ago
• zjunlp / DynamicKnowledgeCircuits
  How Do LLMs Acquire New Knowledge? A Knowledge Circuits Perspective on Continual Pre-Training
  ☆36Updated 2 months ago