Alternatives and similar repositories for LiteRT-LM

Users that are interested in LiteRT-LM are comparing it to the libraries listed below

• Lizonghang / TPI-LLM
  TPI-LLM: Serving 70b-scale LLMs Efficiently on Low-resource Edge Devices
  ☆186Updated 2 months ago
• Goekdeniz-Guelmez / mlx-lm-lora
  Train Large Language Models on MLX.
  ☆138Updated this week
• mzbac / mlx_sharding
  Distributed Inference for mlx LLm
  ☆94Updated last year
• MetaStone-AI / XBai-o4
  ☆207Updated this week
• huggingface / huggingface-gemma-recipes
  Inference, Fine Tuning and many more recipes with Gemma family of models
  ☆262Updated 2 weeks ago
• exo-explore / mlx-bitnet
  1.58 Bit LLM on Apple Silicon using MLX
  ☆217Updated last year
• freddyaboulton / orpheus-cpp
  Fast Streaming TTS with Orpheus + WebRTC (with FastRTC)
  ☆302Updated 3 months ago
• arcee-ai / fastmlx
  FastMLX is a high performance production ready API to host MLX models.
  ☆319Updated 4 months ago
• JosefAlbers / Phi-3-Vision-MLX
  Phi-3.5 for Mac: Locally-run Vision and Language Models for Apple Silicon
  ☆270Updated 10 months ago
• NimbleEdge / sparse_transformers
  Sparse Inferencing for transformer based LLMs
  ☆196Updated this week
• willccbb / mlx_parallm
  Fast parallel LLM inference for MLX
  ☆204Updated last year
• lemonade-sdk / lemonade
  Lemonade helps users run local LLMs with the highest performance by configuring state-of-the-art inference engines for their NPUs and GPU…
  ☆350Updated this week
• adriancable / qwen3.c
  Local Qwen3 LLM inference. One easy-to-understand file of C source with no dependencies.
  ☆97Updated last month
• menloresearch / ReZero
  ☆155Updated 3 months ago
• AlexBodner / How_Much_VRAM
  ☆102Updated 11 months ago
• universal-tool-calling-protocol / python-utcp
  Official python implementation of the UTCP
  ☆364Updated this week
• nath1295 / MLX-Textgen
  A python package for serving LLM on OpenAI-compatible API endpoints with prompt caching using MLX.
  ☆90Updated last month
• huggingface / HuggingSnap
  SmolVLM2 Demo
  ☆170Updated 4 months ago
• SakanaAI / treequest
  A Tree Search Library with Flexible API for LLM Inference-Time Scaling
  ☆423Updated this week
• QuixiAI / dolphin-logger
  ☆102Updated last month
• huggingface / local-gemma
  Gemma 2 optimized for your local machine.
  ☆376Updated 11 months ago
• menloresearch / verifiers-deepresearch
  Verifiers for LLM Reinforcement Learning
  ☆69Updated this week
• kyutai-labs / moshivis
  Kyutai with an "eye"
  ☆212Updated 4 months ago
• JosefAlbers / whisper-turbo-mlx
  Blazing fast whisper turbo for ASR (speech-to-text) tasks
  ☆213Updated 9 months ago
• ivanfioravanti / wine_variety_classification
  Examples on how to use various LLM providers with a Wine Classification problem
  ☆97Updated last month
• iluxu / llmbasedos
  Minimal Linux OS with a Model Context Protocol (MCP) gateway to expose local capabilities to LLMs.
  ☆259Updated last month
• codelion / adaptive-classifier
  A flexible, adaptive classification system for dynamic text classification
  ☆351Updated last week
• RamboRogers / mlx-gui
  MLX-GUI MLX Inference Server
  ☆107Updated last week
• kwindla / macos-local-voice-agents
  Pipecat voice AI agents running locally on macOS
  ☆88Updated last week
• N8python / mlx-pretrain
  A simple MLX implementation for pretraining LLMs on Apple Silicon.
  ☆83Updated 3 months ago