Alternatives and similar repositories for LiteRT-LM

Users that are interested in LiteRT-LM are comparing it to the libraries listed below

• huawei-csl / SINQ
  Welcome to the official repository of SINQ! A novel, fast and high-quality quantization method designed to make any Large Language Model …
  ☆570Updated 2 weeks ago
• NVlabs / Jet-Nemotron
  ☆702Updated last month
• google-ai-edge / LiteRT
  LiteRT, successor to TensorFlow Lite. is Google's On-device framework for high-performance ML & GenAI deployment on edge platforms, via e…
  ☆943Updated this week
• NimbleEdge / sparse_transformers
  Sparse Inferencing for transformer based LLMs
  ☆201Updated 3 months ago
• Chen-zexi / vllm-cli
  A command-line interface tool for serving LLM using vLLM.
  ☆441Updated 3 weeks ago
• leoheuler / flashtensors
  ☆315Updated this week
• WeiboAI / VibeThinker
  Tiny Model, Big Logic: Diversity-Driven Optimization Elicits Large-Model Reasoning Ability in VibeThinker-1.5B
  ☆155Updated last week
• Goekdeniz-Guelmez / mlx-lm-lora
  Train Large Language Models on MLX.
  ☆213Updated last week
• MetaStone-AI / XBai-o4
  ☆300Updated 3 months ago
• huggingface / huggingface-gemma-recipes
  Inference, Fine Tuning and many more recipes with Gemma family of models
  ☆275Updated 4 months ago
• google-ai-edge / ai-edge-apis
  ☆158Updated last week
• freddyaboulton / orpheus-cpp
  Fast Streaming TTS with Orpheus + WebRTC (with FastRTC)
  ☆343Updated 7 months ago
• GradientHQ / parallax
  Parallax is a distributed model serving framework that lets you build your own AI cluster anywhere
  ☆681Updated this week
• ngxson / wllama
  WebAssembly binding for llama.cpp - Enabling on-browser LLM inference
  ☆939Updated last month
• arcee-ai / fastmlx
  FastMLX is a high performance production ready API to host MLX models.
  ☆332Updated 8 months ago
• exo-explore / mlx-bitnet
  1.58 Bit LLM on Apple Silicon using MLX
  ☆225Updated last year
• kyutai-labs / moshivis
  Kyutai with an "eye"
  ☆223Updated 7 months ago
• willccbb / mlx_parallm
  Fast parallel LLM inference for MLX
  ☆227Updated last year
• sofdog-gh / realtime-transcription-fastrtc
  Real Time Speech Transcription with FastRTC ⚡️and Local Whisper 🤗
  ☆689Updated 4 months ago
• senstella / csm-mlx
  An implementation of the CSM(Conversation Speech Model) for Apple Silicon using MLX.
  ☆380Updated 3 months ago
• lmstudio-ai / mlx-engine
  LM Studio Apple MLX engine
  ☆816Updated last week
• JosefAlbers / Phi-3-Vision-MLX
  Phi-3.5 for Mac: Locally-run Vision and Language Models for Apple Silicon
  ☆274Updated last week
• facebookresearch / omnilingual-asr
  Omnilingual ASR Open-Source Multilingual SpeechRecognition for 1600+ Languages
  ☆1,058Updated last week
• ivanfioravanti / qwen-image-mps
  Qwen Image models through MPS
  ☆220Updated 2 weeks ago
• transformerlab / transformerlab-api
  API Server for Transformer Lab
  ☆78Updated this week
• Blaizzy / mlx-embeddings
  MLX-Embeddings is the best package for running Vision and Language Embedding models locally on your Mac using MLX.
  ☆223Updated 2 weeks ago
• unslothai / llama.cpp
  LLM inference in C/C++
  ☆103Updated last week
• iuliaturc / gguf-docs
  Docs for GGUF quantization (unofficial)
  ☆312Updated 3 months ago
• Doriandarko / MLX-GRPO
  A pure MLX-based training pipeline for fine-tuning LLMs using GRPO on Apple Silicon.
  ☆201Updated 2 weeks ago
• HazyResearch / minions
  Big & Small LLMs working together
  ☆1,194Updated last week