Alternatives and similar repositories for LiteRT-LM

Users that are interested in LiteRT-LM are comparing it to the libraries listed below

• huggingface / huggingface-gemma-recipes
  Inference, Fine Tuning and many more recipes with Gemma family of models
  ☆223Updated last week
• freddyaboulton / orpheus-cpp
  Fast Streaming TTS with Orpheus + WebRTC (with FastRTC)
  ☆298Updated 3 months ago
• Lizonghang / TPI-LLM
  TPI-LLM: Serving 70b-scale LLMs Efficiently on Low-resource Edge Devices
  ☆185Updated last month
• Goekdeniz-Guelmez / mlx-lm-lora
  Train Large Language Models on MLX.
  ☆126Updated this week
• AlexBodner / How_Much_VRAM
  ☆101Updated 10 months ago
• JosefAlbers / whisper-turbo-mlx
  Blazing fast whisper turbo for ASR (speech-to-text) tasks
  ☆212Updated 8 months ago
• Vaibhavs10 / hf-llm.rs
  ☆206Updated 5 months ago
• Blaizzy / mlx-embeddings
  MLX-Embeddings is the best package for running Vision and Language Embedding models locally on your Mac using MLX.
  ☆179Updated last month
• codelion / adaptive-classifier
  A flexible, adaptive classification system for dynamic text classification
  ☆336Updated 3 weeks ago
• JosefAlbers / Phi-3-Vision-MLX
  Phi-3.5 for Mac: Locally-run Vision and Language Models for Apple Silicon
  ☆271Updated 10 months ago
• ivanfioravanti / wine_variety_classification
  Examples on how to use various LLM providers with a Wine Classification problem
  ☆96Updated 3 weeks ago
• arcee-ai / fastmlx
  FastMLX is a high performance production ready API to host MLX models.
  ☆313Updated 3 months ago
• huggingface / local-gemma
  Gemma 2 optimized for your local machine.
  ☆376Updated 11 months ago
• AK391 / gemini-gradio
  ☆95Updated 6 months ago
• BhabhaAI / dataformer
  Solving data for LLMs - Create quality synthetic datasets!
  ☆150Updated 5 months ago
• exo-explore / mlx-bitnet
  1.58 Bit LLM on Apple Silicon using MLX
  ☆214Updated last year
• mzbac / mlx_sharding
  Distributed Inference for mlx LLm
  ☆93Updated 11 months ago
• cognitivecomputations / dolphin-logger
  ☆101Updated last month
• Nutlope / open-deep-research
  The Open Deep Research app – generate reports with OSS LLMs
  ☆261Updated 2 weeks ago
• brilliantlabsAR / frame_realtime_gemini_voicevision
  Realtime Voice and Vision wtih Brilliant Labs Frame and Gemini
  ☆58Updated 2 months ago
• NimbleEdge / sparse_transformers
  Sparse Inferencing for transformer based LLMs
  ☆193Updated this week
• Fus3n / gem-assist
  Command-line personal assistant using your favorite proprietary or local models with access to over 30+ tools
  ☆110Updated 2 weeks ago
• Vaibhavs10 / llama-assistant
  ☆171Updated 11 months ago
• huggingface / HuggingSnap
  SmolVLM2 Demo
  ☆159Updated 3 months ago
• madroidmaq / mlx-omni-server
  MLX Omni Server is a local inference server powered by Apple's MLX framework, specifically designed for Apple Silicon (M-series) chips. I…
  ☆437Updated last week
• johnmai-dev / NotebookMLX
  📋 NotebookMLX - An Open Source version of NotebookLM (Ported NotebookLlama)
  ☆303Updated 4 months ago
• kyutai-labs / moshivis
  Kyutai with an "eye"
  ☆207Updated 3 months ago
• adithya-s-k / YoloGemma
  Testing and evaluating the capabilities of Vision-Language models (PaliGemma) in performing computer vision tasks such as object detectio…
  ☆81Updated last year
• willccbb / mlx_parallm
  Fast parallel LLM inference for MLX
  ☆198Updated last year
• BenCaunt / MoondreamObjectTracking
  Using the moondream VLM with optical flow for promptable object tracking
  ☆68Updated 4 months ago