Alternatives and similar repositories for mlx-llm.cpp

Users that are interested in mlx-llm.cpp are comparing it to the libraries listed below

• rounak / MLXTinyGPT
  MLX Swift implementation of Andrej Karpathy's Let's build GPT video
  ☆63Updated last year
• mzbac / vibevoice.swift
  vibevoice real time 0.5B swift port
  ☆27Updated last month
• mzbac / flux.swift.cli
  CLI tool for text to image generation using the FLUX.1 model.
  ☆67Updated 7 months ago
• awni / mlx_nanocode
  Minimal Claude Code alternative powered by MLX
  ☆44Updated 3 weeks ago
• Jaykef / mlx-rag-gguf
  Minimal, clean code implementation of RAG with mlx using gguf model weights
  ☆53Updated last year
• mzbac / flux.1.app
  ☆22Updated last year
• chimezie / mlx-tuning-fork
  Very basic framework for composable parameterized large language model (Q)LoRA / (Q)Dora fine-tuning using mlx, mlx_lm, and OgbujiPT.
  ☆43Updated 7 months ago
• QuixiAI / dolphin-utils
  ☆15Updated last month
• uogbuji / mlx-notes
  Shared personal notes created while working with the Apple MLX machine learning framework
  ☆24Updated last month
• kunal732 / MLX-Model-Manager
  MLX Model Manager unifies loading and inferencing with LLMs and VLMs.
  ☆103Updated last year
• nath1295 / MLX-Textgen
  A python package for serving LLM on OpenAI-compatible API endpoints with prompt caching using MLX.
  ☆100Updated 7 months ago
• mzbac / flux.swift
  Swift implementation of Flux.1 using mlx-swift
  ☆112Updated 5 months ago
• mzbac / mlx_sharding
  Distributed Inference for mlx LLm
  ☆100Updated last year
• mzbac / swift-mlx-server
  ☆43Updated 7 months ago
• mzbac / mlx-llm-server
  For inferring and serving local LLMs using the MLX framework
  ☆110Updated last year
• DePasqualeOrg / mlx-swift-audio
  Swift tools for text to speech (TTS) and speech to text (STT) powered by MLX
  ☆98Updated 2 weeks ago
• riccardomusmeci / mlx-image
  mlx image models for Apple Silicon machines
  ☆91Updated 2 months ago
• mzau / mlx-knife
  ollama like cli tool for MLX models on huggingface (pull, rm, list, show, serve etc.)
  ☆128Updated this week
• ptsochantaris / emeltal
  Local ML voice chat using high-end models.
  ☆182Updated last month
• zhuzilin / faster-nougat
  Implementation of nougat that focuses on processing pdf locally.
  ☆84Updated last year
• Blaizzy / mlx-embeddings
  MLX-Embeddings is the best package for running Vision and Language Embedding models locally on your Mac using MLX.
  ☆269Updated 3 weeks ago
• Goekdeniz-Guelmez / mlx-kan
  KAN (Kolmogorov–Arnold Networks) in the MLX framework for Apple Silicon
  ☆31Updated 7 months ago
• ToluClassics / mlx-transformers
  MLX Transformers is a library that provides model implementation in MLX. It uses a similar model interface as HuggingFace Transformers an…
  ☆72Updated last year
• JosefAlbers / PVM
  Phi-3.5 for Mac: Locally-run Vision and Language Models for Apple Silicon
  ☆273Updated 2 months ago
• awni / mlx-skills
  A repo of useful MLX skills.
  ☆69Updated 2 weeks ago
• kyutai-labs / moshi-swift
  ☆129Updated 7 months ago
• ivanfioravanti / autogram
  Grammar checker with a keyboard shortcut for Ollama and Apple MLX with Automator on macOS.
  ☆81Updated 2 years ago
• RamboRogers / mlx-gui
  MLX-GUI MLX Inference Server for Apple Silicone
  ☆179Updated 3 weeks ago
• firstbatchxyz / dria-agent
  powerful and fast tool calling agents
  ☆80Updated 10 months ago
• stockeh / mlx-optimizers
  A collection of optimizers for MLX
  ☆55Updated last month