Up to 4× faster LLM decoding on Apple Silicon, lossless. Native MLX port of DeepSeek's DSpark & z-lab's DFlash speculative decoding — Gemma-4, Qwen3.8, Muse-Glimmer, Nemotron, LFM2.5, Ornith-1.0, ternary Bonsai-27B.
☆720Oct 5, 2026Updated 2 weeks ago
Alternatives and similar repositories for mlx-dspark
Users that are interested in mlx-dspark are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- The fastest way to run Qwen 3.8 Flash Next, Qwen 3.8 27B and Ternary Bonsai 2 27B on a Mac: 125 tok/s in OpenCode on an M5 Max, and a 27B…☆2,619Oct 10, 2026Updated last week
- Native LLM inference server for Apple Silicon. OpenAI + Anthropic API compatible. No Python. Zig backend, Swift frontend macOS app with c…☆2,030Updated this week
- A local inference engine for Apple silicon, built around the model.☆1,733Updated this week
- A MLX port of FLUX based on the Huggingface Diffusers implementation.☆20Sep 20, 2026Updated last month
- lithos-metal: high-performance LLM inference kernels and serving for Apple silicon.☆306Updated this week
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- LLM Inference Engine for Metal and CUDA.☆1,387Updated this week
- Qwen 3.8 27B at 48-65 tok/s on a Mac Studio M4 Max — measured oMLX native-MTP recipe, same-day A/B vs mlx-vlm+MTP sidecar, raw benchmark …☆69Aug 21, 2026Updated 2 months ago
- MiniMax H3 inference engine for Mac computers☆2,943Aug 11, 2026Updated 2 months ago
- LLM inference server with continuous batching & SSD caching for Apple Silicon — managed from the macOS menu bar☆22,977Updated this week
- Fine-tune LLMs on your Mac with Apple Silicon. SFT, DPO, GRPO, Vision, TTS, STT, Embedding, and OCR fine-tuning — natively on MLX. Unslot…☆1,449Jun 23, 2026Updated 4 months ago
- a community oriented 1:1, vLLM-alike (Continuous batching, paged KV) engine in C++ with additional features (GGUF, RadixAttention, Cache-…☆454Updated this week
- DFlash block-diffusion speculative decoding running on Apple Silicon via MLX, with an ANE execution path that explores heterogeneous acce…☆61Apr 18, 2026Updated 6 months ago
- Minimal Claude Code alternative powered by MLX☆47Jan 11, 2026Updated 9 months ago
- vMLX - Use MLX models easily - JANGQ (GGUF for MLX) - Not dependant on mlx_vlm☆899Updated this week
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Native MLX port of TRELLIS.2 for Apple Silicon☆69Jun 13, 2026Updated 4 months ago
- Splish: a fork of Inco's Splash, tuned for Apple M5 GPUs. Apache-2.0☆28Oct 5, 2026Updated 2 weeks ago
- Rapid-MLX is an open-source (Apache 2.0) OpenAI- and Anthropic-compatible LLM inference server for Apple Silicon, built on MLX, focused o…☆4,018Updated this week
- 1.0 Beta · oMLX 0.6.3rc2 Dual-ANE+CPU · Qwen3.8-27B abliterated oQ4e · Mac Studio M3 Ultra☆45Aug 23, 2026Updated 2 months ago
- Minimalist repo to do mlx vlm constrained decoding in batch mode☆20Apr 11, 2026Updated 6 months ago
- Lossless DFlash speculative decoding for MLX on Apple Silicon☆789Aug 20, 2026Updated 2 months ago
- Run LLMs with MLX☆7,436Updated this week
- Community maintained hardware plugin for vLLM on Apple Silicon☆1,900Updated this week
- FreeToken brings datacenter-scale model serving to your desktop. Run massive models locally, fast and efficiently.☆14,678Updated this week
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- MLX-VLM is a package for inference and fine-tuning of Vision Language Models (VLMs) on your Mac using MLX.☆5,648Updated this week
- DeepSeek 4 Flash and PRO local inference engine for Metal, CUDA and ROCm☆23,995Updated this week
- Qwen3.8-Flash-Next on any consumer hardware: one-click install for Windows / Linux. Strata inference engine, OpenAI/Anthropic API on loca…☆30,418Updated this week
- Local LLM Testing & Benchmarking for Apple Silicon☆212Sep 5, 2026Updated last month
- Gemma 4 26B-A4B inference in ~2 GB of RAM on any M-series MacBook☆6,943Oct 15, 2026Updated last week
- ☆27Aug 15, 2026Updated 2 months ago
- A self-improving RLM agent for coding workflows and long-running autonomous tasks.☆22,265Updated this week
- Various configurations for optimal Local AI usage.☆57Updated this week
- Search your computer by what's in your files: photos, PDFs, documents, recordings, videos and code. On-device on Mac, Windows and Linux, …☆5,483Updated this week
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- MiniMax H3 (video + audio) on TensorFold 0.6.5 with an H3 family, Mac Studio M5 Ultra: 5 s 864x480 clip in ~50 s, 40 s at 768x448 — the f…☆29Oct 7, 2026Updated 2 weeks ago
- Native MLX runtime for Laya typed decision models — 7–14 ms short decisions on M3 Max. No text generation, PyTorch, or cloud API.☆6,994Updated this week
- qMLX: Custom inference engine for Qwen 3.5 122B on Apple Silicon, extending MLX with hybrid attention support, SSD-backed KV cache, and R…☆36Aug 5, 2026Updated 2 months ago
- Apple Silicon GPU DVFS reverse engineering: voltage corners, CLPC frequency control, Metal benchmarks☆65Aug 24, 2026Updated last month
- Metal Cuda Direct Memory Access☆201Oct 15, 2026Updated last week
- Qwen3.8-Flash-Next on two DGX Sparks with TensorFold☆33Oct 11, 2026Updated last week
- ☆39Oct 15, 2026Updated last week