Native LLM inference server for Apple Silicon. OpenAI + Anthropic API compatible. No Python. Includes MLX Core macOS app with chat, agent mode, and tool calling.
☆1,242Sep 11, 2026Updated this week
Alternatives and similar repositories for mlx-serve
Users that are interested in mlx-serve are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- 3x faster speeds on MLX | Qwen 3.8 27B | Native MTP Speculative Decoding On Apple Silicon With No External Drafter.☆2,279Sep 6, 2026Updated last week
- vMLX - Use MLX models easily - JANGQ (GGUF for MLX) - Not dependant on mlx_vlm☆849Updated this week
- LLM inference server with continuous batching & SSD caching for Apple Silicon — managed from the macOS menu bar☆21,651Updated this week
- High-performance OpenAI and Anthropic compatible LLM inference server for Apple Silicon. Native MLX, continuous batching, multimodal mode…☆1,570Sep 6, 2026Updated last week
- MLX Studio - Easiest way to run LLM's on your Mac. All in one engine.☆970Updated this week
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- Open-source LLM observability and evaluation platform☆16Jul 13, 2026Updated last month
- Community maintained hardware plugin for vLLM on Apple Silicon☆1,728Updated this week
- ☆15Feb 3, 2026Updated 7 months ago
- Run LLMs with MLX☆6,984Updated this week
- MLX-VLM is a package for inference and fine-tuning of Vision Language Models (VLMs) on your Mac using MLX.☆5,490Updated this week
- The fastest local AI engine for Apple Silicon. 4.2x faster than Ollama, 0.08s cached TTFT, 100% tool calling. 17 tool parsers, prompt cac…☆3,731Updated this week
- ⚡ Native MLX Swift LLM inference server for Apple Silicon. OpenAI-compatible API, SSD streaming for 100B+ MoE models, TurboQuant KV cache…☆766Sep 5, 2026Updated last week
- LLMs and VLMs with MLX Swift☆803Updated this week
- PMetal: high-performance Apple Silicon framework for local LLM inference, LoRA/QLoRA fine-tuning, serving, quantization, and MLX/Metal ac…☆311Updated this week
- End-to-end encrypted email - Proton Mail • AdSpecial offer: 40% Off Yearly / 80% Off First Month. All Proton services are open source and independently audited for security.
- Own your AI. The native macOS harness for AI agents -- any model, persistent memory, autonomous execution, cryptographic identity. Built …☆7,903Updated this week
- Optimized Ollama LLM server configuration for Mac Studio and other Apple Silicon Macs. Headless setup with automatic startup, resource op…☆353Jan 24, 2026Updated 7 months ago
- A little file for doing LLM-assisted prompt expansion and image generation using Flux.schnell - complete with prompt history, prompt queu…☆26Aug 16, 2024Updated 2 years ago
- Video Frame data structures, originally part of rav1e☆18Aug 2, 2026Updated last month
- A hands-on Swift and Metal course for building LLM inference from first principles on Apple silicon, with 48 guided lessons, runnable exe…☆190Jul 17, 2026Updated last month
- Store, query, and create YAML workflow playbooks for LLM agents via MCP. STDIO or Streamable HTTP.☆31Sep 4, 2026Updated last week
- Mixed-vendor GPU inference cluster manager with speculative decoding☆34Jul 2, 2026Updated 2 months ago
- Vesta macOS Distribution - Official releases and downloads.Vesta AI Chat Assistant for macOS - Built with SwiftUI, Swift MLX and Apple I…☆82May 9, 2026Updated 4 months ago
- A small embeddable Datalog engine in Zig ⚡☆26Aug 1, 2026Updated last month
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- MLX-Embeddings is the best package for running Vision and Language Embedding models locally on your Mac using MLX.☆441May 13, 2026Updated 3 months ago
- 'afm' command cli: macOS server and single prompt mode that exposes Apple's Foundation and MLX Models and other APIs running on your Mac …☆340Updated this week
- A MCP server allowing LLM agents to easily connect and retrieve data from any database☆99Aug 1, 2025Updated last year
- High-performance MLX-based LLM inference engine for macOS with native Swift implementation☆592Updated this week
- Run LLMs with MLX☆15May 1, 2026Updated 4 months ago
- Demo project for YOLO implementation with Rust and WASM☆11Mar 29, 2024Updated 2 years ago
- A WebSocket implementation based on Swift Concurrency☆11Sep 13, 2022Updated 4 years ago
- Superseded by github.com/poisonxa16/pxa — PXA, the set-and-forget engine for Pascal and Volta☆24Updated this week
- MLX Model Quantization Toolkit - Comprehensive collection of Jupyter notebooks for converting and quantizing large language models usi…☆16Aug 16, 2025Updated last year
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- A cosy home for your LLMs.☆1,503Updated this week
- Tool calling using MLX Swift across iOS, macOS, and visionOS platforms☆127Aug 31, 2026Updated last week
- Utilities to evaluate MLX quantizations☆26Jun 9, 2026Updated 3 months ago
- implementation of zig-BUILD lib to python to make working with matrices faster, for fun lets see what is going to happen☆25Apr 12, 2026Updated 5 months ago
- Turn failed AI agent runs into replayable regression tests. Catch regressions before you ship.☆18Jun 4, 2026Updated 3 months ago
- Local LLM Testing & Benchmarking for Apple Silicon☆203Sep 5, 2026Updated last week
- This guide is beginner-friendly, project-driven, and laser-focused on the commands & concepts you will actually use while working with Do…☆16Dec 20, 2025Updated 8 months ago