vLLM Metal plugin powered by mlx-swift — high-performance LLM inference on Apple Silicon
☆271Jun 3, 2026Updated last month
Alternatives and similar repositories for vllm-swift
Users that are interested in vllm-swift are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Lossless DFlash speculative decoding for MLX on Apple Silicon☆751Jun 11, 2026Updated last month
- DFlash block-diffusion speculative decoding running on Apple Silicon via MLX, with an ANE execution path that explores heterogeneous acce…☆62Apr 18, 2026Updated 2 months ago
- ⚡ Native MLX Swift LLM inference server for Apple Silicon. OpenAI-compatible API, SSD streaming for 100B+ MoE models, TurboQuant KV cache…☆715May 19, 2026Updated last month
- 2.24x decode TPS increase On Qwen 3.6 27B @ temp 0.6 | Native MTP Speculative Decoding On Apple Silicon With No External Drafter.☆1,033Updated this week
- Exact speculative decoding on Apple Silicon, powered by MLX.☆380Apr 20, 2026Updated 2 months ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- MLX Studio - Home of JANG_Q - Image Gen/Edit + Chat/Code All in one - + OpenClaw (Anthropic API)☆885Updated this week
- ☆36Mar 30, 2026Updated 3 months ago
- JANG — GGUF for MLX. YOU MUST USE JANG_Q RUNTIME. Adaptive Mixed-Precision Quantization + Runtime for Apple Silicon☆205Updated this week
- Multi-LoRA inference server for Apple Silicon -- one base model, many adapters, zero reload☆18Apr 13, 2026Updated 3 months ago
- Sequential Monte Carlo Speculative Decoding☆52Updated this week
- Agent Skill to help convert transformer LLMs to mlx-lm☆48Jun 16, 2026Updated 3 weeks ago
- Flash-MoE sidecar slot-bank runtime for large GGUF MoE models on Apple Silicon — llama.cpp fork☆118Jun 20, 2026Updated 3 weeks ago
- 🔥 The fastest local AI engine for Apple Silicon. Optimised for agentic use.☆81May 24, 2026Updated last month
- vMLX - JANGTQ Uber Compressed MLX Models - L2 Disk Cache (survives restart) + L1 Paged (super fast ttft) + Hybrid SSM Scheduler + Cont B…☆768Updated this week
- Deploy open-source AI quickly and easily - Special Bonus Offer • AdRunpod Hub is built for open source. One-click deployment and autoscaling endpoints without provisioning your own infrastructure.
- mac code — Claude Code, but it runs on your Mac for free. 35B AI agent at 30 tok/s via Apple Silicon flash-paging. $0/month.☆1,022Apr 9, 2026Updated 3 months ago
- Run LLMs on Apple devices with CoreML, optimized for Apple Neural Engine + GPU☆176Jun 8, 2026Updated last month
- LLM inference server with continuous batching & SSD caching for Apple Silicon — managed from the macOS menu bar☆17,827Updated this week
- ☆6,992Jun 26, 2026Updated 2 weeks ago
- DFlash: Block Diffusion for Flash Speculative Decoding☆5,468May 10, 2026Updated 2 months ago
- Test LLMs on real tasks. Compare models side-by-side.☆373Jun 16, 2026Updated 3 weeks ago
- ☆389Apr 16, 2026Updated 2 months ago
- ☆26Jan 15, 2026Updated 5 months ago
- Neutral, reproducible benchmark for local LLMs on Apple Silicon (Mac · iPhone · iPad) — MLX, llama.cpp, CoreML, Apple Foundation Models☆51Updated this week
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Train Large Language Models on MLX.☆394Updated this week
- Tree-based speculative decoding for Apple Silicon (MLX). ~10-15% faster than DFlash on code, ~1.5x over autoregressive. First MLX port wi…☆147Apr 15, 2026Updated 3 months ago
- PMetal: high-performance Apple Silicon framework for local LLM inference, LoRA/QLoRA fine-tuning, serving, quantization, and MLX/Metal ac…☆304Jun 5, 2026Updated last month
- ☆200Jun 11, 2026Updated last month
- Modern Swift network monitoring. Elegant, reactive and testable☆48Apr 26, 2026Updated 2 months ago
- Staging Room for benchmarking, orchestration and other operations for local Hermes AI Agent☆52Updated this week
- Local AI runtime for training & running small LLMs directly on Apple Neural Engine (ANE). No CoreML. No Metal. Offline, on-device fine-tu…☆107Mar 6, 2026Updated 4 months ago
- A Swift wrapper around libVLC for iOS, macOS, tvOS, visionOS, and Mac Catalyst☆525Updated this week
- Headless iOS Simulator manager/farm + host-side input injection for iOS 26 — taps, swipes, multi-finger gestures, and 60 fps streaming☆1,524Updated this week
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Model export recipes, Python primitives, and Swift runtime utilities for on-device AI☆1,388Updated this week
- The fastest local AI engine for Apple Silicon. 4.2x faster than Ollama, 0.08s cached TTFT, 100% tool calling. 17 tool parsers, prompt cac…☆3,266Updated this week
- ☆36May 19, 2026Updated last month
- Minimalist repo to do mlx vlm constrained decoding in batch mode☆18Apr 11, 2026Updated 3 months ago
- Local AI app and inference engine for agents. Run open-weight LLMs locally — private, 100% offline on your computer.☆1,080Updated this week
- Community model zoo for Apple Core AI (iOS/macOS 27): 49 models — LLM, VLM, OCR, ASR, TTS, image/video/music gen, forecasting — converted…☆344Updated this week
- One hub for all LLMs. Lives on your macOS menu bar.☆120Jun 1, 2026Updated last month