A local inference engine for Apple silicon, built around the model.
☆2,110Nov 6, 2026Updated this week
Alternatives and similar repositories for splash
Users that are interested in splash are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- The fastest way to run Qwen 3.8 Flash Next, Qwen 3.8 27B and Ternary Bonsai 2 27B on a Mac: 125 tok/s in OpenCode on an M5 Max, and a 27B…☆2,673Updated this week
- Unofficial M1/M2 port of Inco's Splash (upstream is M3+ only): Metal kernels written for Apple7/8 GPUs, prebuilt releases.☆212Updated this week
- Native LLM inference server for Apple Silicon. OpenAI + Anthropic API compatible. No Python. Zig backend, Swift frontend macOS app with c…☆2,389Updated this week
- Sushi engine runs very high quality quant model in Apple Silicon, using both STQ and EXL3 format with special tuning technology.☆421Updated this week
- LLM Inference Engine for Metal, CUDA and Vulkan.☆1,677Updated this week
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- LLM inference server with continuous batching & SSD caching for Apple Silicon — managed from the macOS menu bar☆23,416Updated this week
- Splish: a fork of Inco's Splash, tuned for Apple M5 GPUs. Apache-2.0☆32Oct 29, 2026Updated last week
- lithos-metal: high-performance LLM inference kernels and serving for Apple silicon.☆335Oct 21, 2026Updated 2 weeks ago
- Blazing fast Apple Silicon inference engine optimized for Qwen & Nemotron. OpenAI + Anthropic API compatible. Built by folks from nace.ai☆657Updated this week
- Up to 4× faster LLM decoding on Apple Silicon, lossless. Native MLX port of DeepSeek's DSpark & z-lab's DFlash speculative decoding — Gem…☆735Oct 5, 2026Updated last month
- Real-time vLLM + TensorFold performance dashboard TUI — single file, zero dependencies☆13Oct 19, 2026Updated 2 weeks ago
- ☆38Oct 22, 2026Updated 2 weeks ago
- Qwen3.8-Flash-Next on any consumer hardware: one-click install for Windows / Linux. Strata inference engine, OpenAI/Anthropic API on loca…☆40,925Updated this week
- MiniMax H3 inference engine for Mac computers☆3,032Aug 11, 2026Updated 2 months ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- MLX Studio - Easiest way to run LLM's on your Mac. All in one engine.☆990Updated this week
- vMLX - Use MLX models easily - JANGQ (GGUF for MLX) - Not dependant on mlx_vlm☆909Updated this week
- Run LLMs with MLX☆7,571Updated this week
- Lossless DFlash speculative decoding for MLX on Apple Silicon☆793Aug 20, 2026Updated 2 months ago
- Rapid-MLX is an open-source (Apache 2.0) OpenAI- and Anthropic-compatible LLM inference server for Apple Silicon, built on MLX, focused o…☆4,103Updated this week
- A high-performance inference engine for AI models☆3,230Updated this week
- Run a 105 GB AI model on a Mac that can't hold it. Qwen3.8-Flash-Next 4-bit, streamed from SSD on 16–64 GB Apple Silicon Macs. Fully nati…☆652Updated this week
- Fork of antirez/ds4 for Apple Silicon, tuned mostly for M1/M2: Qwen3.8-Flash-Next with 262K context on 64 GB and up, 35 tok/s on an M1 Ma…☆35Updated this week
- Our lightning-fast inference engine.☆276Oct 27, 2026Updated last week
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- DeepSeek 4 Flash and PRO local inference engine for Metal, CUDA and ROCm☆24,253Updated this week
- MLX-VLM is a package for inference and fine-tuning of Vision Language Models (VLMs) on your Mac using MLX.☆5,813Updated this week
- Local computer use on Apple silicon: on-device typed decisions with laya and form filling with CUA-S1-FORMS, driven through the macOS Acc…☆543Oct 28, 2026Updated last week
- High-performance OpenAI and Anthropic compatible LLM inference server for Apple Silicon. Native MLX, continuous batching, multimodal mode…☆1,650Updated this week
- Qwen 3.8 27B at 48-65 tok/s on a Mac Studio M4 Max — measured oMLX native-MTP recipe, same-day A/B vs mlx-vlm+MTP sidecar, raw benchmark …☆71Aug 21, 2026Updated 2 months ago
- Nativ is an open-source local AI app for Mac. It runs open AI models on Apple Silicon, and nothing leaves your Mac.☆1,576Updated this week
- MLTF: Qwen3.8-27B q8c inference for Apple Silicon☆14Oct 8, 2026Updated 3 weeks ago
- High-performance single-GPU inference for selected model checkpoints and GPUs.☆3,269Updated this week
- ⚡ Native MLX Swift LLM inference server for Apple Silicon. OpenAI-compatible API, SSD streaming for 100B+ MoE models, TurboQuant KV cache…☆797Updated this week
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- DS Menu Bar - A Lightweight Menu Bar Control for DwarfStar Server (ds4-server)☆18Updated this week
- DFlash: Block Diffusion for Flash Speculative Decoding☆6,217Aug 18, 2026Updated 2 months ago
- Run GLM-5.3-Flash (321B), DeepSeek-V4.1-Flash (748B) and MiniMax-M3.1-Flash (428B) on your own GPUs - one engine, one dashboard, OpenAI- …☆2,585Updated this week
- Open source inference engine that tunes its kernels on your hardware to find the fastest way to run each model. 2x faster than Ollama. Wo…☆7,719Updated this week
- Qwen 3.8 27B MLX challenge — placeholder, not yet open.☆57Aug 29, 2026Updated 2 months ago
- Own your AI. The native macOS harness for AI agents -- any model, persistent memory, autonomous execution, cryptographic identity. Built …☆8,136Updated this week
- Community maintained hardware plugin for vLLM on Apple Silicon☆1,967Updated this week