Run a 105 GB AI model on a Mac that can't hold it. Qwen3.8-Flash-Next 4-bit, streamed from SSD on 16–64 GB Apple Silicon Macs. Fully native Swift, MLX and Metal. Offline, no Python. CLI, Swift library, and Ollama/OpenAI/Anthropic APIs. Works with Claude Code and Codex.
☆652Nov 4, 2026Updated this week
Alternatives and similar repositories for slotstream
Users that are interested in slotstream are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Run Qwen Flash Next on a Mac Mini m5 64GB box☆18Oct 24, 2026Updated last week
- Blazing fast Apple Silicon inference engine optimized for Qwen & Nemotron. OpenAI + Anthropic API compatible. Built by folks from nace.ai☆657Updated this week
- DeepSeek-V4-Flash-0731 284B inference in ~25 GB of RAM / Qwen3.8-Next-Flash inference in ~15 GB of RAM on any M-series MacBook☆151Oct 28, 2026Updated last week
- Swiftlet is a Swift and Metal runtime that runs large Qwen Mixture-of-Experts models locally on Apple devices by streaming expert weights…☆667Updated this week
- A local inference engine for Apple silicon, built around the model.☆2,110Updated this week
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Gemma 4 26B-A4B inference in ~2 GB of RAM on any M-series MacBook☆7,286Oct 26, 2026Updated last week
- Run DeepSeek V4-Flash (~100B MoE) on a 48GB Apple Silicon Mac via SSD expert-streaming — a custom MLX offload engine. ~4.5-5 tok/s.☆10Jul 4, 2026Updated 4 months ago
- Privacy-first AI coding activity for your GitHub profile.☆19Updated this week
- The fastest way to run Qwen 3.8 Flash Next, Qwen 3.8 27B and Ternary Bonsai 2 27B on a Mac: 125 tok/s in OpenCode on an M5 Max, and a 27B…☆2,673Updated this week
- lithos-metal: high-performance LLM inference kernels and serving for Apple silicon.☆335Oct 21, 2026Updated 2 weeks ago
- MiniMax H3 inference engine for Mac computers☆3,032Aug 11, 2026Updated 2 months ago
- worlds via code, from fable 5.1☆528Sep 9, 2026Updated last month
- Native LLM inference server for Apple Silicon. OpenAI + Anthropic API compatible. No Python. Zig backend, Swift frontend macOS app with c…☆2,389Updated this week
- LLM inference in C/C++☆58Sep 26, 2026Updated last month
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Claude Code ZeroClaw Pro 2026: AI Multitool & CLI Router for Claude SDK Subagents☆52Updated this week
- A high-performance inference engine for AI models☆3,230Updated this week
- A self-hosted, zero-knowledge, secure PHP notebook. Your notes, in your browser, on your server - every byte encrypted with AES-256 using…☆26Jun 20, 2026Updated 4 months ago
- Our lightning-fast inference engine.☆276Oct 27, 2026Updated last week
- Claude Code for the Power User☆288Apr 18, 2026Updated 6 months ago
- K-Veritas CLI☆13Updated this week
- Sushi engine runs very high quality quant model in Apple Silicon, using both STQ and EXL3 format with special tuning technology.☆421Updated this week
- ARGODRIVE Deltafin: Kimi K3 (2.8T MoE) streamed from SSDs on Apple Silicon — fork of gavamedia/deltafin with the ARGODRIVE storage work a…☆99Updated this week
- Close your router's backdoors, see where your traffic goes, speed up your Wi-Fi, and let Claude, ChatGPT or Grok watch your network. Wind…☆35Oct 30, 2026Updated last week
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Qwen3.8-Flash-Next on any consumer hardware: one-click install for Windows / Linux. Strata inference engine, OpenAI/Anthropic API on loca…☆40,925Updated this week
- Splish: a fork of Inco's Splash, tuned for Apple M5 GPUs. Apache-2.0☆32Oct 29, 2026Updated last week
- Runtime governance for AI agents. Allow, warn, or block every model and tool call before it commits. Hash-chained audit for every decisio…☆32Updated this week
- ☆54Oct 20, 2026Updated 2 weeks ago
- LLM Inference Engine for Metal, CUDA and Vulkan.☆1,677Updated this week
- Fine-tune Gemma 4 and 3n with audio, images and text on Apple Silicon, using PyTorch and Metal Performance Shaders.☆1,515Oct 30, 2026Updated last week
- LLM inference server with continuous batching & SSD caching for Apple Silicon — managed from the macOS menu bar☆23,416Updated this week
- Free, open source voice dictation for macOS. On-device transcription with Apple's Speech framework. No cloud/no API keys/no account.☆466Updated this week
- Run full Kimi K3 on a single device. And an OpenAI-compatible API server for local chat and coding agents.☆857Oct 4, 2026Updated last month
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- ☆106Aug 29, 2026Updated 2 months ago
- Qwen3.8-Flash-Next on Apple Silicon: an MLX engine that reads Strata's GGUF files and speaks its line protocol (unofficial)☆111Oct 24, 2026Updated last week
- Wardnet is a self-hosted network privacy gateway that runs on linux (docker or bare metal). It sits alongside an existing home or small-o…☆26Updated this week
- Nativ is an open-source local AI app for Mac. It runs open AI models on Apple Silicon, and nothing leaves your Mac.☆1,576Updated this week
- Clean up Claude's token vomit with a separate LLM. Save your tokens, Opus is hopeless☆202Sep 9, 2026Updated last month
- Open source lightweight TUI for parallel agent management☆20Oct 10, 2026Updated 3 weeks ago
- Run local image, text, speech, vision, music, and video workflows, plus model management and a loopback OpenAI-compatible API server. The…☆88Updated this week