vMLX - JANGTQ Uber Compressed MLX Models - L2 Disk Cache (survives restart) + L1 Paged (super fast ttft) + Hybrid SSM Scheduler + Cont Batching + etc!
☆768Jul 14, 2026Updated this week
Alternatives and similar repositories for vmlx
Users that are interested in vmlx are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- MLX Studio - Home of JANG_Q - Image Gen/Edit + Chat/Code All in one - + OpenClaw (Anthropic API)☆885Updated this week
- LLM inference server with continuous batching & SSD caching for Apple Silicon — managed from the macOS menu bar☆17,827Updated this week
- 2.24x decode TPS increase On Qwen 3.6 27B @ temp 0.6 | Native MTP Speculative Decoding On Apple Silicon With No External Drafter.☆1,033Updated this week
- Lossless DFlash speculative decoding for MLX on Apple Silicon☆751Jun 11, 2026Updated last month
- Exact speculative decoding on Apple Silicon, powered by MLX.☆380Apr 20, 2026Updated 2 months ago
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- The fastest local AI engine for Apple Silicon. 4.2x faster than Ollama, 0.08s cached TTFT, 100% tool calling. 17 tool parsers, prompt cac…☆3,266Updated this week
- Native LLM inference server for Apple Silicon. OpenAI + Anthropic API compatible. No Python. Includes MLX Core macOS app with chat, agent…☆276Updated this week
- vLLM Metal plugin powered by mlx-swift — high-performance LLM inference on Apple Silicon☆271Jun 3, 2026Updated last month
- ⚡ Native MLX Swift LLM inference server for Apple Silicon. OpenAI-compatible API, SSD streaming for 100B+ MoE models, TurboQuant KV cache…☆715May 19, 2026Updated last month
- Minimalist repo to do mlx vlm constrained decoding in batch mode☆18Apr 11, 2026Updated 3 months ago
- DeepSeek 4 Flash and PRO local inference engine for Metal, CUDA and ROCm☆18,521Jul 3, 2026Updated last week
- macMLX brings local LLM inference to Apple Silicon with a first-class native macOS experience. No cloud, no telemetry, no Electron — just…☆59Updated this week
- OpenAI and Anthropic compatible server for Apple Silicon. Run LLMs and vision-language models (Llama, Qwen-VL, LLaVA) with continuous bat…☆1,429Jun 28, 2026Updated 2 weeks ago
- 🔥 The fastest local AI engine for Apple Silicon. Optimised for agentic use.☆81May 24, 2026Updated last month
- End-to-end encrypted cloud storage - Proton Drive • AdSpecial offer: 40% Off Yearly / 80% Off First Month. Protect your most important files, photos, and documents from prying eyes.
- DFlash: Block Diffusion for Flash Speculative Decoding☆5,468May 10, 2026Updated 2 months ago
- A native Mac App for LLM fine-tuning on Apple Silicon — fully on-device, fully open source.☆243Jun 22, 2026Updated 3 weeks ago
- Running a big model on a small laptop☆3,980Mar 19, 2026Updated 3 months ago
- Local LLM Testing & Benchmarking for Apple Silicon☆194Jun 18, 2026Updated 3 weeks ago
- MLX-VLM is a package for inference and fine-tuning of Vision Language Models (VLMs) on your Mac using MLX.☆5,160Updated this week
- Supporting code for "LLMs for your iPhone: Whole-Tensor 4 Bit Quantization"☆11Mar 31, 2024Updated 2 years ago
- Utilities to evaluate MLX quantizations☆20Jun 9, 2026Updated last month
- Own your AI. The native macOS harness for AI agents -- any model, persistent memory, autonomous execution, cryptographic identity. Built …☆7,097Updated this week
- Flash-MoE sidecar slot-bank runtime for large GGUF MoE models on Apple Silicon — llama.cpp fork☆118Jun 20, 2026Updated 3 weeks ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- ☆218Mar 24, 2026Updated 3 months ago
- DFlash block-diffusion speculative decoding running on Apple Silicon via MLX, with an ANE execution path that explores heterogeneous acce…☆62Apr 18, 2026Updated 2 months ago
- AI speech toolkit for Apple Silicon — ASR, TTS, speech-to-speech, VAD, and diarization powered by MLX and CoreML☆1,016Updated this week
- A tool for creating and running Linux containers using lightweight virtual machines on a Mac. It is written in Swift, and optimized for A…☆47,840Updated this week
- MiMo-V2.5 Omni TP=2 on 2x DGX Spark · 1M context · NVFP4 4-bit KV (~1.97M-token KV pool @ 1M, ~30 tok/s) · 69-eval: thinking-OFF 97.8 bea…☆36Updated this week
- Run Chroma embedded in Swift☆70Feb 18, 2026Updated 4 months ago
- mac code — Claude Code, but it runs on your Mac for free. 35B AI agent at 30 tok/s via Apple Silicon flash-paging. $0/month.☆1,022Apr 9, 2026Updated 3 months ago
- M-Courtyard: Local AI Model Fine-tuning Assistant for Apple Silicon. Zero-code, zero-cloud, privacy-first desktop app powered by Tauri + …☆156Updated this week
- Local AI app and inference engine for agents. Run open-weight LLMs locally — private, 100% offline on your computer.☆1,080Updated this week
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Tree-based speculative decoding for Apple Silicon (MLX). ~10-15% faster than DFlash on code, ~1.5x over autoregressive. First MLX port wi…☆147Apr 15, 2026Updated 3 months ago
- The agent that grows with you☆214,747Updated this week
- Pure MLX port of LTX-2 (Lightricks LTX-2.3) for Apple Silicon — video + audio generation☆77Updated this week
- A high-performance API server that provides OpenAI-compatible endpoints for MLX models. Developed using Python and powered by the FastAPI…☆351Updated this week
- The safest, simplest way to manage Hermes from your Mac. Pure SSH. No gateways, no exposed ports, no browser layer.☆1,961Jun 19, 2026Updated 3 weeks ago
- ☆605Jun 10, 2026Updated last month
- Open source Ghostty-based macOS terminal with vertical tabs and notifications for AI coding agents. Built for multitasking, organization,…☆24,487Updated this week