Flash weight streaming for MLX: run massive models larger than your RAM on Apple Silicon.
☆141Jun 13, 2026Updated 4 months ago
Alternatives and similar repositories for mlx-flash
Users that are interested in mlx-flash are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Running a big model on a small laptop☆4,488Mar 19, 2026Updated 7 months ago
- ☆228Mar 24, 2026Updated 7 months ago
- ⚡ Native MLX Swift LLM inference server for Apple Silicon. OpenAI-compatible API, SSD streaming for 100B+ MoE models, TurboQuant KV cache…☆797Updated this week
- REAP expert pruning for MoE LLMs on Apple Silicon via MLX☆58Mar 16, 2026Updated 7 months ago
- ANE (Apple Neural Engine) CostModel profiler for CoreML models☆36Apr 9, 2026Updated 6 months ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- A Swift-flavored mini development environment for the Apple II.☆14Jul 9, 2026Updated 3 months ago
- Implementation of E2-TTS, "Embarrassingly Easy Fully Non-Autoregressive Zero-Shot TTS", in MLX☆21Oct 8, 2024Updated 2 years ago
- Remote control agent for macOS development☆18Sep 20, 2026Updated last month
- Research MIL-to-HWX compiler for the M4 Apple Neural Engine☆17Sep 3, 2026Updated 2 months ago
- Running a big model on a small laptop☆60Mar 28, 2026Updated 7 months ago
- 😼 OpenFelix — Voice-first AI agent for macOS. Runs local LLMs on Apple Silicon via MLX. Supports all OpenClaw skills. Claude, GPT, or fu…☆33Mar 6, 2026Updated 8 months ago
- ☆29Oct 31, 2026Updated last week
- Metal Flash Attention for MLX☆20Oct 1, 2026Updated last month
- Docker/podman container for llama.cpp/vllm/exllamav{2,3} orchestrated using llama-swap☆17Jun 17, 2026Updated 4 months ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- MLX Model Quantization Toolkit - Comprehensive collection of Jupyter notebooks for converting and quantizing large language models usi…☆15Aug 16, 2025Updated last year
- Provides a frame iterator for videos by using ffmpeg. Decodes images using the image crate.☆12Mar 31, 2021Updated 5 years ago
- ☆86Mar 3, 2026Updated 8 months ago
- MLX: An array framework for Apple silicon☆69Oct 29, 2026Updated last week
- Brings the private API for full screen sheets in UIKit to SwiftUI☆11Jul 28, 2025Updated last year
- ☆21Oct 9, 2024Updated 2 years ago
- A repo of useful MLX skills.☆90Jan 25, 2026Updated 9 months ago
- CLI to demonstrate running a large language model (LLM) on Apple Neural Engine.☆131Dec 27, 2024Updated last year
- Run transformers directly on Apple's Neural Engine in Swift bypass coreml entirely☆174Sep 12, 2026Updated last month
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Convert and Run Exl3 format LLM quant on Apple Silicon.☆60Aug 24, 2026Updated 2 months ago
- Lossless DFlash speculative decoding for MLX on Apple Silicon☆793Aug 20, 2026Updated 2 months ago
- A simple category to use static UITableViewCells without having to use storyboards☆13Jan 12, 2014Updated 12 years ago
- An MLX port of Meta's Coconut reasoning model☆16Sep 2, 2025Updated last year
- Build bits for Rask Ingemann Lambertsen's IA16 GCC port☆11Apr 16, 2017Updated 9 years ago
- Run 70B+ LLMs on Apple Silicon by using SSD as extended memory — intelligent layer streaming and caching for Mac☆62Oct 24, 2026Updated 2 weeks ago
- Parse dates from strings, and add a natural language date field to your Swift app☆18Aug 12, 2025Updated last year
- Helmholtz-Kohlrausch effect estimation based on "Simple Estimation Methods for the Helmholtz – Kohlrausch Effect" Nayatani 1997☆11Mar 6, 2022Updated 4 years ago
- GLM-5.2 on 4x DGX Spark with adaptive MTP K2/K4/K5, FULL CUDA graphs, DCP2, 520K context, and a downloadable ARM64 runtime image.☆13Aug 8, 2026Updated 2 months ago
- End-to-end encrypted email - Proton Mail • AdSpecial offer: 40% Off Yearly / 80% Off First Month. All Proton services are open source and independently audited for security.
- Run Time Series Foundation Models on Apple Silicon☆36Feb 27, 2026Updated 8 months ago
- 😱 dead fast thumbnail library for browser and NodeJs! Built with Rust 🦀 and WebAssembly 🕸☆19Jan 7, 2024Updated 2 years ago
- vibevoice real time 0.5B swift port☆30Dec 12, 2025Updated 10 months ago
- MLX Omni Server is a local inference server powered by Apple's MLX framework, specifically designed for Apple Silicon (M-series) chips. I…☆746May 9, 2026Updated 5 months ago
- Academy Spectral Similarity Index Calculator☆10Aug 7, 2024Updated 2 years ago
- ☆41Sep 11, 2026Updated last month
- Production LLM inference on the Apple Neural Engine — a practitioner's guide, complete with converters, Swift runtimes, and validated mod…☆47Jun 7, 2026Updated 5 months ago