Flash weight streaming for MLX: run massive models larger than your RAM on Apple Silicon.
☆138Jun 13, 2026Updated 4 months ago
Alternatives and similar repositories for mlx-flash
Users that are interested in mlx-flash are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Running a big model on a small laptop☆4,255Mar 19, 2026Updated 6 months ago
- ☆226Mar 24, 2026Updated 6 months ago
- ⚡ Native MLX Swift LLM inference server for Apple Silicon. OpenAI-compatible API, SSD streaming for 100B+ MoE models, TurboQuant KV cache…☆784Updated this week
- vLLM inference solutions for NVIDIA GB10 (DGX Spark, sm121) — KIMI-K3 B12X_MLA + DSpark, GLM-5.2☆67Sep 30, 2026Updated 2 weeks ago
- REAP expert pruning for MoE LLMs on Apple Silicon via MLX☆58Mar 16, 2026Updated 7 months ago
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- ANE (Apple Neural Engine) CostModel profiler for CoreML models☆35Apr 9, 2026Updated 6 months ago
- PMetal: high-performance Apple Silicon framework for local LLM inference, LoRA/QLoRA fine-tuning, serving, quantization, and MLX/Metal ac…☆327Updated this week
- Flash-MoE sidecar slot-bank runtime for large GGUF MoE models on Apple Silicon — llama.cpp fork☆135Oct 7, 2026Updated last week
- Implementation of E2-TTS, "Embarrassingly Easy Fully Non-Autoregressive Zero-Shot TTS", in MLX☆21Oct 8, 2024Updated 2 years ago
- 😼 OpenFelix — Voice-first AI agent for macOS. Runs local LLMs on Apple Silicon via MLX. Supports all OpenClaw skills. Claude, GPT, or fu…☆32Mar 6, 2026Updated 7 months ago
- Running a big model on a small laptop☆58Mar 28, 2026Updated 6 months ago
- ☆40Apr 5, 2026Updated 6 months ago
- Detect and type PII locally with one ProgramAsWeights neural program.☆34Sep 3, 2026Updated last month
- ☆27Updated this week
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- MLX Model Quantization Toolkit - Comprehensive collection of Jupyter notebooks for converting and quantizing large language models usi…☆15Aug 16, 2025Updated last year
- Web3j integrations for Ethereum 2.0 (Eth2) network☆12Dec 15, 2021Updated 4 years ago
- Rust crate for some audio utilities☆32Jun 17, 2026Updated 4 months ago
- For those who love graphics programming and hate shading languages☆28Apr 30, 2021Updated 5 years ago
- Swift + Metal MoE inference for Apple Silicon: Qwen 3.6 35B at 23.5–29.3 tok/s decode with 2.20× faster long-prompt prefill on a 24 GB M5…☆122Sep 25, 2026Updated 3 weeks ago
- A Telegram bot that integrates with ChatGPT through Openrouter.AI API to provide answers.☆15Jul 6, 2026Updated 3 months ago
- ☆86Mar 3, 2026Updated 7 months ago
- A Clojure library to automatically generate public API namespaces by wrapping and exposing functions and macros from implementation names…☆13Mar 14, 2025Updated last year
- Fast Clojure interpreter and template engine☆14Oct 15, 2021Updated 5 years ago
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- Shared personal notes created while working with the Apple MLX machine learning framework☆24Dec 12, 2025Updated 10 months ago
- CLI to demonstrate running a large language model (LLM) on Apple Neural Engine.☆131Dec 27, 2024Updated last year
- A toolkit for using rust with clojurescript☆12Dec 23, 2018Updated 7 years ago
- Version of the open bank, using Axon instead of Kafka.☆13Sep 1, 2022Updated 4 years ago
- MLX version of DINO DETR☆17Dec 26, 2024Updated last year
- An experimental browser REPL using re-frame☆12Mar 5, 2019Updated 7 years ago
- A repo of useful MLX skills.☆89Jan 25, 2026Updated 8 months ago
- Lossless DFlash speculative decoding for MLX on Apple Silicon☆789Aug 20, 2026Updated last month
- An MLX port of Meta's Coconut reasoning model☆16Sep 2, 2025Updated last year
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- Swift 6 agent SDK: type-safe tools, streaming, cloud + on-device inference via MLX on Apple Silicon☆35Sep 26, 2026Updated 3 weeks ago
- A Custom Calendar Designed in SwiftUI☆13Feb 1, 2022Updated 4 years ago
- Este repositorio sirve como guia para la tecnologia vista en el curso. El codigo presente no es absoluto y se puede considerar como plagi…☆23Sep 10, 2026Updated last month
- Almost backwards compatible alternative to Clojure 1.8.0 implementation of multimethods with roughly 1/10 the method lookup cost.☆14Aug 1, 2023Updated 3 years ago
- Run Time Series Foundation Models on Apple Silicon☆36Feb 27, 2026Updated 7 months ago
- Framework for neural network model creating, training and using in predicting written with use of Metal Performance Shaders☆31Sep 8, 2026Updated last month
- lithos-metal: high-performance LLM inference kernels and serving for Apple silicon.☆272Updated this week