Run LLMs on Apple devices with CoreML, optimized for Apple Neural Engine + GPU
☆203Oct 5, 2026Updated 3 weeks ago
Alternatives and similar repositories for CoreML-LLM
Users that are interested in CoreML-LLM are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Custom converter: open-weight Hugging Face LLMs/VLMs -> on-device LiteRT-LM (.litertlm), with one-command reproduction☆29Updated this week
- Downloadable models and conversion recipes for Apple's Core AI on iPhone and Mac. Chat, vision, speech and generative models with per-mod…☆464Updated this week
- Swift SDK for running chat, vision and speech models on iPhone and Mac with Apple's Core AI. Model download and caching, FoundationModels…☆123Updated this week
- ANE (Apple Neural Engine) CostModel profiler for CoreML models☆36Apr 9, 2026Updated 6 months ago
- Converted TFLite Model Zoo for Android with LiteRT CompiledModel GPU acceleration☆26Updated this week
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- Exact speculative decoding on Apple Silicon, powered by MLX.☆389Apr 20, 2026Updated 6 months ago
- ☆13Sep 18, 2025Updated last year
- Local AI runtime for training & running small LLMs directly on Apple Neural Engine (ANE). No CoreML. No Metal. Offline, on-device fine-tu…☆133Aug 23, 2026Updated 2 months ago
- Reproducible on-device LLM benchmarks for Apple Silicon (iPhone 17 Pro, M4 Max): Apple Core AI, MLX, llama.cpp, LiteRT-LM and Core ML on …☆73Oct 18, 2026Updated last week
- ☆237Jun 11, 2026Updated 4 months ago
- DFlash block-diffusion speculative decoding running on Apple Silicon via MLX, with an ANE execution path that explores heterogeneous acce…☆61Apr 18, 2026Updated 6 months ago
- Model export recipes, Python primitives, and Swift runtime utilities for on-device AI☆2,233Updated this week
- 3.34× faster inference on Apple Silicon: native MLX port of DFlash speculative decoding☆19Oct 7, 2026Updated 3 weeks ago
- ☆14Jun 17, 2026Updated 4 months ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Core ML model zoo for iOS/macOS — PyTorch models converted to ready-to-use .mlpackage, each with a conversion script and SwiftUI sample a…☆1,892Updated this week
- import documents for LLMs☆49Updated this week
- LLMs and VLMs with MLX Swift☆850Updated this week
- Run transformers directly on Apple's Neural Engine in Swift bypass coreml entirely☆173Sep 12, 2026Updated last month
- Render deformable 3D Gaussian Splats using Metal on Apple platforms☆25Mar 8, 2026Updated 7 months ago
- ☆12Sep 11, 2026Updated last month
- Swift package for reading and writing Safetensors files.☆13Feb 6, 2026Updated 8 months ago
- vLLM Metal plugin powered by mlx-swift — high-performance LLM inference on Apple Silicon☆274Jun 3, 2026Updated 4 months ago
- A modular Swift SDK for audio processing with MLX on Apple Silicon☆811Updated this week
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Kokoro TTS for iOS and macOSX☆294Jan 10, 2026Updated 9 months ago
- A Swift Package for using OpenUSD, Pixar's Universal Scene Description☆88Oct 1, 2026Updated 3 weeks ago
- Swift package for real-time speech-to-text transcription with Apple SpeechAnalyzer and SpeechTranscriber on iOS 26 and macOS 26.☆167Aug 31, 2026Updated last month
- A browser agent for iOS and macOS that a person can take over at any time. Real WKWebView, small on-device models, a native SwiftUI panel…☆40Updated this week
- MLX Model Quantization Toolkit - Comprehensive collection of Jupyter notebooks for converting and quantizing large language models usi…☆15Aug 16, 2025Updated last year
- A simple cache for Swift☆18Mar 20, 2026Updated 7 months ago
- Frontier CoreML audio models in your apps — text-to-speech, speech-to-text, voice activity detection, and speaker diarization. In Swift, …☆3,232Updated this week
- A library for PyTorch model compression and optimizations for deployment via Core AI on Apple silicon.☆152Updated this week
- Flash-MoE sidecar slot-bank runtime for large GGUF MoE models on Apple Silicon — llama.cpp fork☆134Oct 7, 2026Updated 3 weeks ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Your dev horoscope by Foundation Models☆18Jun 7, 2026Updated 4 months ago
- A UIView that magnifies the point under your finger so users can drag precisely on small targets.☆17Jun 14, 2023Updated 3 years ago
- Tool for exporting Apple Neural Engine-accelerated versions of transformers models on HuggingFace Hub.☆16Jun 25, 2026Updated 4 months ago
- ☆13Apr 2, 2024Updated 2 years ago
- Simple LLM package for ios devices.☆36May 28, 2026Updated 5 months ago
- ⚡ Native MLX Swift LLM inference server for Apple Silicon. OpenAI-compatible API, SSD streaming for 100B+ MoE models, TurboQuant KV cache…☆792Updated this week
- 🚀 Tired of your Mac feeling sluggish? Fear not! MacCleaner is here to save the day! 🧹 Clean up your system clutter and optimize perform…☆15Jun 8, 2024Updated 2 years ago