Reproducible on-device LLM benchmarks for Apple Silicon (iPhone 17 Pro, M4 Max): Apple Core AI, MLX, llama.cpp, LiteRT-LM and Core ML on the same model and harness, every number with its quantization and capture session; hybrid Mamba-2 models (Nemotron-3 Nano, Granite-4.0-H, Falcon-H1) included.
☆67Sep 8, 2026Updated this week
Alternatives and similar repositories for apple-silicon-llm-bench
Users that are interested in apple-silicon-llm-bench are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Community model zoo for Apple Core AI (iOS/macOS 27): 66 models — LLM, VLM, OCR, ASR, TTS, image/video/music gen, forecasting — each gate…☆415Updated this week
- Run LLMs, VLMs, ASR, TTS, diarization and more fully on-device with Apple's Core AI framework (iOS/macOS 27) — one line of Swift per mode…☆48Updated this week
- The best benchmark for LLMs on Apple's MLX framework knowledge and coding tasks.☆38Jun 12, 2026Updated 3 months ago
- Model export recipes, Python primitives, and Swift runtime utilities for on-device AI☆2,085Updated this week
- Low-level command-line tool for measuring CPU and Metal GPU memory bandwidth, synthetic LLM decode and prefill memory traffic, cache and …☆19Sep 6, 2026Updated last week
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- Swift package for reading and writing Safetensors files.☆13Feb 6, 2026Updated 7 months ago
- A UIView that magnifies the point under your finger so users can drag precisely on small targets.☆17Jun 14, 2023Updated 3 years ago
- Missing Xcode Tools Documentation☆66Updated this week
- 👨💻 Update a pinned gist to contain random IDE shortcut☆14Dec 20, 2025Updated 8 months ago
- Multi-LoRA inference server for Apple Silicon -- one base model, many adapters, zero reload☆20Apr 13, 2026Updated 5 months ago
- DFlash block-diffusion speculative decoding running on Apple Silicon via MLX, with an ANE execution path that explores heterogeneous acce…☆61Apr 18, 2026Updated 4 months ago
- In fluid dynamics, an eddy is the swirling of a fluid and the reverse current created when the fluid is in a turbulent flow regime.☆19Jul 23, 2026Updated last month
- Production harness for Apple Foundation Models on iOS, macOS, and visionOS☆42Jul 31, 2026Updated last month
- ☆13Apr 2, 2024Updated 2 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Collection of useful utilities for working with Google Cloud Storage.☆13Dec 9, 2022Updated 3 years ago
- Cantonese Grapheme-to-Phoneme Converter based on GitYCC/g2pW☆15Dec 10, 2024Updated last year
- Train Embedding Models on MLX.☆17Jun 2, 2026Updated 3 months ago
- Agent Skill to help convert transformer LLMs to mlx-lm☆51Jun 16, 2026Updated 2 months ago
- A repo of useful MLX skills.☆89Jan 25, 2026Updated 7 months ago
- A simple GPT-3 interface to automate core legal writing tasks☆13Mar 8, 2023Updated 3 years ago
- Simple LLM package for ios devices.☆37May 28, 2026Updated 3 months ago
- ☆37Mar 30, 2026Updated 5 months ago
- Your dev horoscope by Foundation Models☆17Jun 7, 2026Updated 3 months ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- A native macOS app for voice dictation anywhere. An open-source alternative to Wispr Flow and Superwhisper. Press and hold Fn (or a custo…☆32Updated this week
- ☆23Aug 19, 2026Updated 3 weeks ago
- Persistent memory for OpenAI Codex CLI — powered by Supermemory☆48Sep 3, 2026Updated last week
- Privacy-first AI voice keyboard for iPhone and iPad that turns speech into ready-to-send text. Local models, no servers, no tracking, ful…☆31Sep 2, 2026Updated last week
- Code for the paper Learning Exposure Correction via Consistency Modeling (BMVC 2021)☆15Oct 29, 2021Updated 4 years ago
- This repo maintains a 'cheat sheet' for LLMs that are undertrained on mlx☆33Mar 12, 2026Updated 6 months ago
- ☆11Nov 2, 2024Updated last year
- Fully local voice AI for iOS☆98Apr 2, 2026Updated 5 months ago
- AI agent skill for Claude Code, Copilot, Cursor, Codex & Gemini — correct focus management for tvOS, iOS, macOS, visionOS & watchOS☆20Aug 31, 2026Updated last week
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- A tool to automatically detect memory leaks☆17Jan 14, 2025Updated last year
- A SwiftUI library that provides a debug menu for viewing and copying LanguageModelSession transcripts.☆19Updated this week
- Run LLMs on Apple devices with CoreML, optimized for Apple Neural Engine + GPU☆192Jun 8, 2026Updated 3 months ago
- Moshi-Finetune-MLX lets you fine-tune Moshi (Native, Real-Time, Speech-to-Speech) models all on Apple Silicon.☆26Apr 21, 2026Updated 4 months ago
- Turn written web content into a podcast feed!☆31Oct 23, 2024Updated last year
- Tree-based speculative decoding for Apple Silicon (MLX). ~10-15% faster than DFlash on code, ~1.5x over autoregressive. First MLX port wi…☆145Apr 15, 2026Updated 4 months ago
- EdgeConnect for iOS implemented using CoreML.☆42Feb 1, 2019Updated 7 years ago