Production LLM inference on the Apple Neural Engine — a practitioner's guide, complete with converters, Swift runtimes, and validated model manifests
☆47Jun 7, 2026Updated 5 months ago
Alternatives and similar repositories for ane-book
Users that are interested in ane-book are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- GEMMs with metal☆27Updated this week
- Tool for exporting Apple Neural Engine-accelerated versions of transformers models on HuggingFace Hub.☆16Jun 25, 2026Updated 4 months ago
- ☆37Mar 30, 2026Updated 7 months ago
- Triton‑style kernel toolkit for MLX plus a small upstream incubator: prototype, benchmark, and upstream fusions for Apple Silicon☆52Mar 31, 2026Updated 7 months ago
- DeepSeek-V4-Flash on a Raspberry Pi 5 (8GB)☆26Jun 9, 2026Updated 4 months ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- Minimal Claude Code alternative powered by MLX☆47Jan 11, 2026Updated 9 months ago
- ANE (Apple Neural Engine) CostModel profiler for CoreML models☆36Apr 9, 2026Updated 6 months ago
- ☆13Jan 31, 2024Updated 2 years ago
- LLM training on Apple's Neural Engine — native Obj-C, private APIs, zero GPU. Dynamic weight pipeline for training without kernel recompi…☆59Mar 17, 2026Updated 7 months ago
- Transformer inference via unconventional compute: a single algebraic primitive, a tag-system scheduler, and Apple's Neural Engine through…☆24Apr 26, 2026Updated 6 months ago
- ☆13Apr 8, 2026Updated 6 months ago
- An MLX implementation of Meta AI's ESM-2 protein language model☆16Aug 16, 2025Updated last year
- ☆29Oct 31, 2026Updated last week
- Minimal Docker/Compose front end for Apple's container, in Swift☆18Oct 11, 2026Updated 3 weeks ago
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- Userspace driver, matmul, and on-NPU op library for Rockchip NPUs (RK3588 & Subset on RK3576) via the mainline rocket DRM-accel driver☆23Updated this week
- ☆14Jun 17, 2026Updated 4 months ago
- ☆17Aug 16, 2026Updated 2 months ago
- A hands-on Swift and Metal course for building LLM inference from first principles on Apple silicon, with 48 guided lessons, runnable exe…☆194Jul 17, 2026Updated 3 months ago
- Research MIL-to-HWX compiler for the M4 Apple Neural Engine☆17Sep 3, 2026Updated 2 months ago
- Reference book on Arm Helium (M-Profile Vector Extension) for Cortex-M processors covering SIMD, DSP, and ML (educational)☆27Jun 16, 2025Updated last year
- Like readline but not copyleft☆24Updated this week
- Storing the LongCoT-mini results for RLM(GPT-5.2)☆20Apr 26, 2026Updated 6 months ago
- ☆86Mar 3, 2026Updated 8 months ago
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- ☆47Oct 4, 2026Updated last month
- The best benchmark for LLMs on Apple's MLX framework knowledge and coding tasks.☆38Jun 12, 2026Updated 4 months ago
- Qwen3.6/3.8-27B on one RTX 5090: 576K pooled context across 12 sessions at FP8-level quality from 5.75 bpw. EXL3 trellis weights, 4-bit t…☆29Oct 23, 2026Updated 2 weeks ago
- Yet Another Rockchip top-like Tool☆12Nov 9, 2025Updated 11 months ago
- Profile your CoreML models directly from Python 🐍☆29Sep 8, 2025Updated last year
- ☆12Jun 1, 2016Updated 10 years ago
- Python runtime for the Apple Neural Engine☆68Updated this week
- MLX (Apple Silicon) port of MiniMax-H3 video+audio and Pruna's P-H3-Image. Use it in Phosphene, the free Mac app: phosphene.video☆29Updated this week
- [experimental] Cross-platform UI framework using actual OS widgets: UIKit / AndroidViews / Win32 / AppKit / GTK☆18Updated this week
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- GLM-5.2 UD-Q2 decode speedup: CPU∥GPU MoE expert-split (harness, specs, de-risk)☆23Aug 9, 2026Updated 2 months ago
- TEVO: evolve LM motifs cheaply, then validate them in downstream train.py loops.☆20Apr 18, 2026Updated 6 months ago
- Training framework with a goal to explore the frontier of sample efficiency of small language models☆101Jan 25, 2026Updated 9 months ago
- Tile primitives for speedy kernels☆21Sep 13, 2026Updated last month
- Local AI runtime for training & running small LLMs directly on Apple Neural Engine (ANE). No CoreML. No Metal. Offline, on-device fine-tu…☆133Aug 23, 2026Updated 2 months ago
- Out-of-tree RKNPU kernel module for RK3588/RK3588S on mainline Linux 6.19+ — enables vendor RKNN SDK on modern kernels☆11Apr 16, 2026Updated 6 months ago
- ModernBERT model optimized for Apple Neural Engine.☆39Jan 10, 2025Updated last year