Run transformers directly on Apple's Neural Engine in Swift bypass coreml entirely
☆173Sep 12, 2026Updated last month
Alternatives and similar repositories for Espresso
Users that are interested in Espresso are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Compress tool outputs, logs, files, and RAG chunks before they reach the LLM. 60-95% fewer tokens, same answers☆30May 19, 2026Updated 5 months ago
- Local AI runtime for training & running small LLMs directly on Apple Neural Engine (ANE). No CoreML. No Metal. Offline, on-device fine-tu…☆133Aug 23, 2026Updated 2 months ago
- Deterministic graph runtime for agent workflows in Swift. Same input, same output, every time — golden-testable, checkpoint-resumable, an…☆26May 17, 2026Updated 5 months ago
- ANE (Apple Neural Engine) CostModel profiler for CoreML models☆36Apr 9, 2026Updated 6 months ago
- Apple Neural Engine (ANE) LLM inference engine — reverse-engineered private APIs, Metal GPU shaders, hybrid ANE+GPU+CPU on Apple Silicon.…☆33Oct 2, 2026Updated 3 weeks ago
- Open source password manager - Proton Pass • AdSecurely store, share, and autofill your credentials with Proton Pass, the end-to-end encrypted password manager trusted by millions.
- MiniMax H3 text-to-video on the Apple Neural Engine — every DiT block as a raw MIL graph on a base 24GB M4☆14Aug 12, 2026Updated 2 months ago
- An on device Agent Runtime☆23May 13, 2026Updated 5 months ago
- Debug On Device AI, Capture Hardware state and AI Output☆19Jun 16, 2026Updated 4 months ago
- Swift SDK for running chat, vision and speech models on iPhone and Mac with Apple's Core AI. Model download and caching, FoundationModels…☆123Updated this week
- Research MIL-to-HWX compiler for the M4 Apple Neural Engine☆17Sep 3, 2026Updated last month
- ☆86Mar 3, 2026Updated 7 months ago
- ☆28Oct 12, 2026Updated 2 weeks ago
- Shared Single-file memory layer for all your agents, sub mili-second RAG over text, photo and video on Apple Silicon.. No Server. No API.…☆806Oct 1, 2026Updated 3 weeks ago
- ☆17Apr 17, 2026Updated 6 months ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- Type-safe tools, on-device inference, multi-agent workflows, memory, and guardrails, in one Swift-native runtime☆587Oct 2, 2026Updated 3 weeks ago
- Tool for exporting Apple Neural Engine-accelerated versions of transformers models on HuggingFace Hub.☆16Jun 25, 2026Updated 4 months ago
- Run Time Series Foundation Models on Apple Silicon☆36Feb 27, 2026Updated 8 months ago
- Run ops on Apple ANE in NPU register with pure python on M1 Asahi Linux. No Espresso, No CoreML, no metal, no .mlmodels file, no .hwx fil…☆21Oct 8, 2026Updated 3 weeks ago
- LLM inference on Apple Neural Engine (ANE)☆146Mar 4, 2026Updated 7 months ago
- ☆20Apr 12, 2026Updated 6 months ago
- Pure Swift CLI to sync, search, and classify your X/Twitter bookmarks locally. Uses Safari session cookies, SQLite FTS5 for full-text s…☆13Apr 8, 2026Updated 6 months ago
- A Swift package for typed decisions from language models (probabilities, choices, and scores), with support for local MLX models and the …☆42Oct 17, 2026Updated 2 weeks ago
- Reverse engineered the Apple Neural Engine, with working Python and Objective C samples☆40Feb 1, 2026Updated 8 months ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Artificial Neural Engine Machine Learning Library☆1,704Sep 18, 2026Updated last month
- ☆227Mar 24, 2026Updated 7 months ago
- Playwright for Swift is a browser automation library to control Chromium, Firefox and WebKit with a single API.☆94May 8, 2026Updated 5 months ago
- Apple Silicon GPU DVFS reverse engineering: voltage corners, CLPC frequency control, Metal benchmarks☆69Updated this week
- ☆47Oct 4, 2026Updated 3 weeks ago
- 🦑 Unified Swift SDK for LLM inference across local and cloud providers☆121Jun 13, 2026Updated 4 months ago
- DFlash block-diffusion speculative decoding running on Apple Silicon via MLX, with an ANE execution path that explores heterogeneous acce…☆61Apr 18, 2026Updated 6 months ago
- Downloadable models and conversion recipes for Apple's Core AI on iPhone and Mac. Chat, vision, speech and generative models with per-mod…☆464Updated this week
- PMetal: high-performance Apple Silicon framework for local LLM inference, LoRA/QLoRA fine-tuning, serving, quantization, and MLX/Metal ac…☆331Updated this week
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Tool for visual profiling Core ML models, compatible with both package and compiled versions, including reasons for unsupported operation…☆39Jun 18, 2024Updated 2 years ago
- 670 MB/s Swift tokenizer inspired by Marcel Roed’s gigatoken. Zero-copy, NEON/CRC32, WebAssembly, and Embedded Swift.☆30Jul 31, 2026Updated 3 months ago
- Python runtime for the Apple Neural Engine☆67Oct 7, 2026Updated 3 weeks ago
- Zoni is a comprehensive, production-ready RAG framework built with Swift 6.0 🦝☆45Jun 2, 2026Updated 4 months ago
- Build your own NSVisualEffectView☆15Oct 4, 2020Updated 6 years ago
- A minimal, un-opinionated agent library for Swift providing conversation and tool calling☆17May 20, 2026Updated 5 months ago
- ☆14Jun 17, 2026Updated 4 months ago