Run transformers directly on Apple's Neural Engine in Swift bypass coreml entirely
☆171Sep 12, 2026Updated last week
Alternatives and similar repositories for Espresso
Users that are interested in Espresso are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Compress tool outputs, logs, files, and RAG chunks before they reach the LLM. 60-95% fewer tokens, same answers☆30May 19, 2026Updated 4 months ago
- Apple Neural Engine (ANE) LLM inference engine — reverse-engineered private APIs, Metal GPU shaders, hybrid ANE+GPU+CPU on Apple Silicon.…☆28Mar 5, 2026Updated 6 months ago
- Local AI runtime for training & running small LLMs directly on Apple Neural Engine (ANE). No CoreML. No Metal. Offline, on-device fine-tu…☆122Aug 23, 2026Updated 3 weeks ago
- ANE (Apple Neural Engine) CostModel profiler for CoreML models☆36Apr 9, 2026Updated 5 months ago
- Swift SDK for running chat, vision and speech models on iPhone and Mac with Apple's Core AI. Model download and caching, FoundationModels…☆105Updated this week
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- Deterministic graph runtime for agent workflows in Swift. Same input, same output, every time — golden-testable, checkpoint-resumable, an…☆25May 17, 2026Updated 4 months ago
- 🚀 LLM inference Engine in Swift/Metal, Load GGUF and safe tensors modes, no conversion, no cpp, pure swift☆49May 19, 2026Updated 4 months ago
- ☆86Mar 3, 2026Updated 6 months ago
- ☆45Mar 5, 2026Updated 6 months ago
- ☆20Apr 12, 2026Updated 5 months ago
- An on device Agent Runtime☆23May 13, 2026Updated 4 months ago
- Shared Single-file memory layer for all your agents, sub mili-second RAG over text, photo and video on Apple Silicon.. No Server. No API.…☆799Updated this week
- ☆223Mar 24, 2026Updated 5 months ago
- DFlash block-diffusion speculative decoding running on Apple Silicon via MLX, with an ANE execution path that explores heterogeneous acce…☆61Apr 18, 2026Updated 5 months ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Playwright for Swift is a browser automation library to control Chromium, Firefox and WebKit with a single API.☆92May 8, 2026Updated 4 months ago
- Type-safe tools, on-device inference, multi-agent workflows, memory, and guardrails, in one Swift-native runtime☆581Updated this week
- Reverse engineered the Apple Neural Engine, with working Python and Objective C samples☆39Feb 1, 2026Updated 7 months ago
- Run Time Series Foundation Models on Apple Silicon☆36Feb 27, 2026Updated 6 months ago
- A custom replacement for UISplitViewController that's customizable and can present detail VCs with different structure and format.☆15Feb 7, 2017Updated 9 years ago
- A minimal, un-opinionated agent library for Swift providing conversation and tool calling☆16May 20, 2026Updated 4 months ago
- A comprehensive AI & ML project portfolio from the University of Texas at Austin PG Program, demonstrating real-world data science and ma…☆18Jan 25, 2026Updated 7 months ago
- Flash-MoE sidecar slot-bank runtime for large GGUF MoE models on Apple Silicon — llama.cpp fork☆134Sep 4, 2026Updated 2 weeks ago
- Debug On Device AI, Capture Hardware state and AI Output☆19Jun 16, 2026Updated 3 months ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- A Swift client for Hugging Face Hub and Inference Providers APIs☆175Updated this week
- 🦑 Unified Swift SDK for LLM inference across local and cloud providers☆120Jun 13, 2026Updated 3 months ago
- Swift library for working with Extended Backus–Naur Form (EBNF) notation and grammars.☆28Jan 20, 2026Updated 8 months ago
- Demo app for my talk at SG Conf '25☆13Jan 17, 2025Updated last year
- ☆37Mar 30, 2026Updated 5 months ago
- PMetal: high-performance Apple Silicon framework for local LLM inference, LoRA/QLoRA fine-tuning, serving, quantization, and MLX/Metal ac…☆316Updated this week
- A Swift package that enables customisation of UIKit's table or collection view swipe actions.☆20Jun 26, 2025Updated last year
- Downloadable models and conversion recipes for Apple's Core AI on iPhone and Mac. Chat, vision, speech and generative models with per-mod…☆438Updated this week
- Artificial Neural Engine Machine Learning Library☆1,675Updated this week
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- End-to-end encrypted chat for iOS/macOS with Curve25519 key agreement, AES-256-GCM, voice messages, polls, and reactions.☆14Jul 29, 2026Updated last month
- Matcha – brew beautiful TUIs at Swift speed.☆66Jul 30, 2025Updated last year
- A high-performance, Swift-native file system watcher for macOS and iOS that provides intelligent monitoring of directory changes with min…☆70May 24, 2026Updated 3 months ago
- A minimalistic Swift implementation of the Jinja templating engine, specifically designed for parsing and rendering ML chat templates.☆132Updated this week
- Make views live.☆63May 11, 2026Updated 4 months ago
- Minimalist repo to do mlx vlm constrained decoding in batch mode☆19Apr 11, 2026Updated 5 months ago
- segment person sample on iOS☆22Jul 15, 2022Updated 4 years ago