Run transformers directly on Apple's Neural Engine in Swift bypass coreml entirely
☆168Aug 24, 2026Updated last week
Alternatives and similar repositories for Espresso
Users that are interested in Espresso are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Compress tool outputs, logs, files, and RAG chunks before they reach the LLM. 60-95% fewer tokens, same answers☆30May 19, 2026Updated 3 months ago
- Local AI runtime for training & running small LLMs directly on Apple Neural Engine (ANE). No CoreML. No Metal. Offline, on-device fine-tu…☆115Aug 23, 2026Updated last week
- Apple Neural Engine (ANE) LLM inference engine — reverse-engineered private APIs, Metal GPU shaders, hybrid ANE+GPU+CPU on Apple Silicon.…☆24Mar 5, 2026Updated 5 months ago
- Deterministic graph runtime for agent workflows in Swift. Same input, same output, every time — golden-testable, checkpoint-resumable, an…☆25May 17, 2026Updated 3 months ago
- Run LLMs, VLMs, ASR, TTS, diarization and more fully on-device with Apple's Core AI framework (iOS/macOS 27) — one line of Swift per mode…☆41Updated this week
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- 🚀 LLM inference Engine in Swift/Metal, Load GGUF and safe tensors modes, no conversion, no cpp, pure swift☆48May 19, 2026Updated 3 months ago
- ☆86Mar 3, 2026Updated 5 months ago
- ☆45Mar 5, 2026Updated 5 months ago
- ☆19Apr 12, 2026Updated 4 months ago
- Shared Single-file memory layer for all your agents, sub mili-second RAG over text, photo and video on Apple Silicon.. No Server. No API.…☆790Updated this week
- ☆222Mar 24, 2026Updated 5 months ago
- DFlash block-diffusion speculative decoding running on Apple Silicon via MLX, with an ANE execution path that explores heterogeneous acce…☆61Apr 18, 2026Updated 4 months ago
- Playwright for Swift is a browser automation library to control Chromium, Firefox and WebKit with a single API.☆92May 8, 2026Updated 3 months ago
- Type-safe tools, on-device inference, multi-agent workflows, memory, and guardrails, in one Swift-native runtime☆572Updated this week
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- Reverse engineered the Apple Neural Engine, with working Python and Objective C samples☆39Feb 1, 2026Updated 6 months ago
- Run Time Series Foundation Models on Apple Silicon☆36Feb 27, 2026Updated 6 months ago
- A custom replacement for UISplitViewController that's customizable and can present detail VCs with different structure and format.☆15Feb 7, 2017Updated 9 years ago
- A minimal, un-opinionated agent library for Swift providing conversation and tool calling☆16May 20, 2026Updated 3 months ago
- A comprehensive AI & ML project portfolio from the University of Texas at Austin PG Program, demonstrating real-world data science and ma…☆18Jan 25, 2026Updated 7 months ago
- Debug On Device AI, Capture Hardware state and AI Output☆19Jun 16, 2026Updated 2 months ago
- A Swift client for Hugging Face Hub and Inference Providers APIs☆171Jul 29, 2026Updated last month
- 🦑 Unified Swift SDK for LLM inference across local and cloud providers☆121Jun 13, 2026Updated 2 months ago
- Swift library for working with Extended Backus–Naur Form (EBNF) notation and grammars.☆28Jan 20, 2026Updated 7 months ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- Demo app for my talk at SG Conf '25☆13Jan 17, 2025Updated last year
- ☆36Mar 30, 2026Updated 5 months ago
- PMetal: high-performance Apple Silicon framework for local LLM inference, LoRA/QLoRA fine-tuning, serving, quantization, and MLX/Metal ac…☆310Jun 5, 2026Updated 2 months ago
- Community model zoo for Apple Core AI (iOS/macOS 27): 62 models — LLM, VLM, OCR, ASR, TTS, image/video/music gen, forecasting — each gate…☆399Updated this week
- A Swift package that enables customisation of UIKit's table or collection view swipe actions.☆20Jun 26, 2025Updated last year
- Artificial Neural Engine Machine Learning Library☆1,650Mar 10, 2026Updated 5 months ago
- End-to-end encrypted chat for iOS/macOS with Curve25519 key agreement, AES-256-GCM, voice messages, polls, and reactions.☆15Jul 29, 2026Updated last month
- Matcha – brew beautiful TUIs at Swift speed.☆66Jul 30, 2025Updated last year
- Minimalist repo to do mlx vlm constrained decoding in batch mode☆18Apr 11, 2026Updated 4 months ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- A high-performance, Swift-native file system watcher for macOS and iOS that provides intelligent monitoring of directory changes with min…☆70May 24, 2026Updated 3 months ago
- A minimalistic Swift implementation of the Jinja templating engine, specifically designed for parsing and rendering ML chat templates.☆132Jul 21, 2026Updated last month
- Make views live.☆63May 11, 2026Updated 3 months ago
- segment person sample on iOS☆22Jul 15, 2022Updated 4 years ago
- LLMs and VLMs with MLX Swift☆794Updated this week
- Run LLMs on Apple devices with CoreML, optimized for Apple Neural Engine + GPU☆181Jun 8, 2026Updated 2 months ago
- Run ops on Apple ANE in NPU register with pure python on M1 Asahi Linux. No Espresso, No CoreML, no metal, no .mlmodels file, no .hwx fil…☆19Jun 28, 2026Updated 2 months ago