Swiftlet is a Swift and Metal runtime that runs large Qwen Mixture-of-Experts models locally on Apple devices by streaming expert weights from storage, enabling 35B and 80B models to run with low RAM, including on iPhone.
☆667Nov 2, 2026Updated this week
Alternatives and similar repositories for Swiftlet
Users that are interested in Swiftlet are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Gemma 4 26B-A4B inference in ~2 GB of RAM on any M-series MacBook☆7,286Oct 26, 2026Updated last week
- Private, local transcription and system-wide dictation for Apple Silicon.☆222Updated this week
- Wardnet is a self-hosted network privacy gateway that runs on linux (docker or bare metal). It sits alongside an existing home or small-o…☆26Updated this week
- Run a 105 GB AI model on a Mac that can't hold it. Qwen3.8-Flash-Next 4-bit, streamed from SSD on 16–64 GB Apple Silicon Macs. Fully nati…☆652Updated this week
- ☆158Aug 15, 2026Updated 2 months ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- MiniMax H3 inference engine for Mac computers☆3,032Aug 11, 2026Updated 2 months ago
- Free, open source voice dictation for macOS. On-device transcription with Apple's Speech framework. No cloud/no API keys/no account.☆466Updated this week
- Nativ is an open-source local AI app for Mac. It runs open AI models on Apple Silicon, and nothing leaves your Mac.☆1,576Updated this week
- Your car as a chat-room agent: Raspberry Pi 5 + dashcam + local AI. CodeWatch's sibling for the garage.☆303Oct 9, 2026Updated 3 weeks ago
- Desktop provider switcher for Claude Code and Codex. Keep every endpoint, API key, and model in one place, switch the active provider in …☆17Updated this week
- An offline CLI for turning life goals into quests☆72Jul 11, 2026Updated 3 months ago
- Browser System With Zero HTML/CSS/JS☆30Aug 28, 2026Updated 2 months ago
- ☆95Aug 19, 2026Updated 2 months ago
- A deep-research agent with an enforced budget, verified quotes, and a privacy boundary for local data.☆318Updated this week
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Millisecond decisions, any domain: a 0.8B open "System 1" model that picks between your options with calibrated probabilities. One base, …☆1,582Updated this week
- The runtime for a personal assistant☆438Updated this week
- browse hackernews like a hacker☆150Oct 1, 2026Updated last month
- 一个小而精美的桌面打印工具，把图片、Office 文档、PDF 等文件直接拖进去一键打印，省去逐个打开文件再点打印的麻烦（跨平台 mac/windows） 。☆16Aug 7, 2026Updated 3 months ago
- Multimodal visual memory search on macOS☆524Updated this week
- CPU-first LLM inference server on llama.cpp. Runs useful models on free-tier ARM boxes; rewriting the input made it ~6x faster and more a…☆114Oct 12, 2026Updated 3 weeks ago
- A menu bar app that keeps a written record of what you worked on.☆207Oct 17, 2026Updated 2 weeks ago
- ☆221Oct 27, 2026Updated last week
- Handwritten notes and a whiteboard in your browser. Write with a pen, keep the pdf next to your notes. No account, nothing leaves the bro…☆74Oct 13, 2026Updated 3 weeks ago
- End-to-end encrypted email - Proton Mail • AdSpecial offer: 40% Off Yearly / 80% Off First Month. All Proton services are open source and independently audited for security.
- make your framework hinge rusty (wow it's also written in rust too)☆57Jul 30, 2026Updated 3 months ago
- A Python framework for self-hosted LLM tool-calling and multi-step agentic workflows☆2,265Updated this week
- Give coding agents a disposable Linux VM, not your laptop☆1,038Aug 13, 2026Updated 2 months ago
- 🛰️ Real-time fleet tracking, smart alerts, and sensor analytics☆36Updated this week
- This project simulates cassette tape audio profiles using ffmpeg☆521Sep 9, 2026Updated last month
- Run full Kimi K3 on a single device. And an OpenAI-compatible API server for local chat and coding agents.☆857Oct 4, 2026Updated last month
- One zero-dependency MCP gateway CLI for every server and agent skill. Token optimization, tool discovery and context compression: 71,929 …☆422Updated this week
- macOS menubar app that visually rotates or spins another app's window, using ScreenCaptureKit to fake what macOS has no API to do☆50Oct 9, 2026Updated 3 weeks ago
- Run large AI models across your computers and servers. Powered by Colibri. Pure C.☆213Updated this week
- Open source password manager - Proton Pass • AdSecurely store, share, and autofill your credentials with Proton Pass, the end-to-end encrypted password manager trusted by millions.
- A hierarchical inference engine for frontier MoE models: hot experts on the GPU (CUDA, Vulkan), warm ones in RAM, cold ones streamed from…☆48,363Updated this week
- A native macOS UI for Apple's platform☆1,629Oct 27, 2026Updated last week
- Secure encrypted one-time secret sharing for clearnet and Tor onion services☆33Jun 15, 2026Updated 4 months ago
- Your personal AI agent in your own Cloudflare account. Chat, memory, tasks, notes and scheduled reminders, deployed with one command: npx…☆1,444Updated this week
- Run the full 2.78-trillion-parameter Kimi K3 model, DeepSeek V4.1 Flash or GLM-5.3-Flash beyond available RAM by streaming activated weig…☆2,537Sep 18, 2026Updated last month
- Backchannel brings the internet's conversations into whatever you're reading. It blends Hacker News, Bluesky, Reddit, and more into a sin…☆265Updated this week
- Manage OpenClaw in your team (Enterprise) by providing it compute infrastructure, tool integration, Authentication and security primitiv…☆62Jul 13, 2026Updated 3 months ago