Swift + Metal MoE inference for Apple Silicon: Qwen 3.6 35B at 23.5–29.3 tok/s decode with 2.20× faster long-prompt prefill on a 24 GB M5; Gemma 4 26B in ~2 GB, DeepSeek-V4-Flash 284B, Inkling-Small 276B, native Mac app, CLI, and OpenAI-compatible server.
☆122Nov 4, 2026Updated this week
Alternatives and similar repositories for Mference
Users that are interested in Mference are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- A simple CLI based tool to perform tasks with AI☆14Jun 21, 2026Updated 4 months ago
- Run large AI models fast on low RAM Mac's using SSD/NVM streaming.☆64Updated this week
- Local-first macOS AI workspace. Notch-native, 8 providers, your coding agents and their subagents in one place. ⌥Space anywhere.☆19Oct 28, 2026Updated last week
- Open-source voice companion firmware for the M5Stack StackChan (CoreS3, ESP32-S3): xiaozhi-based, Hermes Agent brain, anime faces, dance,…☆29Updated this week
- Run large Mixture-of-Experts language models well on the memory you have.☆21Oct 24, 2026Updated 2 weeks ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Run GPT-OSS-120B on a 16 GB Mac. Streams mixture-of-experts weights from SSD so only the 2 GiB trunk stays resident. Swift + Metal, no de…☆25Aug 7, 2026Updated 3 months ago
- ☆47Oct 19, 2026Updated 2 weeks ago
- llama.cpp fork for running Qwen3.8-Flash-Next V3 (95.5 GiB) on a 64 GB Apple Silicon Mac by streaming MoE experts from SSD. Setup guide: …☆13Sep 19, 2026Updated last month
- Run MoE models bigger than your RAM. Frontier-size MoE on a phone, laptop, edge. Lossless, on stock llama.cpp. An adaptive streaming opti…☆712Updated this week
- ☆12May 1, 2026Updated 6 months ago
- A workbench for language model research☆110Aug 9, 2026Updated 2 months ago
- Loom TUI and Character Lab for developing AI characters from base models: branch text, curate anthologies, simulate conversations, and ev…☆13Oct 4, 2026Updated last month
- free ai chat bridge to your pc☆13Aug 18, 2026Updated 2 months ago
- AI voice calibration plugin that learns your writing style through guided prompts and generates a reusable voice profile so agents can wr…☆13Sep 29, 2026Updated last month
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- Gemma 4 26B-A4B inference in ~2 GB of RAM on any M-series MacBook☆7,286Oct 26, 2026Updated last week
- 직장인 개발자를 위한 터미널 관심종목 뷰어 · 상사 오면 htop/vim으로 위장 · KOSPI/KOSDAQ 실시간(네이버)☆17Aug 27, 2026Updated 2 months ago
- ChatGPT Version Arrows v0.6.4☆28Updated this week
- Multi-dataset evaluation of Anthropic's J-Space on Qwen3-4B. Demonstrates that internal 'workspace noise' can reliably route high-confide…☆12Jul 13, 2026Updated 3 months ago
- method of training mamba for reasoning☆11Oct 28, 2026Updated last week
- Give your AI coding agent access to curated ML/AI knowledge.☆14Oct 5, 2026Updated last month
- SGLang is a high-performance serving framework for large language models and multimodal models.☆18Sep 11, 2026Updated last month
- A comfortable GUI for the Pi coding agent☆13Updated this week
- Code, prompts, protocols, and reproducibility materials for Substrates.☆17Sep 6, 2026Updated 2 months ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- A curated list of tools for LLM second brains / long-term memory — asking the community what they use☆14May 6, 2026Updated 6 months ago
- Fork of antirez/ds4 for Apple Silicon, tuned mostly for M1/M2: Qwen3.8-Flash-Next with 262K context on 64 GB and up, 35 tok/s on an M1 Ma…☆35Updated this week
- An experimental JEV-powered framework for forecasting short-term stock price direction from structured market data.☆16Sep 17, 2026Updated last month
- Memory system for LLMs that remembers everything you teach it during conversation. No reindexing, no context window limits. CPU by defaul…☆13May 2, 2026Updated 6 months ago
- Discord bot bridge for SillyTavern - Chat with your characters in real time!☆20May 30, 2026Updated 5 months ago
- A friendly Linux UI for local AI: chat, agent, models, backends, all in one☆20Updated this week
- Sample solution to build a deployment pipeline for Amazon SageMaker.☆14Jul 18, 2022Updated 4 years ago
- Local AI model manager☆16May 21, 2026Updated 5 months ago
- ☆13Nov 19, 2024Updated last year
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- High performance GPT-OSS MLX implementation☆39Aug 6, 2025Updated last year
- Zero-shot forecasting, tabular classification, and regression via MCP — exposes Google TimesFM 2.5 and TabFM v1.0.0 to AI assistants. Jus…☆32Sep 4, 2026Updated 2 months ago
- A chatbot built on a model that cannot generate text (TypeSafe AI's Jev, driven autoregressively)☆32Sep 17, 2026Updated last month
- Cube Basher - 3D Rougelite Bullet Hell Survival Game (Originally Vibecoded By Matt Wolfe and Claude Fable)☆14Jun 11, 2026Updated 4 months ago
- Unified Physical Grounding for Simulation-Ready 3D Assets☆56Sep 26, 2026Updated last month
- Obsidian community plugin: your vault as a private, self-hosted NotebookLM alternative. A built-in manager downloads and runs local AI mo…☆11Updated this week
- moderation is a profanity filter for Go☆14Feb 3, 2022Updated 4 years ago