Low-level Metal inference engine for Apple M4: universal quant formats at MLX parity, 1M-token out-of-core contexts, and speculative decode off flash storage.
☆26Sep 5, 2026Updated last month
Alternatives and similar repositories for m4-prefill-engine
Users that are interested in m4-prefill-engine are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- MLX (Apple Silicon) port of MiniMax-H3 — 33B joint video+audio diffusion. Validated against the diffusers reference; AdaLN precompute dro…☆28Oct 8, 2026Updated last week
- ☆15Feb 3, 2026Updated 8 months ago
- ☆19Sep 6, 2026Updated last month
- Qwen3.8-27B on one laptop CPU: up to 2.52 token/s, 8 GB tested, no runtime accuracy loss. Native OpenAI-compatible API with function tool…☆21Sep 9, 2026Updated last month
- ☆50Updated this week
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- Blazing-fast PR reviewer☆28Updated this week
- a very simple object oriented node module for wrapping the ffmpeg command line app☆11Jun 1, 2011Updated 15 years ago
- Native iOS client for MicYou: use your iPhone or iPad as a microphone for your PC.☆37Updated this week
- Ternary Bonsai 2 27B MLX inference speedup benchmark engine☆34Oct 10, 2026Updated last week
- Introduce some smooth and free android emulator for develop. （开发神器 — 一些免费流畅的Android模拟器）☆14Apr 30, 2015Updated 11 years ago
- This repository is only for distributing build artifacts of the ZWPlayer player.☆18Sep 11, 2026Updated last month
- Retty: 终端的无缝接力 , iOS | macOS☆24Updated this week
- A local-first research viewer for medical image volumes, with optional advanced processing engines.☆43Sep 6, 2026Updated last month
- A local CLI, built on ccusage, that syncs your token usage with everyone else.☆83Updated this week
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- ☆39Updated this week
- A Swift package for rendering View with swift-markdown☆21Oct 3, 2026Updated 2 weeks ago
- An open source coding agent whose only tool is a durable code REPL, with tools and recursive subagents called from code. Forked from Open…☆26Updated this week
- ☆140Sep 21, 2026Updated 3 weeks ago
- Iris-3B pixel-space text-to-image on Apple Silicon GPUs: Metal-optimized engine, native macOS app, CLI, Python and local HTTP API☆56Updated this week
- ☆27Oct 12, 2026Updated last week
- A Swift implementation of the Xet protocol☆31Oct 12, 2026Updated last week
- State-of-the-art, developer-friendly, open-source move testing framework.☆17Aug 16, 2026Updated 2 months ago
- face-detect.cpp is a from-scratch C++17 port of the insightface buffalo face-recognition pipeline, built on ggml.☆30Jun 29, 2026Updated 3 months ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- A native Mac app that captures any region, marks it up, and frames it for sharing.☆30Updated this week
- MiniMax-H3 on single DGX Spark: keys Sol-Engine ports + Heretic TE + Spectrum/Sage speed + 0.5MP upscaler finish. Formal bench included.☆49Aug 23, 2026Updated last month
- HyperSkill: Self-Evolving LLM Agents via Hypergraph-Structured Skill Memory☆41Aug 16, 2026Updated 2 months ago
- Device-agnostic web bench for Feetech servo characterization and configuration☆16Aug 9, 2026Updated 2 months ago
- Qwen3.8-27b and Qwen3.6-35B-A3B local inference engine for Vulkan and Metal☆71Updated this week
- Source code for XTRIDE: "Practical Type Inference: High-Throughput Recovery of Real-World Structures and Function Signatures"☆26Jun 24, 2026Updated 3 months ago
- A collaborative training library☆38Jul 4, 2026Updated 3 months ago
- Vesuvius Challenge Ink Crackle Labeling Tool for Scroll Segmentations☆11Nov 25, 2024Updated last year
- Fork of qemu android emulator with aarch64 support.☆22Aug 21, 2019Updated 7 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- An embedded, openCypher-compatible graph workspace for Python & Node.js☆54Updated this week
- Cuplivo — community fork of Kelivo: a cross-platform LLM chat client with LAN sync, manual-first image compression and persistent input d…☆81Updated this week
- OpenAI-compatible speech serving in Rust: streaming TTS and full-duplex voice over GPT-Live. 128 concurrent PersonaPlex sessions on one G…☆47Sep 30, 2026Updated 2 weeks ago
- The most ghetto installer you will ever lay eyes on☆14Aug 1, 2012Updated 14 years ago
- lm15 for Python: one request and response model for every AI model provider. The reference implementation; standard library only. pip ins…☆30Updated this week
- Pure Zig implementation of Jinja2 templating. Bytecode compilation, 40+ filters, template inheritance, macros, autoescaping, and sandboxi…☆64Sep 28, 2026Updated 3 weeks ago
- Identity Crisis Pro is your personal agent for building and managing digital identities. A desktop application built in electron to aid i…☆62Sep 28, 2026Updated 3 weeks ago