Rust-native hybrid training & inference engine for Apple Neural Engine + Metal GPU
☆181Apr 3, 2026Updated 6 months ago
Alternatives and similar repositories for rustane
Users that are interested in rustane are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- LLM training on Apple's Neural Engine — native Obj-C, private APIs, zero GPU. Dynamic weight pipeline for training without kernel recompi…☆59Mar 17, 2026Updated 7 months ago
- Minimalist repo to do mlx vlm constrained decoding in batch mode☆19Apr 11, 2026Updated 6 months ago
- ANE (Apple Neural Engine) CostModel profiler for CoreML models☆35Apr 9, 2026Updated 6 months ago
- REAP expert pruning for MoE LLMs on Apple Silicon via MLX☆58Mar 16, 2026Updated 7 months ago
- Source-grounded MCP memory runtime and Obsidian-compatible vault template for LLM agents.☆76Updated this week
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- GLM-5.2 NVFP4+AQLM on 3× DGX Spark — 380k context MTP serve stack☆72Aug 2, 2026Updated 2 months ago
- Train Embedding Models on MLX.☆17Jun 2, 2026Updated 4 months ago
- DFlash block-diffusion speculative decoding running on Apple Silicon via MLX, with an ANE execution path that explores heterogeneous acce…☆61Apr 18, 2026Updated 6 months ago
- ☆38Mar 30, 2026Updated 6 months ago
- ☆395May 8, 2026Updated 5 months ago
- Local AI runtime for training & running small LLMs directly on Apple Neural Engine (ANE). No CoreML. No Metal. Offline, on-device fine-tu…☆130Aug 23, 2026Updated last month
- A ChatGPT-like app using Alibaba's Qwen3.5 models locally on the phone - with tool calling & vision☆60Jul 22, 2026Updated 2 months ago
- Unofficial Rust bindings to Apple's mlx framework☆382Oct 3, 2026Updated 2 weeks ago
- Training neural networks on Apple Neural Engine via reverse-engineered private APIs☆7,270Mar 10, 2026Updated 7 months ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Run ops on Apple ANE in NPU register with pure python on M1 Asahi Linux. No Espresso, No CoreML, no metal, no .mlmodels file, no .hwx fil…☆21Oct 8, 2026Updated last week
- Apple Silicon (MLX) port of Karpathy's autoresearch — autonomous AI research loops on Mac, no PyTorch required.☆1,866Jul 2, 2026Updated 3 months ago
- A minimal, un-opinionated agent library for Swift providing conversation and tool calling☆16May 20, 2026Updated 4 months ago
- ☆521Jul 8, 2026Updated 3 months ago
- Fine-tune LLMs on your Mac with Apple Silicon. SFT, DPO, GRPO, Vision, TTS, STT, Embedding, and OCR fine-tuning — natively on MLX. Unslot…☆1,443Jun 23, 2026Updated 3 months ago
- ☆15Jan 8, 2023Updated 3 years ago
- CodexKit is an iOS SDK for building OpenAI-powered Codex agents with secure auth, threaded runtime state, streaming responses, and host-d…☆32Updated this week
- Run Time Series Foundation Models on Apple Silicon☆36Feb 27, 2026Updated 7 months ago
- ☆46Oct 4, 2026Updated 2 weeks ago
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- An iOS kernel debugger based on a KTRR bypass for A11 iPhones; works with LLDB and IDA Pro.☆15Oct 30, 2025Updated 11 months ago
- Running a big model on a small laptop☆58Mar 28, 2026Updated 6 months ago
- Rust CLI for RBMEM (.rbmem), a structured Rust-Brain memory format with timestamp-protected sections, hierarchy, graph relations, Hermes …☆28Jun 14, 2026Updated 4 months ago
- Local release tool that reuses your GitHub Actions workflow YAML to build via nektos/act when CI queues are throttled, then uploads artif…☆77Updated this week
- Exact speculative decoding on Apple Silicon, powered by MLX.☆389Apr 20, 2026Updated 5 months ago
- Strategies for BentoBox☆11Mar 9, 2023Updated 3 years ago
- vLLM Metal plugin powered by mlx-swift — high-performance LLM inference on Apple Silicon☆274Jun 3, 2026Updated 4 months ago
- Minimal Claude Code alternative powered by MLX☆47Jan 11, 2026Updated 9 months ago
- Train Large Language Models on MLX.☆434Updated this week
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- ☆25Mar 16, 2026Updated 7 months ago
- One-stop on-device diffusion image-generation engine for iOS / macOS / visionOS. Embeds stable-diffusion.cpp + ggml-metal behind a tight …☆21Sep 8, 2026Updated last month
- ☆13Apr 24, 2023Updated 3 years ago
- Automated hyperparameter search for optimal Gabliteration configurations on large language models☆49Mar 10, 2026Updated 7 months ago
- ☆91Oct 9, 2026Updated last week
- ☆41Oct 8, 2026Updated last week
- A novel hybrid AI architecture leveraging Titan's-like memory and HRM-like reasoning☆27Aug 28, 2026Updated last month