Rust-native hybrid training & inference engine for Apple Neural Engine + Metal GPU
☆184Apr 3, 2026Updated 7 months ago
Alternatives and similar repositories for rustane
Users that are interested in rustane are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Minimalist repo to do mlx vlm constrained decoding in batch mode☆20Apr 11, 2026Updated 7 months ago
- ANE (Apple Neural Engine) CostModel profiler for CoreML models☆36Apr 9, 2026Updated 7 months ago
- LLM inference on Apple Neural Engine (ANE)☆147Mar 4, 2026Updated 8 months ago
- A unified library of SOTA model optimization techniques like quantization, distillation, pruning, neural architecture search, speculative…☆11Updated this week
- Run a coding model at 300+ tok/s on your Mac. Native Rust + Metal inference engine for LiquidAI LFM2.5-24B-A2B (MLX 4-bit) on Apple Silic…☆25Oct 29, 2026Updated 2 weeks ago
- End-to-end encrypted email - Proton Mail • AdSpecial offer: 40% Off Yearly / 80% Off First Month. All Proton services are open source and independently audited for security.
- Apple Neural Engine (ANE) LLM inference engine — reverse-engineered private APIs, Metal GPU shaders, hybrid ANE+GPU+CPU on Apple Silicon.…☆34Oct 2, 2026Updated last month
- A MLX port of FLUX based on the Huggingface Diffusers implementation.☆20Sep 20, 2026Updated last month
- Quick and dirty benchmarking tool to measure the performance of RK3588 NPU.☆12Feb 23, 2024Updated 2 years ago
- DFlash block-diffusion speculative decoding running on Apple Silicon via MLX, with an ANE execution path that explores heterogeneous acce…☆62Apr 18, 2026Updated 6 months ago
- Local AI runtime for training & running small LLMs directly on Apple Neural Engine (ANE). No CoreML. No Metal. Offline, on-device fine-tu…☆134Aug 23, 2026Updated 2 months ago
- Training neural networks on Apple Neural Engine via reverse-engineered private APIs☆7,302Mar 10, 2026Updated 8 months ago
- Classify Amazon apparel products and make recommendations based on images, title and brand information.☆10Jan 5, 2021Updated 5 years ago
- Unofficial Rust bindings to Apple's mlx framework☆389Nov 5, 2026Updated last week
- ☆521Jul 8, 2026Updated 4 months ago
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- ☆15Jan 8, 2023Updated 3 years ago
- Apple Silicon (MLX) port of Karpathy's autoresearch — autonomous AI research loops on Mac, no PyTorch required.☆1,892Jul 2, 2026Updated 4 months ago
- Production LLM inference on the Apple Neural Engine — a practitioner's guide, complete with converters, Swift runtimes, and validated mod…☆47Jun 7, 2026Updated 5 months ago
- ☆229Mar 24, 2026Updated 7 months ago
- Exact speculative decoding on Apple Silicon, powered by MLX.☆390Apr 20, 2026Updated 6 months ago
- EXO Gym is an open-source Python toolkit that facilitates distributed AI research.☆119Dec 1, 2025Updated 11 months ago
- Llama-architecture models (SmolLM2 135M, 360M, 1.7B) in Bend 2, token for token against PyTorch, with the shapes in the types☆16Updated this week
- Run Time Series Foundation Models on Apple Silicon☆36Feb 27, 2026Updated 8 months ago
- Fine-tune LLMs on your Mac with Apple Silicon. SFT, DPO, GRPO, Vision, TTS, STT, Embedding, and OCR fine-tuning — natively on MLX. Unslot…☆1,468Jun 23, 2026Updated 4 months ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- AI agent that helps you learn Tinygrad and updates you on the bounties☆14Aug 5, 2025Updated last year
- Native Swift AI agent SDK for iOS and macOS with ChatGPT sign-in. No API keys required. Streaming, app-defined tools, and SQLite or Realm…☆34Updated this week
- GEMMs with metal☆27Nov 1, 2026Updated last week
- ☆13Jan 31, 2024Updated 2 years ago
- KAN (Kolmogorov–Arnold Networks) in the MLX framework for Apple Silicon☆31Jun 18, 2025Updated last year
- vana-claim☆10Dec 16, 2024Updated last year
- A powerful command-line OCR tool built with Apple's Vision framework, supporting single image and batch processing with detailed position…☆12Apr 3, 2026Updated 7 months ago
- Apple Silicon GPU DVFS reverse engineering: voltage corners, CLPC frequency control, Metal benchmarks☆73Oct 30, 2026Updated last week
- Demo of an "always-on" AI assistant.☆23Feb 14, 2024Updated 2 years ago
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- Open-source SM120 (Blackwell) SASS assembler — encode, schedule & assemble GPU machine code, including all tensor-core instructions.☆14Updated this week
- vLLM Metal plugin powered by mlx-swift — high-performance LLM inference on Apple Silicon☆274Jun 3, 2026Updated 5 months ago
- Matrix multiplication and LLM serving kernels for RK3588 RKNPU2. (like FlashInfer but for RKNPU2!)☆21Nov 4, 2026Updated last week
- A novel hybrid AI architecture leveraging Titan's-like memory and HRM-like reasoning☆26Aug 28, 2026Updated 2 months ago
- ☆47Oct 4, 2026Updated last month
- ☆38Aug 19, 2026Updated 2 months ago
- ☆35Aug 10, 2025Updated last year
Are these results useful?