Apple Neural Engine (ANE) LLM inference engine — reverse-engineered private APIs, Metal GPU shaders, hybrid ANE+GPU+CPU on Apple Silicon. 32 tok/s matching llama.cpp, 3.6 TFLOPS fused ANE mega-kernels.
☆22Mar 5, 2026Updated 4 months ago
Alternatives and similar repositories for ane-infer
Users that are interested in ane-infer are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ANE (Apple Neural Engine) CostModel profiler for CoreML models☆33Apr 9, 2026Updated 3 months ago
- Install, update and remove AppImage from your CLI. appimage, linux, package-manager☆19May 21, 2025Updated last year
- Local AI runtime for training & running small LLMs directly on Apple Neural Engine (ANE). No CoreML. No Metal. Offline, on-device fine-tu…☆110Mar 6, 2026Updated 4 months ago
- Windows Slop Remover.☆89Jun 21, 2026Updated 3 weeks ago
- Train and run transformers directly on Apple's Neural Engine in Swift bypass coreml entirely☆153Updated this week
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Apple's Neural Engine - bare metal access☆43Jul 2, 2026Updated 2 weeks ago
- Linux kernel source tree☆28Updated this week
- XVI - Ethereum execution client☆16Feb 25, 2026Updated 4 months ago
- Vault-0: Agent Security, Monitor & x402 Wallet for OpenClaw. Encrypted secret vault, real-time agent monitor, policy enforcement, and nat…☆15Feb 13, 2026Updated 5 months ago
- The Ultimate Offense & Defense Duality – Linux Kernel Rootkit and Its Perfect Cure☆16Apr 22, 2026Updated 2 months ago
- ☆42Mar 5, 2026Updated 4 months ago
- A comprehensive framework and node for developing, deploying, and interacting with smart contracts written in Rust and Solidity (includin…☆20Oct 3, 2025Updated 9 months ago
- Go SDK and CLI for LM Studio: manage, interact, and run LLMs via WebSocket API☆12Sep 8, 2025Updated 10 months ago
- Add some encryption to your sensitive preferences☆11Feb 1, 2018Updated 8 years ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- A Rust rewrite of FastKMeans for CPU-based clustering☆17Jun 29, 2026Updated 3 weeks ago
- The most advanced, lightweight, and undetectable C++ open-source utility client base for Minecraft. Built with ImGui and modular architec…☆26Mar 21, 2026Updated 3 months ago
- Stealth HTTPS forward proxy with automatic Let's Encrypt TLS and nginx camouflage☆27Mar 18, 2026Updated 4 months ago
- grep for context, not just text. Local-first CLI for searching documents, notes, memories, and project context.☆26Mar 8, 2026Updated 4 months ago
- Interactive multi-agent NCA ecosystem simulation☆86Apr 15, 2026Updated 3 months ago
- A minimal, type-safe, runtime-agnostic async DAG executor with compile-time dependency validation☆24Feb 20, 2026Updated 5 months ago
- ☆26Jul 12, 2025Updated last year
- A macOS app for running parallel AI agents in sandboxed local VMs☆21May 18, 2026Updated 2 months ago
- macOS Seatbelt sandbox CLI for developers. Protect credentials (SSH, AWS, GPG) from malicious npm packages, supply chain attacks, and unt…☆24Updated this week
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- A CLI in Rust to generate synthetic data for MLX friendly training☆26Jan 13, 2024Updated 2 years ago
- PyTorch-equivalent deep learning framework in pure Rust — 22 crates, CUDA GPU, vision, LLMs, ONNX, autograd, distributed training☆28Jun 28, 2026Updated 3 weeks ago
- A brand new take on a self-hosted music streaming platform.☆11Jan 15, 2026Updated 6 months ago
- Flashing/updating Samsung S24 Ultra (and other devices) with Heimdall from Mac or Linux☆16Oct 27, 2024Updated last year
- Mr Free SMS Sender - MrTools☆14May 4, 2023Updated 3 years ago
- A high-performance Rust trading bot that performs arbitrage between Pacifica (maker) and Hyperliquid (taker). The bot continuously monito…☆18Jun 13, 2026Updated last month
- MCP that combats tools overload☆23Aug 9, 2025Updated 11 months ago
- Bridges PyTorch and Core AI. Convert existing models to Core AI IR, or author new ones from PyTorch via composite ops, custom op lowering…☆121Updated this week
- Heuristic device integrity signals for Flutter (root/jailbreak, emulator/simulator, Frida/hook, debugger) – Android & iOS☆16Jul 6, 2026Updated 2 weeks ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Tiny, low-memory footprint generic enum handling library for .NET that provides high-performance validation, parsing/formatting and bitwi…☆15Feb 25, 2026Updated 4 months ago
- Pure-Rust LLM runtime: one binary serves (OpenAI-compatible), runs local agents, and distills models on their own rollouts — on Apple Sil…☆20Updated this week
- Rust implementation of Google's TurboQuant algorithm for vector quantization☆36Mar 25, 2026Updated 3 months ago
- Tool-native dataset generation skill for Codex, Claude Code, and Antigravity with SFT/DPO pipelines, verification, deduplication, and fle…☆18Jun 20, 2026Updated last month
- ☆86Mar 3, 2026Updated 4 months ago
- Stateless Ethereum block validation☆26Updated this week
- The most comprehensive guard clause & validation ecosystem for .NET☆15Jun 29, 2026Updated 3 weeks ago