Native Apple Silicon inference engine for many AI agents at once: C++/Metal, agent-contexts API, 8-bit paged KV, SSD tier (Qwen3.8)
☆26Nov 8, 2026Updated this week
Alternatives and similar repositories for inferd
Users that are interested in inferd are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- LLM serving engines that SkyDiscover builds on the fly for specific AI models and hardware: Qwen3.6-35B-A3B, Qwen3.8-Flash-Next and Flint…☆39Nov 4, 2026Updated last week
- ☆19Mar 3, 2017Updated 9 years ago
- Minimal Claude Code alternative powered by MLX☆47Jan 11, 2026Updated 10 months ago
- Self-hosted live telemetry, alerts and benchmarks for NVIDIA DGX Spark (GB10) clusters☆11Updated this week
- Qwen3.8-27B on one laptop CPU: up to 2.52 token/s, 8 GB tested, no runtime accuracy loss. Native OpenAI-compatible API with function tool…☆23Sep 9, 2026Updated 2 months ago
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- MiniMax H3 text-to-video on the Apple Neural Engine — every DiT block as a raw MIL graph on a base 24GB M4☆14Aug 12, 2026Updated 2 months ago
- Local workload scheduler for autonomous agents sharing an Apple Silicon Mac.☆13Nov 4, 2026Updated last week
- MLTF: Qwen3.8-27B q8c inference for Apple Silicon☆14Oct 8, 2026Updated last month
- Raw-Metal inference engine for Qwen3.8-Flash-Next on Apple M5: EXL3 weights, MTP, OpenAI + Anthropic APIs☆12Oct 23, 2026Updated 2 weeks ago
- A simple tool to ensure compatibility between microservices☆16Jul 3, 2019Updated 7 years ago
- State-of-the-art, developer-friendly, open-source move testing framework.☆17Aug 16, 2026Updated 2 months ago
- A helper for working with Docker on CircleCI☆12May 20, 2016Updated 10 years ago
- 1 spark glm 5.3 flash☆11Sep 7, 2026Updated 2 months ago
- Source code for XTRIDE: "Practical Type Inference: High-Throughput Recovery of Real-World Structures and Function Signatures"☆25Jun 24, 2026Updated 4 months ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- LLM inference in C, compiled per model and per chip. Up to 14x faster.☆28Sep 7, 2026Updated 2 months ago
- Rust-host continuation of DwarfStar for explicit, hardware-validated large-model inference on DGX-Spark.☆19Updated this week
- Fork of qemu android emulator with aarch64 support.☆22Aug 21, 2019Updated 7 years ago
- MLX (Apple Silicon) port of MiniMax-H3 video+audio and Pruna's P-H3-Image. Use it in Phosphene, the free Mac app: phosphene.video☆29Updated this week
- Tutum node inside a container or Vagrant box☆19Dec 14, 2015Updated 10 years ago
- Auto researching harness that burns through everything.☆69Updated this week
- Low-level Metal inference engine for Apple M4: universal quant formats at MLX parity, 1M-token out-of-core contexts, and speculative deco…☆26Sep 5, 2026Updated 2 months ago
- One place to run all your coding agents in parallel - debug in the built-in browser, edit in the built-in IDE, and verify every change w…☆22Updated this week
- ☆36Jan 7, 2026Updated 10 months ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- ☆30Updated this week
- An opinionated and efficient automated software-factory☆30Updated this week
- Your agent says it's done. ShipBash shows you it works.☆12Oct 16, 2026Updated 3 weeks ago
- Synthetic users that walk your software before real users do.☆16Updated this week
- Local-first agent that drives Claude Code and Codex over ACP. Desktop app, git-URL plugins, A2A 1.0. MIT.☆17Updated this week
- 红薯AI养号助手，浏览器插件，小红书自动养号，点赞，收藏，AI评论！☆24Oct 9, 2025Updated last year
- Source code of Local Code, a private AI agent for Mac, iPad and iPhone. Runs DeepSeek 4.1 on device, with Python, Node.js and a shell bu…☆128Updated this week
- ☆19Nov 23, 2015Updated 10 years ago
- An opinionated linter for SKILL.md files☆15May 27, 2026Updated 5 months ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- Agent Usage Detail Record — an open JSON standard for attributing and costing agent runs☆15Updated this week
- Prospero coding harness☆182Updated this week
- Main power meter☆11Jun 15, 2024Updated 2 years ago
- Inspired by autoresearch but for finance☆21Mar 17, 2026Updated 7 months ago
- RESO Tools - a toolkit for working with RESO servers and clients☆20Updated this week
- An MLX port of Meta's Coconut reasoning model☆16Sep 2, 2025Updated last year
- An environment where open models work as agents: a first-level harness with routing, skills, memory and sandboxed tools, on an engine tha…☆74Updated this week
Are these results useful?