Pinned Intel Arc Pro B60/B70 inference recipes, engine patches and measurement records: Qwen3.8-27B EXL3 on one card (262,144 context, 63 tok/s; MTP3 measured lossy on 27% of a fixed 329-item set), Nemotron Bolt 74B, Flash-Next, dual-card routes, and a machine-checked catalog where each speculative row states whether the drafter changes the answ…
☆193Nov 5, 2026Updated this week
Alternatives and similar repositories for intel-arc-pro-b70-inference-cookbook
Users that are interested in intel-arc-pro-b70-inference-cookbook are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Reproducible Qwen3.8-27B GPTQ INT4 + MTP4 inference on Intel Arc Pro B70 using vLLM XPU — 84.65 tok/s median.☆47Sep 9, 2026Updated last month
- EXL3 (exllamav3 trellis) inference on Intel Arc Battlemage: bit-exact ESIMD kernels as a vLLM XPU plugin☆38Sep 26, 2026Updated last month
- ☆75Updated this week
- Agent Skills for running, benchmarking, and profiling Hugging Face models on Intel GPUs — PyTorch, vLLM-XPU, and SGLang-XPU☆50Updated this week
- Plug-and-play llama.cpp runtime for Intel Arc GPUs. Auto-detects your card, picks safe SYCL defaults, and exposes an OpenAI-compatible AP…☆19Updated this week
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Custom fan curves + GPU power/clock tuning for Intel Arc Pro B60/B70 (Battlemage) on Linux. Confirmed on Arc Pro B60 (8086:e211).☆36Jul 9, 2026Updated 3 months ago
- Intel Arc LLM inference server (A770/B60): Qwen hybrids up to Qwen3.8-Flash-Next (512-expert MoE through an expert cache in VRAM and host…☆26Updated this week
- ☆22Sep 1, 2026Updated 2 months ago
- Inference engine for Intel GPUs based on SYCL☆13Updated this week
- Benchmark results and performance data for the Intel Arc Pro B70 GPU (Xe2/Battlemage) - LLM inference, video generation, dual-GPU scaling…☆98Apr 22, 2026Updated 6 months ago
- ☆589Updated this week
- Local LLM stack on Intel Arc Pro B70 (USB4 eGPU): llama.cpp SYCL build + llama-swap, wired to opencode and pi☆11Oct 28, 2026Updated last week
- Install Pi on your local unixy OS without sandbox but with peace of mind☆16Jun 18, 2026Updated 4 months ago
- Inference engine for Intel devices. Serve LLMs, VLMs, Whisper, Kokoro-TTS, Embedding and Rerank models over OpenAI endpoints.☆548Oct 13, 2026Updated 3 weeks ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- A unified library of SOTA model optimization techniques like quantization, distillation, pruning, neural architecture search, speculative…☆11Oct 13, 2026Updated 3 weeks ago
- ☆16Oct 20, 2026Updated 2 weeks ago
- AI runtime optimized for agentic work with Qwen models on AMD RX 7900 XT/XTX☆22Updated this week
- ☆13Updated this week
- Recipe for running vLLM productively on Radeon PRO V620 (Navi 21 / gfx1030) on Linux. Multiple Qwen models supported.☆21Sep 6, 2026Updated 2 months ago
- Qwen 3.8 27B on a $1,400 Strix Halo: frozen optimal config, 262k needle-exact retrieval, vision fixed, delegation-card certified☆14Updated this week
- ☆26Oct 14, 2026Updated 3 weeks ago
- Personal voice assistant, with voice interruption and Twilio support☆18Feb 24, 2025Updated last year
- DeepSeek 4 Flash and PRO local inference engine for Metal, CUDA and ROCm☆17Oct 22, 2026Updated 2 weeks ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Per-session analytics for Hermes Desktop: tokens, cache, cost, failures, files — plus Ask AI analysis☆15Sep 27, 2026Updated last month
- Run the AEON Bench suite on your own hardware: verified HuggingFace pull → serve → benchmark (text · agentic ×3 harnesses · vision · audi…☆25Oct 6, 2026Updated last month
- An experimental and feature-rich inference engine built on top of llama.cpp☆83Updated this week
- An inference engine built with SYCL + oneDNN☆33Aug 31, 2026Updated 2 months ago
- ☆28Sep 27, 2026Updated last month
- Terminal braille rendering library for images, animation, and expressive CLI graphics.☆12Oct 7, 2026Updated 3 weeks ago
- pi extension to empower a curl request with coding agent capabilities (slopcoded)☆10Apr 28, 2026Updated 6 months ago
- Unified KV-cache compression for LLM inference: 12 Python-native methods, guarded add-on composition and routing, analytical capacity sim…☆30Oct 10, 2026Updated 3 weeks ago
- ROCmFPX Family for AMD Hardware and Processors. More quants and special agent quants☆432Oct 22, 2026Updated 2 weeks ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- Your favorite Terminal Coding Agent, now in Rust & a Breakdown of the Claude Code leak & discoveries☆14Apr 1, 2026Updated 7 months ago
- Point Of Sales made in C# using SQL Server. This is just a School Project.☆13Aug 5, 2022Updated 4 years ago
- A locally running AI image blocker for Chrome☆46Aug 31, 2026Updated 2 months ago
- llama.cpp fork for GSQ-quantized Qwen3.8-Flash-Next on AMD Strix Halo (gfx1151): faster ROCm prefill, MTP and 4×256K chats with Q8_0 KV a…☆11Oct 11, 2026Updated 3 weeks ago
- Decentralizing exports in Julia☆15Jul 29, 2020Updated 6 years ago
- llama.cpp setup on dedicated AMD Strix Halo machine☆14Jul 26, 2026Updated 3 months ago
- ☆13Updated this week