Inference engine for Intel devices. Serve LLMs, VLMs, Whisper, Kokoro-TTS, Embedding and Rerank models over OpenAI endpoints.
☆551Nov 16, 2026Updated this week
Alternatives and similar repositories for OpenArc
Users that are interested in OpenArc are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆590Updated this week
- Make use of Intel Arc Series GPU to Run Ollama, StableDiffusion, Whisper and Open WebUI, for image generation, speech recognition and int…☆430Nov 1, 2026Updated 2 weeks ago
- AI PC starter app for doing AI image creation, image stylizing, and chatbot on a PC powered by an Intel® Arc™ GPU.☆1,042Oct 30, 2026Updated 2 weeks ago
- ☆62Sep 14, 2026Updated 2 months ago
- The vLLM XPU kernels for Intel GPU☆83Updated this week
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- ☆76Updated this week
- Pinned Intel Arc Pro B60/B70 inference recipes, engine patches and measurement records: Qwen3.8-27B EXL3 on one card (262,144 context, 63…☆202Updated this week
- ☆208Updated this week
- Run Generative AI models with simple C++/Python API and using OpenVINO Runtime☆624Updated this week
- 🤗 Optimum Intel: Accelerate inference with Intel optimization tools☆631Updated this week
- Personal voice assistant, with voice interruption and Twilio support☆18Feb 24, 2025Updated last year
- A scalable inference server for models optimized with OpenVINO™☆962Updated this week
- Adapt IPEX to CUDA☆43Updated this week
- Plug-and-play llama.cpp runtime for Intel Arc GPUs. Auto-detects your card, picks safe SYCL defaults, and exposes an OpenAI-compatible AP…☆20Updated this week
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- An fully autonomous agent that accesses the browser and performs tasks.☆19Aug 17, 2026Updated 3 months ago
- Intel Arc firmware extracted from every consumer driver release publicly available.☆82Nov 4, 2026Updated 2 weeks ago
- Thin Intel XPU integration for upstream ComfyUI (A770/DG2 optimized custom node), extracted from intel/llm-scaler☆17Updated this week
- GLM-5.3-Flash with 152 of 288 experts per layer (RCO), for coding and agentic use on a home PC: recipe, mask, patches, evaluation harness☆14Oct 31, 2026Updated 2 weeks ago
- Fully automated installation scripts for ComfyUI optimized for Intel Arc GPUs (A-Series) and Intel Core Ultra iGPUs with XPU backend, Tri…☆162Feb 10, 2026Updated 9 months ago
- This repository contains Dockerfiles, scripts, yaml files, Helm charts, etc. used to scale out AI containers with versions of TensorFlow …☆78Sep 8, 2026Updated 2 months ago
- A curated list of OpenVINO based AI projects☆215Oct 19, 2026Updated last month
- OpenVINO Tokenizers extension☆60Updated this week
- Privacy-first agentic framework with powerful reasoning & task automation capabilities. Natively distributed and fully ISO 27XXX complian…☆66Apr 1, 2025Updated last year
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Get up and running with Llama 3.3, DeepSeek-R1, Phi-4, Gemma 3, Mistral Small 3.1 and other large language models.☆11Sep 11, 2026Updated 2 months ago
- Surgically de-slop LLMs☆15Jun 1, 2025Updated last year
- An inference engine built with SYCL + oneDNN☆34Updated this week
- ☆18Jul 1, 2025Updated last year
- BROKEN REPO. DO NOT USE UNDER ANY CIRCUMSTANCES☆20Oct 13, 2026Updated last month
- EXL3 (ExLlamaV3 trellis quantization) in stock SGLang and vLLM on RTX 3090 and Intel Arc B70, bit-exact with ExLlamaV3☆15Updated this week
- Accelerate local LLM inference and finetuning (LLaMA, Mistral, ChatGLM, Qwen, DeepSeek, Mixtral, Gemma, Phi, MiniCPM, Qwen-VL, MiniCPM-V,…☆8,840Jan 28, 2026Updated 9 months ago
- OpenVINO Intel NPU Compiler☆105Updated this week
- Reliable model swapping for any local AI server. Chosen by thousands of users. Batteries included. If we don't have it, you probably don…☆6,272Updated this week
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- Generate a llama-quantize command to copy the quantization parameters of any GGUF☆36Apr 20, 2026Updated 7 months ago
- A local-first LLM development studio. Build, test, and customize inference workflows with your own models — no cloud, totally local.☆17May 21, 2025Updated last year
- Run multiple resource-heavy Large Models (LM) on the same machine with limited amount of VRAM/other resources by exposing them on differe…☆88Updated this week
- My attempt at absolutely maxxing out my gaming PC for AI inference via the intel Arc B70 platform☆17Aug 26, 2026Updated 2 months ago
- Compose, manage, and run MCP servers as Docker containers. With a Unified API gateway built in.☆58Oct 9, 2025Updated last year
- OpenVINO™ is an open source toolkit for optimizing and deploying AI inference☆11,558Updated this week
- Implementation of Sesame's Conversational Speech Model for Hugging Face Transformers☆58May 17, 2025Updated last year
Are these results useful?