Inference engine for Intel devices. Serve LLMs, VLMs, Whisper, Kokoro-TTS, Embedding and Rerank models over OpenAI endpoints.
☆346Mar 17, 2026Updated this week
Alternatives and similar repositories for OpenArc
Users that are interested in OpenArc are comparing it to the libraries listed below
Sorting:
- Personal voice assistant, with voice interruption and Twilio support☆18Feb 24, 2025Updated last year
- AI PC starter app for doing AI image creation, image stylizing, and chatbot on a PC powered by an Intel® Arc™ GPU.☆780Mar 12, 2026Updated last week
- ☆193Updated this week
- Local runner for Microsoft VibeVoice Realtime TTS Fully compatible with Open-Webui Plug and Play. OpenAI api endpoint .Run the Colab note…☆31Mar 13, 2026Updated last week
- Run multiple resource-heavy Large Models (LM) on the same machine with limited amount of VRAM/other resources by exposing them on differe…☆90Updated this week
- An OpenAI API compatible FastAPI server that sits on top of the Anemll repo. Tested with Open WebUI.☆20Jan 21, 2026Updated 2 months ago
- Privacy-first agentic framework with powerful reasoning & task automation capabilities. Natively distributed and fully ISO 27XXX complian…☆68Apr 1, 2025Updated 11 months ago
- ☆19Aug 19, 2025Updated 7 months ago
- A web application that converts speech to speech 100% private☆84Jun 3, 2025Updated 9 months ago
- OpenVINO Tokenizers extension☆49Updated this week
- ☆41Feb 14, 2026Updated last month
- A one command Voice AI deployment script for MacOS. Supports Sesame, Kokoro, Spark, Zonos and Whisper. Creates an api server with OpenAI …☆23Mar 19, 2025Updated last year
- Surgically de-slop LLMs☆14Jun 1, 2025Updated 9 months ago
- ☆93Dec 9, 2025Updated 3 months ago
- A Field-Theoretic Approach to Unbounded Memory in Large Language Models☆20Apr 15, 2025Updated 11 months ago
- ☆202Mar 31, 2025Updated 11 months ago
- ☆30Aug 28, 2023Updated 2 years ago
- ☆49Updated this week
- llama.cpp fork with additional SOTA quants and improved performance☆1,846Updated this week
- Since OpenAI and friends refuse to give us a max_ctx param in /models, here's the current context window, input token and output token li…☆67Dec 20, 2025Updated 3 months ago
- Reliable model swapping for any local OpenAI/Anthropic compatible server - llama.cpp, vllm, etc☆2,868Updated this week
- An fully autonomous agent that accesses the browser and performs tasks.☆18Apr 25, 2025Updated 10 months ago
- ScribePal is an Open Source intelligent browser extension that leverages AI to empower your web experience by providing contextual insigh…☆22Mar 5, 2026Updated 2 weeks ago
- ☆14Aug 25, 2024Updated last year
- Developer kits reference setup scripts for various kinds of Intel platforms and GPUs☆43Updated this week
- Dia-JAX: A JAX port of Dia, the text-to-speech model for generating realistic dialogue from text with emotion and tone control.☆29May 7, 2025Updated 10 months ago
- Intel® AI Super Builder☆166Updated this week
- ☆114Updated this week
- ☆58Feb 8, 2026Updated last month
- A meta-framework for self-improving LLMs with transparent reasoning☆36Dec 10, 2025Updated 3 months ago
- Run Orpheus 3B Locally with Gradio UI, Standalone App☆23Apr 1, 2025Updated 11 months ago
- See the device (CPU/GPU/ANE) and estimated cost for every layer in your CoreML model.☆25Oct 23, 2025Updated 4 months ago
- GraphRag vs Embeddings☆16Jul 14, 2024Updated last year
- Force more aggressive GC behaviour☆20Oct 9, 2022Updated 3 years ago
- A library and CLI utilities for managing performance states of NVIDIA GPUs.☆34Oct 6, 2024Updated last year
- Easy to use interface for the Whisper model optimized for all GPUs!☆501Feb 15, 2026Updated last month
- OpenAI compatible TTS for Sesame CSM:1b & dia:1.6b - Voice Cloning from File/YT☆434Sep 26, 2025Updated 5 months ago
- ☆229May 7, 2025Updated 10 months ago
- A native macOS AI chat app powered by MLX. 100% local inference on Apple Silicon, no cloud required. Built with ShipSwift.☆1,716Updated this week