SearchSavior / OpenArcLinks
Lightweight Inference server for OpenVINO
☆198Updated this week
Alternatives and similar repositories for OpenArc
Users that are interested in OpenArc are comparing it to the libraries listed below
Sorting:
- A platform to self-host AI on easy mode☆159Updated 2 weeks ago
- InferX is a Inference Function as a Service Platform☆128Updated this week
- Sparse Inferencing for transformer based LLMs☆197Updated 2 weeks ago
- Run LLMs on AMD Ryzen™ AI NPUs. Just like Ollama - but purpose-built and deeply optimized for the AMD NPUs.☆129Updated last week
- Run multiple resource-heavy Large Models (LM) on the same machine with limited amount of VRAM/other resources by exposing them on differe…☆73Updated last week
- Open source LLM UI, compatible with all local LLM providers.☆174Updated 11 months ago
- ☆82Updated 5 months ago
- ☆84Updated last week
- llmbasedos — Local-First OS Where Your AI Agents Wake Up and Work☆271Updated this week
- Lightweight & fast AI inference proxy for self-hosted LLMs backends like Ollama, LM Studio and others. Designed for speed, simplicity and…☆77Updated this week
- 🚀 FlexLLama - Lightweight self-hosted tool for running multiple llama.cpp server instances with OpenAI v1 API compatibility and multi-GP…☆30Updated last month
- ☆162Updated 2 weeks ago
- Local LLM Powered Recursive Search & Smart Knowledge Explorer☆251Updated 6 months ago
- Enhancing LLMs with LoRA☆50Updated 2 weeks ago
- This is a cross-platform desktop application that allows you to chat with locally hosted LLMs and enjoy features like MCP support☆222Updated 2 weeks ago
- ☆168Updated last week
- Docs for GGUF quantization (unofficial)☆251Updated last month
- A web application that converts speech to speech 100% private☆75Updated 2 months ago
- ☆209Updated last month
- Local Qwen3 LLM inference. One easy-to-understand file of C source with no dependencies.☆102Updated last month
- Easy to use interface for the Whisper model optimized for all GPUs!☆274Updated 3 weeks ago
- reddacted lets you analyze & sanitize your online footprint using LLMs, PII detection & sentiment analysis to identify anything that migh…☆108Updated last month
- An OpenAI API compatible API for chat with image input and questions about the images. aka Multimodal.☆259Updated 5 months ago
- ☆221Updated 3 months ago
- Manifold is a platform for enabling workflow automation using AI assistants.☆457Updated 3 weeks ago
- Dia-JAX: A JAX port of Dia, the text-to-speech model for generating realistic dialogue from text with emotion and tone control.☆27Updated 3 months ago
- Privacy-first agentic framework with powerful reasoning & task automation capabilities. Natively distributed and fully ISO 27XXX complian…☆66Updated 4 months ago
- Chat WebUI is an easy-to-use user interface for interacting with AI, and it comes with multiple useful built-in tools such as web search …☆42Updated this week
- GPU Power and Performance Manager☆61Updated 10 months ago
- Llama.cpp runner/swapper and proxy that emulates LMStudio / Ollama backends☆44Updated this week