Inference engine for Intel devices. Serve LLMs, VLMs, Whisper, Kokoro-TTS, Embedding and Rerank models over OpenAI endpoints.
☆326Feb 22, 2026Updated last week
Alternatives and similar repositories for OpenArc
Users that are interested in OpenArc are comparing it to the libraries listed below
Sorting:
- Add genai backend for ollama to run generative AI models using OpenVINO Runtime.☆22Jun 20, 2025Updated 8 months ago
- AI PC starter app for doing AI image creation, image stylizing, and chatbot on a PC powered by an Intel® Arc™ GPU.☆756Feb 13, 2026Updated 2 weeks ago
- Implementation of Sesame's Conversational Speech Model for Hugging Face Transformers☆57May 17, 2025Updated 9 months ago
- Run multiple resource-heavy Large Models (LM) on the same machine with limited amount of VRAM/other resources by exposing them on differe…☆88Feb 7, 2026Updated 3 weeks ago
- A Field-Theoretic Approach to Unbounded Memory in Large Language Models☆20Apr 15, 2025Updated 10 months ago
- Since OpenAI and friends refuse to give us a max_ctx param in /models, here's the current context window, input token and output token li…☆65Dec 20, 2025Updated 2 months ago
- Autonomous, agentic, creative story writing system that incorporates stored embeddings and Knowledge Graphs.☆95Feb 16, 2026Updated last week
- ☆57Feb 8, 2026Updated 3 weeks ago
- Privacy-first agentic framework with powerful reasoning & task automation capabilities. Natively distributed and fully ISO 27XXX complian…☆68Apr 1, 2025Updated 11 months ago
- Zsh completion plugin for the LLM CLI tool by Simon Willison☆20May 28, 2025Updated 9 months ago
- A tutorial and trained model that can identify Aboriginal flags in images using PyTorch and Detecto☆11Oct 19, 2020Updated 5 years ago
- Browser extension to unhype/neutralise headers on the web☆73Aug 3, 2025Updated 6 months ago
- A web application that converts speech to speech 100% private☆84Jun 3, 2025Updated 8 months ago
- Mount an S3 bucket as an NFS filesystem to use it as a Docker or Docker Compose volume.☆11Updated this week
- ☆20Mar 20, 2025Updated 11 months ago
- Phoenix LiveView + HeadlessUI React web components☆13Nov 6, 2024Updated last year
- ☆159Feb 10, 2026Updated 2 weeks ago
- A library and CLI utilities for managing performance states of NVIDIA GPUs.☆33Oct 6, 2024Updated last year
- ☆92Dec 9, 2025Updated 2 months ago
- Efficient visual programming for AI language models☆360May 13, 2025Updated 9 months ago
- Notate is a desktop chat application that takes AI conversations to the next level. It combines the simplicity of chat with advanced feat…☆262Feb 25, 2025Updated last year
- Tools for easier OpenVINO development/debugging☆10Jul 16, 2025Updated 7 months ago
- Kafka broker for taskiq☆15Nov 25, 2025Updated 3 months ago
- ☆14Aug 25, 2024Updated last year
- A graph-native memory system for AI agents and context graphs. Store conversations, build knowledge graphs, and let your agents learn fro…☆41Updated this week
- CLI tool for generating and displaying mazes in the terminal☆12Aug 21, 2024Updated last year
- GraphRag vs Embeddings☆16Jul 14, 2024Updated last year
- ☆210Jan 5, 2026Updated last month
- SoTA open-source TTS☆151Dec 16, 2025Updated 2 months ago
- A open webui function for better R1 experience☆78Mar 7, 2025Updated 11 months ago
- ☆229May 7, 2025Updated 9 months ago
- LLM Inference on consumer devices☆130Mar 17, 2025Updated 11 months ago
- Running LLMs against a sandbox airport to see if they can make the correct decisions in real time☆25Jul 22, 2025Updated 7 months ago
- ☆13Oct 10, 2023Updated 2 years ago
- ScribePal is an Open Source intelligent browser extension that leverages AI to empower your web experience by providing contextual insigh…☆22Updated this week
- ☆153Updated this week
- llama.cpp fork with additional SOTA quants and improved performance☆1,696Updated this week
- Manifold is an experimental platform for enabling long horizon workflow automation using teams of AI assistants.☆482Updated this week
- Secure and local AI on your desktop with a built-in RAG knowledge base and Markdown note support.☆1,697Nov 5, 2025Updated 3 months ago