SearchSavior / OpenArc
Lightweight Inference server for OpenVINO
☆143Updated this week
Alternatives and similar repositories for OpenArc:
Users that are interested in OpenArc are comparing it to the libraries listed below
- Open source LLM UI, compatible with all local LLM providers.☆173Updated 6 months ago
- Turns devices into a scalable LLM platform☆127Updated last week
- ☆66Updated last month
- ☆159Updated last week
- Local LLM Powered Recursive Search & Smart Knowledge Explorer☆230Updated last month
- Run multiple resource-heavy Large Models (LM) on the same machine with limited amount of VRAM/other resources by exposing them on differe…☆55Updated last month
- ☆83Updated 3 months ago
- Cohere Toolkit is a collection of prebuilt components enabling users to quickly build and deploy RAG applications.☆28Updated 2 months ago
- transparent proxy server on demand model swapping for llama.cpp (or any local OpenAPI compatible server)☆475Updated this week
- A Conversational Speech Generation Model with Gradio UI and OpenAI compatible API. UI and API support CUDA, MLX and CPU devices.☆143Updated this week
- Orpheus Chat WebUI☆32Updated this week
- ☆197Updated 2 weeks ago
- A frontend for creative writing with LLMs☆122Updated 8 months ago
- The Fastest Way to Fine-Tune LLMs Locally☆285Updated last week
- GPU Power and Performance Manager☆57Updated 5 months ago
- A Discord bot for large language models. Add Gemini, Sonnet-3.7 DeepSeek R-1, and other models. Easily change models, edit prompts, and e…☆75Updated last week
- Serving LLMs in the HF-Transformers format via a PyFlask API☆71Updated 6 months ago
- Manifold is a platform for enabling workflow automation using AI assistants.☆358Updated this week
- klmbr - a prompt pre-processing technique to break through the barrier of entropy while generating text with LLMs☆71Updated 6 months ago
- A fast batching API to serve LLM models☆183Updated 11 months ago
- RetroChat is a powerful command-line interface for interacting with various AI language models. It provides a seamless experience for eng…☆72Updated 3 months ago
- An extension that lets the AI take the wheel, allowing it to use the mouse and keyboard, recognize UI elements, and prompt itself :3...no…☆115Updated 5 months ago
- ☆52Updated this week
- CaSIL is an advanced natural language processing system that implements a sophisticated four-layer semantic analysis architecture. It pro…☆64Updated 4 months ago
- An open source, Gradio-based chatbot app that combines the best of retrieval augmented generation and prompt engineering into an intellig…☆50Updated 7 months ago
- Guaranteed structured outputs from any language model. Eliminate 100% of schema violations and state tracking failures in your LLM applic…☆120Updated this week
- AI management tool☆113Updated 4 months ago
- A Pure Rust based LLM (Any LLM based MLLM such as Spark-TTS) Inference Engine, powering by Candle framework.☆85Updated this week
- User-friendly AI Interface (Supports Ollama, OpenAI API, ...)☆123Updated last month
- Easily view and modify JSON datasets for large language models☆71Updated 3 weeks ago