Alternatives and similar repositories for OpenArc

Users that are interested in OpenArc are comparing it to the libraries listed below

• inferx-net / inferx
  InferX is a Inference Function as a Service Platform
  ☆119Updated last week
• lemonade-sdk / lemonade
  Lemonade helps users run local LLMs with the highest performance by configuring state-of-the-art inference engines for their NPUs and GPU…
  ☆350Updated this week
• kalavai-net / kalavai-client
  A platform to self-host AI on easy mode
  ☆152Updated last week
• theroyallab / YALS
  ☆81Updated last week
• TesslateAI / TFrameX
  ☆152Updated last week
• perk11 / large-model-proxy
  Run multiple resource-heavy Large Models (LM) on the same machine with limited amount of VRAM/other resources by exposing them on differe…
  ☆67Updated last month
• KartDriver / mira_converse
  ☆82Updated 5 months ago
• avarayr / suaveui
  Open source LLM UI, compatible with all local LLM providers.
  ☆175Updated 10 months ago
• iluxu / llmbasedos
  Minimal Linux OS with a Model Context Protocol (MCP) gateway to expose local capabilities to LLMs.
  ☆259Updated last month
• rhulha / Speech2Speech
  A web application that converts speech to speech 100% private
  ☆73Updated 2 months ago
• masterFoad / NanoSage
  Local LLM Powered Recursive Search & Smart Knowledge Explorer
  ☆247Updated 5 months ago
• RoyalCities / RC-Home-Assistant-Low-VRAM
  Local AI voice assistant stack for Home Assistant (GPU-accelerated) with persistent memory, follow-up conversation, and Ollama model reco…
  ☆84Updated last week
• TesslateAI / Agent-Builder
  ☆109Updated this week
• matteoserva / GraphLLM
  ☆207Updated 2 weeks ago
• mehtabmahir / easy-whisper-ui
  Easy to use interface for the Whisper model optimized for all GPUs!
  ☆264Updated this week
• NimbleEdge / sparse_transformers
  Sparse Inferencing for transformer based LLMs
  ☆196Updated this week
• 7ozzam / cohere-toolkit-with-openai
  Cohere Toolkit is a collection of prebuilt components enabling users to quickly build and deploy RAG applications.
  ☆28Updated 6 months ago
• matatonic / openedai-vision
  An OpenAI API compatible API for chat with image input and questions about the images. aka Multimodal.
  ☆259Updated 5 months ago
• Viceman256 / TensorTune
  KoboldCpp Smart Launcher with GPU Layer and Tensor Override Tuning
  ☆26Updated 2 months ago
• MaxHastings / Kolo
  The Fastest Way to Fine-Tune LLMs Locally
  ☆313Updated 4 months ago
• jaco-bro / diajax
  Dia-JAX: A JAX port of Dia, the text-to-speech model for generating realistic dialogue from text with emotion and tone control.
  ☆27Updated 2 months ago
• platinum-hill / cobolt
  This is a cross-platform desktop application that allows you to chat with locally hosted LLMs and enjoy features like MCP support
  ☆221Updated this week
• Independent-AI-Labs / local-super-agents
  Privacy-first agentic framework with powerful reasoning & task automation capabilities. Natively distributed and fully ISO 27XXX complian…
  ☆66Updated 4 months ago
• Vasco0x4 / Neo-AI
  Neo AI integrates into the Linux terminal, capable of executing system commands and providing helpful information.
  ☆110Updated 3 months ago
• Raskoll2 / LLMcalc
  A tool to determine whether or not your PC can run a given LLM
  ☆163Updated 6 months ago
• SingularityMan / vector_companion
  A local AI companion that uses a collection of free, open source AI models in order to create two virtual companions that will follow you…
  ☆227Updated last week
• intelligencedev / eternal
  Eternal is an experimental platform for machine learning models and workflows.
  ☆68Updated 4 months ago
• taylorwilsdon / reddacted
  reddacted lets you analyze & sanitize your online footprint using LLMs, PII detection & sentiment analysis to identify anything that migh…
  ☆105Updated last week
• flatsiedatsie / papeg_ai
  Code for Papeg.ai
  ☆225Updated 7 months ago
• nydasco / jen-ai
  A simple speech-to-text and text-to-speech AI chatbot that can be run fully offline.
  ☆45Updated last year