Alternatives and similar repositories for open-responses-server

Users that are interested in open-responses-server are comparing it to the libraries listed below

• thushan / olla
  High-performance lightweight proxy and load balancer for LLM infrastructure. Intelligent routing, automatic failover and unified model di…
  ☆137Updated last week
• inferx-net / inferx
  InferX: Inference as a Service Platform
  ☆156Updated this week
• iluxu / llmbasedos
  llmbasedos — Local-First OS Where Your AI Agents Wake Up and Work
  ☆282Updated last month
• platinum-hill / cobolt
  This is a cross-platform desktop application that allows you to chat with locally hosted LLMs and enjoy features like MCP support
  ☆227Updated 5 months ago
• TesslateAI / TFrameX
  ☆178Updated 5 months ago
• RandomInternetPreson / Lucid_Autonomy
  An extension that lets the AI take the wheel, allowing it to use the mouse and keyboard, recognize UI elements, and prompt itself :3...no…
  ☆127Updated last year
• TesslateAI / Agent-Builder
  ☆205Updated 5 months ago
• perk11 / large-model-proxy
  Run multiple resource-heavy Large Models (LM) on the same machine with limited amount of VRAM/other resources by exposing them on differe…
  ☆88Updated last week
• abgulati / hf-waitress
  Serving LLMs in the HF-Transformers format via a PyFlask API
  ☆72Updated last year
• Forest-Person / smolResearcher
  Use smol agents to do research and then update csv coumns with its findings.
  ☆41Updated last year
• pwilkin / llama-runner
  Llama.cpp runner/swapper and proxy that emulates LMStudio / Ollama backends
  ☆51Updated 5 months ago
• amanvirparhar / elara
  A simple tool to anonymize LLM prompts.
  ☆66Updated last year
• rhulha / Speech2Speech
  A web application that converts speech to speech 100% private
  ☆81Updated 8 months ago
• taresh18 / conversify
  🗣️ Real‑time, low‑latency voice, vision, and conversational‑memory AI assistant built on LiveKit and local LLMs ✨
  ☆107Updated 7 months ago
• anjor / ollama-mcp-client
  ☆64Updated last year
• monkesearch / monkeSearch
  fully local, temporally aware natural language file search on your pc! even without a GPU. find relevant files using natural language i…
  ☆168Updated last month
• raeudigerRaeffi / turbular
  A MCP server allowing LLM agents to easily connect and retrieve data from any database
  ☆99Updated 6 months ago
• taylorwilsdon / llm-context-limits
  Since OpenAI and friends refuse to give us a max_ctx param in /models, here's the current context window, input token and output token li…
  ☆65Updated last month
• codelion / ellora
  Enhancing LLMs with LoRA
  ☆206Updated 3 months ago
• kalavai-net / kalavai-client
  Aggregates compute from spare GPU capacity
  ☆190Updated last week
• remichu-ai / gallama
  ☆135Updated last month
• matteoserva / GraphLLM
  ☆209Updated last month
• eiondb / eion
  Shared Memory Storage for Multi-Agent Systems
  ☆139Updated 7 months ago
• MaxHastings / Kolo
  The Fastest Way to Fine-Tune LLMs Locally
  ☆333Updated last month
• rodrigobaron / anthill
  ☆24Updated last year
• cp3249 / splaa
  SPLAA is an AI assistant framework that utilizes voice recognition, text-to-speech, and tool-calling capabilities to provide a conversati…
  ☆28Updated 9 months ago
• beratcmn / local-intelligence
  Something similar to Apple Intelligence?
  ☆60Updated last year
• bold84 / cot_proxy
  Smart proxy for LLM APIs that enables model-specific parameter control, automatic mode switching (like Qwen3's /think and /no_think), and…
  ☆50Updated 8 months ago
• StacklokLabs / mockllm
  MockLLM, when you want it to do what you tell it to do!
  ☆75Updated 2 months ago
• nath1295 / MLX-Textgen
  A python package for serving LLM on OpenAI-compatible API endpoints with prompt caching using MLX.
  ☆100Updated 7 months ago