Alternatives and similar repositories for open-responses-server

Users that are interested in open-responses-server are comparing it to the libraries listed below

• inferx-net / inferx
  InferX: Inference as a Service Platform
  ☆146Updated this week
• thushan / olla
  High-performance lightweight proxy and load balancer for LLM infrastructure. Intelligent routing, automatic failover and unified model di…
  ☆126Updated 3 weeks ago
• platinum-hill / cobolt
  This is a cross-platform desktop application that allows you to chat with locally hosted LLMs and enjoy features like MCP support
  ☆225Updated 5 months ago
• amanvirparhar / elara
  A simple tool to anonymize LLM prompts.
  ☆66Updated 11 months ago
• raeudigerRaeffi / turbular
  A MCP server allowing LLM agents to easily connect and retrieve data from any database
  ☆99Updated 5 months ago
• nath1295 / MLX-Textgen
  A python package for serving LLM on OpenAI-compatible API endpoints with prompt caching using MLX.
  ☆99Updated 6 months ago
• perk11 / large-model-proxy
  Run multiple resource-heavy Large Models (LM) on the same machine with limited amount of VRAM/other resources by exposing them on differe…
  ☆87Updated this week
• TesslateAI / TFrameX
  ☆178Updated 5 months ago
• m18coppola / llama.sh
  No-messing-around sh client for llama.cpp's server
  ☆30Updated last year
• jayminban / 41-llms-evaluated-on-19-benchmarks
  This project benchmarks 41 open-source large language models across 19 evaluation tasks using the lm-evaluation-harness library.
  ☆85Updated 4 months ago
• EtiennePerot / safe-code-execution
  Code execution utilities for Open WebUI & Ollama
  ☆314Updated last year
• iluxu / llmbasedos
  llmbasedos — Local-First OS Where Your AI Agents Wake Up and Work
  ☆279Updated last week
• pwilkin / llama-runner
  Llama.cpp runner/swapper and proxy that emulates LMStudio / Ollama backends
  ☆50Updated 4 months ago
• ideaweaver-ai-code / ideaweaver
  ☆63Updated 6 months ago
• taylorwilsdon / llm-context-limits
  Since OpenAI and friends refuse to give us a max_ctx param in /models, here's the current context window, input token and output token li…
  ☆61Updated 3 weeks ago
• taresh18 / conversify
  🗣️ Real‑time, low‑latency voice, vision, and conversational‑memory AI assistant built on LiveKit and local LLMs ✨
  ☆100Updated 6 months ago
• rhulha / Speech2Speech
  A web application that converts speech to speech 100% private
  ☆81Updated 7 months ago
• eiondb / eion
  Shared Memory Storage for Multi-Agent Systems
  ☆138Updated 6 months ago
• phildougherty / llmsh
  *NIX SHELL with Local AI/LLM integration
  ☆24Updated 10 months ago
• abgulati / hf-waitress
  Serving LLMs in the HF-Transformers format via a PyFlask API
  ☆72Updated last year
• amranu / cli-agent
  A lightweight Agentic AI framework which works for Mac/Linux/WSL
  ☆45Updated 6 months ago
• matteoserva / GraphLLM
  ☆210Updated last week
• rodrigobaron / anthill
  ☆24Updated 11 months ago
• SlerpE / highCompute.py
  ☆27Updated 7 months ago
• firstbatchxyz / dria-agent
  powerful and fast tool calling agents
  ☆79Updated 9 months ago
• KartDriver / mira_converse
  ☆83Updated 10 months ago
• codelion / ellora
  Enhancing LLMs with LoRA
  ☆205Updated 2 months ago
• divagr18 / memlayer
  Plug-and-play memory for LLMs in 3 lines of code. Add persistent, intelligent, human-like memory and recall to any model in minutes.
  ☆245Updated last month
• anjor / ollama-mcp-client
  ☆64Updated last year
• TesslateAI / Agent-Builder
  ☆204Updated 4 months ago