promptengineers-ai / llm-server

🤖 Open-source LLM server (OpenAI, Ollama, Groq, Anthropic) with support for HTTP, Streaming, Agents, RAG
32Updated 2 months ago

Alternatives and similar repositories for llm-server:

Users that are interested in llm-server are comparing it to the libraries listed below