lamhotsiagian / llm-system-designView on GitHub
A production-grade LLM System Design platform & interactive lab. Features a pure-Python LLM serving, RAG, routing, safety, and agent control plane (150+ offline tests) plus a LangChain + Streamlit UI with local Ollama models.
☆19Jul 30, 2026Updated 2 months ago

Alternatives and similar repositories for llm-system-design

Users that are interested in llm-system-design are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.

Sorting:

Are these results useful?