Simple FastAPI service for LLAMA-2 7B chat model
☆21Oct 18, 2023Updated 2 years ago
Alternatives and similar repositories for llm-as-a-service
Users that are interested in llm-as-a-service are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Chroma maintenance CLI☆16Aug 15, 2025Updated 10 months ago
- AutoGPT maintainer/reviewer system☆16May 26, 2023Updated 3 years ago
- A demonstration of integrating FastAPI with Ollama, featuring streaming, formatted, and complete JSON responses from AI models. Learn how…