Center-for-AI-Innovation / llm-servingView on GitHub
Serve LLMs on NCSA hardware. Support the best FOSS models, and the long tail on HuggingFace Hub.
14May 8, 2024Updated last year

Alternatives and similar repositories for llm-serving

Users that are interested in llm-serving are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.

Sorting:

Are these results useful?