Center-for-AI-Innovation / llm-serving
View external linksLinks

Serve LLMs on NCSA hardware. Support the best FOSS models, and the long tail on HuggingFace Hub.
13May 8, 2024Updated last year

Alternatives and similar repositories for llm-serving

Users that are interested in llm-serving are comparing it to the libraries listed below

Sorting:

Are these results useful?