bjj / exllamav2-openai-server
View external linksLinks

An OpenAI API compatible LLM inference server based on ExLlamaV2.
25Feb 9, 2024Updated 2 years ago

Alternatives and similar repositories for exllamav2-openai-server

Users that are interested in exllamav2-openai-server are comparing it to the libraries listed below

Sorting:

Are these results useful?