npuichigo / openai_trtllm

OpenAI compatible API for TensorRT LLM triton backend
200Updated 7 months ago

Alternatives and similar repositories for openai_trtllm:

Users that are interested in openai_trtllm are comparing it to the libraries listed below