NVIDIA / trt-llm-as-openai-windowsLinks

This reference can be used with any existing OpenAI integrated apps to run with TRT-LLM inference locally on GeForce GPU on Windows instead of cloud.
121Updated last year

Alternatives and similar repositories for trt-llm-as-openai-windows

Users that are interested in trt-llm-as-openai-windows are comparing it to the libraries listed below

Sorting: