NVIDIA / trt-llm-as-openai-windows
View external linksLinks

This reference can be used with any existing OpenAI integrated apps to run with TRT-LLM inference locally on GeForce GPU on Windows instead of cloud.
127Feb 29, 2024Updated last year

Alternatives and similar repositories for trt-llm-as-openai-windows

Users that are interested in trt-llm-as-openai-windows are comparing it to the libraries listed below

Sorting:

Are these results useful?