imertz / litert-lm-api-serverView on GitHub
A lightweight Node.js server that provides an OpenAI-compatible API for Google's LiteRT-LM (formerly TensorFlow Lite LLM Runtime), enabling you to run local language models with any OpenAI SDK client.
☆15Apr 15, 2026Updated 6 months ago

Alternatives and similar repositories for litert-lm-api-server

Users that are interested in litert-lm-api-server are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.

Sorting:

Are these results useful?