Luna-Inference / rkllm-serverView on GitHub
A minimal OpenAI-compliant rkllm server, verified functional on rk3588, RKNPU v0.9.6, RKLLM v1.2.0
☆12Jun 5, 2025Updated last year

Alternatives and similar repositories for rkllm-server

Users that are interested in rkllm-server are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.

Sorting:

Are these results useful?