NotPunchnox / rkllama

Ollama alternative for Rockchip NPU: An efficient solution for running AI and Deep learning models on Rockchip devices with optimized NPU support ( rkllm )
132Updated this week

Alternatives and similar repositories for rkllama:

Users that are interested in rkllama are comparing it to the libraries listed below