NotPunchnox / rkllama

Ollama alternative for Rockchip NPU: An efficient solution for running AI and Deep learning models on Rockchip devices with optimized NPU support ( rkllm )
104Updated last week

Alternatives and similar repositories for rkllama:

Users that are interested in rkllama are comparing it to the libraries listed below