Pelochus / ezrknpu
Easy usage of Rockchip's NPUs found in RK3588 and similar chips
☆143Updated 3 weeks ago
Alternatives and similar repositories for ezrknpu:
Users that are interested in ezrknpu are comparing it to the libraries listed below
- Easier usage of LLMs in Rockchip's NPU on SBCs like Orange Pi 5 and Radxa Rock 5 series☆127Updated last month
- top-like script for rockhip NPUs on linux☆39Updated last month
- Run Large Language Models on RK3588 with GPU-acceleration☆97Updated last year
- ☆721Updated 2 weeks ago
- Reverse engineering the rk3588 npu☆78Updated 10 months ago
- Making Rockchip's RKNN-Toolkit-2 install easier for SBCs like Orange Pi 5 or Radxa Rock 5☆21Updated 3 weeks ago
- Automated script to convert Huggingface and GGUF models to rkllm format for running on Rockchip NPU☆29Updated 5 months ago
- Ollama alternative for Rockchip NPU: An efficient solution for running AI and Deep learning models on Rockchip devices with optimized NPU…☆132Updated this week
- My develoopment fork of llama.cpp. For now working on RK3588 NPU and Tenstorrent backend☆90Updated this week
- MLC Stable Diffusion for RK3588's Mali GPU☆40Updated 7 months ago
- ☆46Updated 2 months ago
- Allows access via HTTP to LLM running on RK3588 NPU. Returns JSON response.☆21Updated 10 months ago