Chrisz236 / llm-rk3588Links
Run Large Language Models on RK3588 with GPU-acceleration
☆117Updated 2 years ago
Alternatives and similar repositories for llm-rk3588
Users that are interested in llm-rk3588 are comparing it to the libraries listed below
Sorting:
- My develoopment fork of llama.cpp. For now working on RK3588 NPU and Tenstorrent backend☆108Updated last week
- top-like script for rockhip NPUs on linux☆56Updated 2 months ago
- Easy installation and usage of Rockchip's NPUs found in RK3588 and similar SoCs☆190Updated 2 months ago
- Reverse engineering the rk3588 npu☆95Updated last year
- Easier usage of LLMs in Rockchip's NPU on SBCs like Orange Pi 5 and Radxa Rock 5 series☆152Updated 2 months ago
- Allows access via HTTP to LLM running on RK3588 NPU. Returns JSON response.☆26Updated last year
- Streaming TTS based on Piper with optional RK3588 NPU support☆107Updated 5 months ago
- ☆992Updated last week
- ☆49Updated 7 months ago
- MLC Stable Diffusion for RK3588's Mali GPU