Pelochus / ezrknn-llmView external linksLinks
Easier usage of LLMs in Rockchip's NPU on SBCs like Orange Pi 5 and Radxa Rock 5 series
☆170Aug 3, 2025Updated 6 months ago
Alternatives and similar repositories for ezrknn-llm
Users that are interested in ezrknn-llm are comparing it to the libraries listed below
Sorting:
- Making Rockchip's RKNN-Toolkit-2 install easier for SBCs like Orange Pi 5 or Radxa Rock 5☆33May 29, 2025Updated 8 months ago
- ☆1,243Nov 24, 2025Updated 2 months ago
- top-like script for rockhip NPUs on linux☆66Nov 6, 2025Updated 3 months ago
- Ollama alternative for Rockchip NPU: An efficient solution for running AI and Deep learning models on Rockchip devices with optimized NPU…☆417Feb 6, 2026Updated last week
- My develoopment fork of llama.cpp. For now working on RK3588 NPU and Tenstorrent backend☆115Jan 22, 2026Updated 3 weeks ago
- Run Large Language Models on RK3588 with GPU-acceleration☆124Aug 16, 2023Updated 2 years ago
- 将LLM 模型部署到 Rockchip Rk3588芯片中，在开发板上使用NPU进行推理☆69Oct 6, 2024Updated last year
- Reverse engineering the rk3588 npu☆110May 30, 2024Updated last year
- Ubuntu for Rockchip RK35XX Devices☆3,916Sep 13, 2025Updated 5 months ago
- Useful resources for developing with the RK3588.☆435Dec 7, 2025Updated 2 months ago
- Efficient Inference of Transformer models☆478Aug 7, 2024Updated last year
- ☆32Mar 13, 2025Updated 11 months ago
- Matrix multiplication on the NPU inside RK3588☆17Jun 27, 2024Updated last year
- YoloV5 NPU for the RK3566/68/88☆125Jun 19, 2024Updated last year
- ☆10Sep 2, 2023Updated 2 years ago
- Dockerfiles for poetry/mlc-llm(rk3588)/...☆10Sep 13, 2023Updated 2 years ago
- ☆33Nov 26, 2025Updated 2 months ago
- 基于RK3588/香橙派的openpilot软硬件☆57Aug 4, 2025Updated 6 months ago
- Unofficial Rockchip RKNN framework rust binding.☆21Mar 6, 2024Updated last year
- A lightweight end-of-utterance detection model fine-tuned on SmolLM2-135M, optimized for Raspberry Pi and low-power devices.☆45Nov 8, 2025Updated 3 months ago
- The Free Software Media System. 适用于Rockchip SoC 和 RTD1296 的 Jellyfin，请使用已编译的镜像 https://hub.docker.com/u/jjm2473☆16Jan 29, 2024Updated 2 years ago
- Wake word detection with custom phrases without model training☆26Aug 24, 2025Updated 5 months ago
- ROS 2 Inference sample for using Rockchip NPU.☆17Feb 20, 2023Updated 2 years ago
- YOLOX-ti-lite models exportable to TFLite☆22Mar 27, 2023Updated 2 years ago
- This repository contains guide on how to setup toolkits to use NPU present on Axon for running various CNN models☆24Feb 4, 2026Updated last week
- EDK2 UEFI firmware for Rockchip RK3588 platforms☆920Dec 7, 2025Updated 2 months ago
- HandLandmark Detection that can be performed only in onnxruntime. Pre-focusing by skeletal detection is not performed. This does not use …☆20Apr 30, 2024Updated last year
- ☆2,214Apr 9, 2025Updated 10 months ago
- MLC Stable Diffusion for RK3588's Mali GPU☆41Sep 19, 2024Updated last year
- Compass Apache TVM is enhanced based on the Apache TVM for wide range of Neural Network (NN) models quick support, optimization and heter…☆20Jan 22, 2026Updated 3 weeks ago
- Rockchip Userspace Mali GPU Driver and Debian Packages (Mirror of https://github.com/JeffyCN/mirrors/tree/libmali) (See Also: https://git…☆211Jan 20, 2026Updated 3 weeks ago
- CGO bindings to RKNN-Toolkit2 to perform Inferencing in Go on Rockchip NPU☆162Dec 19, 2025Updated last month
- FFmpeg with async and zero-copy Rockchip MPP & RGA support☆1,087Nov 7, 2025Updated 3 months ago
- ☆806Dec 13, 2023Updated 2 years ago
- the python api for axengine runtime☆25Dec 4, 2025Updated 2 months ago
- This repository contains all the code necessary for running the multilingual distilwhisper from Ferraz et al. 2024 IEEE ICASSP paper.☆33Oct 23, 2025Updated 3 months ago
- enable vulkan on mali610☆27Oct 30, 2024Updated last year
- ☆25Sep 19, 2025Updated 4 months ago
- A rockchip-mpp V4L2 wrapper plugin for chromium V4L2 VDA/VEA☆126Apr 30, 2025Updated 9 months ago