Pelochus / ezrknn-llm
Easier usage of LLMs in Rockchip's NPU on SBCs like Orange Pi 5 and Radxa Rock 5 series
☆64Updated this week
Related projects ⓘ
Alternatives and complementary repositories for ezrknn-llm
- Easy usage of Rockchip's NPUs found in RK3588 and similar chips☆93Updated 4 months ago
- top-like script for rockhip NPUs on linux☆24Updated this week
- Run Large Language Models on RK3588 with GPU-acceleration☆85Updated last year
- ☆402Updated this week
- My develoopment fork of llama.cpp. For now working on RK3588 NPU and Tenstorrent backend☆65Updated last week
- Reverse engineering the rk3588 npu☆63Updated 5 months ago
- Efficient Inference of Transformer models☆386Updated 3 months ago
- Making Rockchip's RKNN-Toolkit-2 install easier for SBCs like Orange Pi 5 or Radxa Rock 5☆13Updated 3 months ago
- The Hailo Model Zoo includes pre-trained models and a full building and evaluation environment☆306Updated last week
- Allows access via HTTP to LLM running on RK3588 NPU. Returns JSON response.☆17Updated 5 months ago
- ☆929Updated last month
- MLC Stable Diffusion for RK3588's Mali GPU☆37Updated last month
- On-device LLM Inference Powered by X-Bit Quantization☆186Updated this week
- YoloV5 NPU for the RK3566/68/88☆81Updated 4 months ago
- Streaming TTS based on Piper with optional RK3588 NPU support☆43Updated last month
- Web chat front end for rk3588_npu_llm_server / RK3588 LLM chat interface☆10Updated 3 months ago
- ☆649Updated 10 months ago
- Useful resources for developing with the RK3588.☆184Updated this week
- openFyde supported hardware RADXA Rock5 Model B build artefacts and pre-built image releases.☆35Updated 5 months ago
- ☆359Updated last week
- Improved Rockchip Linux☆152Updated this week
- CGO bindings to RKNN-Toolkit2 to perform Inferencing in Go on Rockchip NPU☆52Updated last week
- PLEASE USE https://github.com/nyanmisaka/ffmpeg-rockchip REPO INSTEAD.☆90Updated 8 months ago
- Managed Development Environment for RadxaOS☆15Updated last week
- ☆891Updated 7 months ago
- Radxa ZERO 3☆30Updated 9 months ago
- YOLOv5 for RK3588☆67Updated 11 months ago
- ☆1,012Updated last month
- Additional device tree overlays to support different hardwares on Radxa products☆43Updated last week
- Rockchip Userspace Mali GPU Driver and Debian Packages (Mirror of https://github.com/JeffyCN/mirrors/tree/libmali)☆90Updated 7 months ago