Chrisz236 / llm-rk3588
Run Large Language Models on RK3588 with GPU-acceleration
☆86Updated last year
Related projects ⓘ
Alternatives and complementary repositories for llm-rk3588
- My develoopment fork of llama.cpp. For now working on RK3588 NPU and Tenstorrent backend☆67Updated this week
- ☆413Updated 2 weeks ago
- Easy usage of Rockchip's NPUs found in RK3588 and similar chips☆96Updated last week
- Easier usage of LLMs in Rockchip's NPU on SBCs like Orange Pi 5 and Radxa Rock 5 series☆68Updated 2 weeks ago
- top-like script for rockhip NPUs on linux☆25Updated 2 weeks ago
- Reverse engineering the rk3588 npu☆63Updated 5 months ago
- Streaming TTS based on Piper with optional RK3588 NPU support☆44Updated last month
- Efficient Inference of Transformer models☆391Updated 3 months ago
- Allows access via HTTP to LLM running on RK3588 NPU. Returns JSON response.☆17Updated 5 months ago
- YoloV5 NPU for the RK3566/68/88☆81Updated 5 months ago
- Run generative AI models in sophgo BM1684X☆125Updated this week
- Useful resources for developing with the RK3588.☆190Updated 2 weeks ago
- Run your yolov7 object detection with Rockchip NPU platforms (RK3566, RK3568, RK3588, RK3588S, RV1103, RV1106, RK3562).☆46Updated 6 months ago
- ☆655Updated 11 months ago
- Rockchip系SoCのHWエンコーダ(rkmpp)の性能実験☆84Updated 2 weeks ago
- MLC Stable Diffusion for RK3588's Mali GPU☆37Updated 2 months ago
- Inference rwkv5 or rwkv6 with Qualcomm AI Engine Direct SDK☆37Updated last week
- ncnn benchmark on various single board computers☆158Updated last year
- Because RKNPU only knows 4D☆29Updated 8 months ago
- openFyde supported hardware RADXA Rock5 Model B build artefacts and pre-built image releases.☆35Updated 6 months ago
- Making Rockchip's RKNN-Toolkit-2 install easier for SBCs like Orange Pi 5 or Radxa Rock 5☆13Updated 3 months ago
- Additional device tree overlays to support different hardwares on Radxa products☆43Updated this week
- DDK for Rockchip NPU☆59Updated 3 years ago
- A rockchip-mpp V4L2 wrapper plugin for chromium V4L2 VDA/VEA☆85Updated 5 months ago
- Using FastChat-T5 Large Language Model, Vosk API for automatic speech recognition, and Piper for text-to-speech☆111Updated last year
- ☆973Updated last week
- A converter for llama2.c legacy models to ncnn models.☆82Updated 11 months ago
- Explore LLM model deployment based on AXera's AI chips☆54Updated last week
- YOLOv5 for RK3588☆67Updated 11 months ago
- ☆900Updated 7 months ago