Chrisz236 / llm-rk3588
Run Large Language Models on RK3588 with GPU-acceleration
☆92Updated last year
Alternatives and similar repositories for llm-rk3588:
Users that are interested in llm-rk3588 are comparing it to the libraries listed below
- My develoopment fork of llama.cpp. For now working on RK3588 NPU and Tenstorrent backend☆86Updated this week
- Easier usage of LLMs in Rockchip's NPU on SBCs like Orange Pi 5 and Radxa Rock 5 series☆120Updated this week
- Easy usage of Rockchip's NPUs found in RK3588 and similar chips☆131Updated this week
- Reverse engineering the rk3588 npu☆73Updated 9 months ago
- top-like script for rockhip NPUs on linux☆35Updated last week
- ☆660Updated last month
- MLC Stable Diffusion for RK3588's Mali GPU☆40Updated 5 months ago
- Streaming TTS based on Piper with optional RK3588 NPU support☆67Updated 2 months ago
- Efficient Inference of Transformer models☆423Updated 7 months ago
- Automated script to convert Huggingface and GGUF models to rkllm format for running on Rockchip NPU☆25Updated 4 months ago
- Allows access via HTTP to LLM running on RK3588 NPU. Returns JSON response.☆21Updated 9 months ago
- ☆35Updated 3 weeks ago
- Making Rockchip's RKNN-Toolkit-2 install easier for SBCs like Orange Pi 5 or Radxa Rock 5☆20Updated this week
- 将LLM 模型部署到 Rockchip Rk3588芯片中,在开发板上使用NPU进行推理☆33Updated 5 months ago
- Rockchip系SoCのHWエンコーダ(rkmpp)の性能実験☆89Updated last week
- Because RKNPU only knows 4D☆32Updated last year
- YoloV5 NPU for the RK3566/68/88☆94Updated 8 months ago
- openFyde supported hardware RADXA Rock5 Model B build artefacts and pre-built image releases.☆36Updated 2 months ago
- Explore LLM model deployment based on AXera's AI chips☆85Updated last month
- Useful resources for developing with the RK3588.☆247Updated 3 months ago
- Run generative AI models in sophgo BM1684X☆184Updated this week
- Run your yolov7 object detection with Rockchip NPU platforms (RK3566, RK3568, RK3588, RK3588S, RV1103, RV1106, RK3562).☆48Updated 10 months ago
- ☆704Updated last year
- Mirrors of Rockchip BSP repositories, only contains yocto related ones to keep it thin since the yocto would try to clone the whole repos…☆45Updated this week
- Additional device tree overlays to support different hardwares on Radxa products☆50Updated last week
- PLEASE USE https://github.com/nyanmisaka/ffmpeg-rockchip REPO INSTEAD.☆90Updated last year
- A rockchip-mpp V4L2 wrapper plugin for chromium V4L2 VDA/VEA☆98Updated last month
- Inference RWKV v5, v6 and v7 with Qualcomm AI Engine Direct SDK☆55Updated this week
- The docs repository of Pulsar2 which is AXera's SoC 2rd AI toolchain. Such as AX650A, AX650N☆13Updated last month