mtx512 / rk3588-npuView external linksLinks
Reverse engineering the rk3588 npu
☆110May 30, 2024Updated last year
Alternatives and similar repositories for rk3588-npu
Users that are interested in rk3588-npu are comparing it to the libraries listed below
Sorting:
- My develoopment fork of llama.cpp. For now working on RK3588 NPU and Tenstorrent backend☆115Jan 22, 2026Updated 3 weeks ago
- Because RKNPU only knows 4D☆42Mar 10, 2024Updated last year
- top-like script for rockhip NPUs on linux☆66Nov 6, 2025Updated 3 months ago
- Easier usage of LLMs in Rockchip's NPU on SBCs like Orange Pi 5 and Radxa Rock 5 series☆170Aug 3, 2025Updated 6 months ago
- A place to chronical performance of various hardward and software solutions for using AI at the edge for object detection☆10Sep 11, 2022Updated 3 years ago
- ☆1,243Nov 24, 2025Updated 2 months ago
- enable vulkan on mali610☆27Oct 30, 2024Updated last year
- Matrix multiplication on the NPU inside RK3588☆17Jun 27, 2024Updated last year
- Useful resources for developing with the RK3588.☆435Dec 7, 2025Updated 2 months ago
- Row-wise block scaling for fp8 quantization matrix multiplication. Solution to GPU mode AMD challenge.☆17Feb 9, 2026Updated last week
- A multi-interface (REST and MCP) server for automatic license plate recognition 🚗☆20Dec 2, 2025Updated 2 months ago
- Dockerfiles for poetry/mlc-llm(rk3588)/...☆10Sep 13, 2023Updated 2 years ago
- Simple experiments on Tenstorrent GraySkull e75 chip☆13Aug 28, 2024Updated last year
- ☆33Nov 26, 2025Updated 2 months ago
- ☆32Mar 13, 2025Updated 11 months ago
- Web chat front end for rk3588_npu_llm_server / RK3588 LLM chat interface☆15Jul 16, 2024Updated last year
- This repository contains guide on how to setup toolkits to use NPU present on Axon for running various CNN models☆24Feb 4, 2026Updated last week
- A Rust-based, OpenAI-style API server for large language models (LLMs)☆18Jan 5, 2026Updated last month
- Run Large Language Models on RK3588 with GPU-acceleration☆124Aug 16, 2023Updated 2 years ago
- ☆20Nov 9, 2024Updated last year
- RKNN Multi threades for Orange Pi5, 5B and 5 Plus☆42Dec 4, 2023Updated 2 years ago
- Template repo for simple ImTui apps☆25Jul 25, 2022Updated 3 years ago
- Customized version of the Linux kernel maintained by Armbian team to support Rockchip SoCs☆405Jan 16, 2026Updated last month
- A relatively basic implementation of RWKV in Rust written by someone with very little math and ML knowledge. Supports 32, 8 and 4 bit eva…☆94Sep 2, 2023Updated 2 years ago
- PLEASE USE https://github.com/nyanmisaka/ffmpeg-rockchip REPO INSTEAD.☆91Mar 6, 2024Updated last year
- the python api for axengine runtime☆25Dec 4, 2025Updated 2 months ago
- Ubuntu for Rockchip RK35XX Devices☆3,916Sep 13, 2025Updated 5 months ago
- a Halide language To MLIR compiler.☆26Aug 30, 2021Updated 4 years ago
- The rkllm server which is compatible with OpenAI API format.☆31Dec 31, 2025Updated last month
- Rock5B/RK3588工具箱☆59May 16, 2024Updated last year
- Additional device tree overlays to support different hardwares on Radxa products☆73Updated this week
- InSales e-commerce platform API bindings☆14Jul 13, 2024Updated last year
- Automated script to convert Huggingface and GGUF models to rkllm format for running on Rockchip NPU☆40Nov 11, 2024Updated last year
- avarehelper☆12Aug 15, 2021Updated 4 years ago
- Cuda Miner for BeamHash (Equihash 150,5)☆13Jan 16, 2019Updated 7 years ago
- Implementation of the model from "Faster sorting algorithms discovered using deep reinforcement learning" that discovered an all-new ult…☆11Aug 29, 2023Updated 2 years ago
- OPI5 open micro desk design.☆13Mar 6, 2023Updated 2 years ago
- Starter Repo for a Flask backend and Vuejs frontend using Docker☆10Sep 24, 2018Updated 7 years ago
- ONNX Command-Line Toolbox☆35Oct 11, 2024Updated last year