Reverse engineering the rk3588 npu
☆110May 30, 2024Updated last year
Alternatives and similar repositories for rk3588-npu
Users that are interested in rk3588-npu are comparing it to the libraries listed below
Sorting:
- My develoopment fork of llama.cpp. For now working on RK3588 NPU and Tenstorrent backend☆115Updated this week
- Because RKNPU only knows 4D☆42Mar 10, 2024Updated last year
- MLC Stable Diffusion for RK3588's Mali GPU☆42Sep 19, 2024Updated last year
- Streaming TTS based on Piper with optional RK3588 NPU support☆123Feb 28, 2026Updated last week
- A place to chronical performance of various hardward and software solutions for using AI at the edge for object detection☆10Sep 11, 2022Updated 3 years ago
- ☆1,270Nov 24, 2025Updated 3 months ago
- enable vulkan on mali610☆27Oct 30, 2024Updated last year
- Matrix multiplication on the NPU inside RK3588☆17Jun 27, 2024Updated last year
- Qwen3-VL-2B on the RK3588 NPU☆19Feb 2, 2026Updated last month
- Ollama alternative for Rockchip NPU: An efficient solution for running AI and Deep learning models on Rockchip devices with optimized NPU…☆436Updated this week
- Useful resources for developing with the RK3588.☆445Dec 7, 2025Updated 3 months ago
- Row-wise block scaling for fp8 quantization matrix multiplication. Solution to GPU mode AMD challenge.☆17Feb 9, 2026Updated last month
- Efficient Inference of Transformer models☆484Aug 7, 2024Updated last year
- Simple experiments on Tenstorrent GraySkull e75 chip☆13Aug 28, 2024Updated last year
- Summary of bugs in Xuantie C9XX core design. include C906/C908/C910/C920☆28Feb 10, 2026Updated 3 weeks ago
- Web chat front end for rk3588_npu_llm_server / RK3588 LLM chat interface☆16Jul 16, 2024Updated last year
- This repository contains guide on how to setup toolkits to use NPU present on Axon for running various CNN models☆25Updated this week
- ☆2,702Jul 29, 2025Updated 7 months ago
- Run Large Language Models on RK3588 with GPU-acceleration☆125Aug 16, 2023Updated 2 years ago
- minicopy双频IC/ID读写卡器android app(写卡无限次数)☆18Jun 29, 2023Updated 2 years ago
- A Rust-based, OpenAI-style API server for large language models (LLMs)☆19Updated this week
- ☆20Nov 9, 2024Updated last year
- ☆1,118Mar 25, 2024Updated last year
- 🚧 A work-in-progress GLSL compiler targeting SPIR-V mlir 🚧☆22Oct 18, 2024Updated last year
- A lightweight MLIR Python frontend with support for PyTorch☆29Sep 3, 2024Updated last year
- Llama.cpp with the Rockchip NPU integration as a GGML backend.☆75Nov 23, 2025Updated 3 months ago
- Ubuntu for Rockchip RK35XX Devices☆3,955Sep 13, 2025Updated 5 months ago
- Allows access via HTTP to LLM running on RK3588 NPU. Returns JSON response.☆29May 29, 2024Updated last year
- The rkllm server which is compatible with OpenAI API and Ollama API format.☆33Feb 24, 2026Updated 2 weeks ago
- a Halide language To MLIR compiler.☆25Aug 30, 2021Updated 4 years ago
- ☆53Dec 23, 2025Updated 2 months ago
- Additional device tree overlays to support different hardwares on Radxa products☆75Updated this week
- Implementation of the model from "Faster sorting algorithms discovered using deep reinforcement learning" that discovered an all-new ult…☆11Aug 29, 2023Updated 2 years ago
- Apparel Classification for Indian Ethnic Clothes☆12Feb 10, 2023Updated 3 years ago
- Natural language control for Python CLI tools using locally-trained SLMs (CPU inference)☆30Feb 21, 2026Updated 2 weeks ago
- OPI5 open micro desk design.☆13Mar 6, 2023Updated 3 years ago
- Cuda Miner for BeamHash (Equihash 150,5)☆13Jan 16, 2019Updated 7 years ago
- avarehelper☆12Aug 15, 2021Updated 4 years ago
- ONNX Command-Line Toolbox☆36Oct 11, 2024Updated last year