Drop-in ggml backend for Rockchip NPUs: offloads llama.cpp/whisper.cpp prefill to the RK3588 NPU
☆26Nov 2, 2026Updated this week
Alternatives and similar repositories for ggml-rocket
Users that are interested in ggml-rocket are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Userspace driver, matmul, and on-NPU op library for Rockchip NPUs (RK3588 & Subset on RK3576) via the mainline rocket DRM-accel driver☆23Updated this week
- Hardware reference and research notes for the RK3588 NPU and its regcmd interface☆30Updated this week
- ☆22Oct 6, 2026Updated last month
- ☆36Aug 4, 2026Updated 3 months ago
- Quick and dirty benchmarking tool to measure the performance of RK3588 NPU.☆12Feb 23, 2024Updated 2 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- ☆13Jan 31, 2024Updated 2 years ago
- Linear Algebra and Deep Learning Zig library with GPGPU and heterogeneous computing☆11Aug 26, 2026Updated 2 months ago
- An OpenAI-compatible API server for Rockchip NPUs (RK3588/RK3576). Run LLMs locally on the edge with hardware acceleration.☆20Mar 20, 2026Updated 7 months ago
- Out-of-tree Rockchip RKNPU kernel module for mainline Linux (6.19+ ~ 7.0)☆21Apr 28, 2026Updated 6 months ago
- A minimal OpenAI-compliant rkllm server, verified functional on rk3588, RKNPU v0.9.6, RKLLM v1.2.0☆12Jun 5, 2025Updated last year
- ☆20Oct 19, 2026Updated 2 weeks ago
- Llama.cpp with the Rockchip NPU integration as a GGML backend.☆286Oct 7, 2026Updated last month
- ☆55Jun 26, 2026Updated 4 months ago
- VA-API driver for Rockchip RK3588 via MPP☆47Sep 24, 2026Updated last month
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- ☆52Feb 18, 2025Updated last year
- ☆11Feb 11, 2025Updated last year
- High-performance system monitor for Rockchip SoCs (RK3588, RK3399) with real-time CPU, GPU, NPU, RGA, memory, and process monitoring. W…☆39Oct 24, 2026Updated 2 weeks ago
- Superresolution running on Rockchip NPU (RK3588, etc..)☆24Jul 7, 2024Updated 2 years ago
- EDK2 UEFI firmware for Rockchip RK35xx platforms☆22May 16, 2025Updated last year
- Automated script to convert Huggingface and GGUF models to rkllm format for running on Rockchip NPU☆50Nov 11, 2024Updated last year
- 一个专门应用于手机输入法的智能联想 模型☆15Aug 5, 2026Updated 3 months ago
- Generate lk2nd and U-Boot based bootchain for msm8916 devices☆14Apr 26, 2025Updated last year
- This is a 3D printed vacuum cleaner which has all the features that the commercial one has including auto return to home for charging and…☆10Jul 29, 2022Updated 4 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Self-hosted, NPU-accelerated LLM chat on Turing RK1 running Talos Linux☆12Updated this week
- This project is to extend RWKV LM's capabilities including sequence classification/embedding/peft/cross encoder/bi encoder/multi modaliti…☆10Aug 7, 2024Updated 2 years ago
- ☆13Feb 8, 2024Updated 2 years ago
- Intelligent voice-controlled SolidWorks automation powered by Claude AI, local Whisper STT, vector memory (Qdrant + Nomic), and a native …☆10Feb 16, 2026Updated 8 months ago
- Out-of-tree mainline Linux patches for Rockchip RK3588☆35Jul 1, 2026Updated 4 months ago
- Out-of-tree RKNPU kernel module for RK3588/RK3588S on mainline Linux 6.19+ — enables vendor RKNN SDK on modern kernels☆11Apr 16, 2026Updated 6 months ago
- Real-time hardware monitor TUI for Rockchip RK3588 SBCs. Like htop, but for the GPU, NPU, VPU, RGA, and thermal zones of your Rock 5B+ / …☆15Oct 12, 2026Updated 3 weeks ago
- RWKV-7 mini☆12Mar 29, 2025Updated last year
- Repo for Unitree A1 robotic dog motion planning and control system based on convex MPC and WBIC algorithms. Case study on stairs climbing…☆11Mar 14, 2024Updated 2 years ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- Dockerfiles for poetry/mlc-llm(rk3588)/...☆10Sep 13, 2023Updated 3 years ago
- Unofficial containerd nightly builds☆15Jul 12, 2023Updated 3 years ago
- enable vulkan on mali610☆29Oct 30, 2024Updated 2 years ago
- Easy installation and usage of Rockchip's NPUs found in RK3588 and similar SoCs☆255Aug 3, 2025Updated last year
- khadas-uboot☆10Sep 22, 2025Updated last year
- libcec bindings for node.js☆12May 10, 2016Updated 10 years ago
- rkdeveloptool porting to wasm/webusb☆37May 27, 2026Updated 5 months ago