Fully open-source, high-performance LLM inference engine for the RK3588 NPU
☆80Nov 5, 2026Updated last week
Alternatives and similar repositories for open_rknpu2_lm_infer
Users that are interested in open_rknpu2_lm_infer are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆39Aug 4, 2026Updated 3 months ago
- ☆24Oct 6, 2026Updated last month
- Run RKLLM only in one docker command. Already converted models here.☆23Oct 23, 2026Updated 3 weeks ago
- LightGlue-RKNN☆13Dec 17, 2025Updated 11 months ago
- Self-hosted, NPU-accelerated LLM chat on Turing RK1 running Talos Linux☆13Updated this week
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- Reverse engineering the rk3588 npu☆135May 30, 2024Updated 2 years ago
- Quick and dirty benchmarking tool to measure the performance of RK3588 NPU.☆12Feb 23, 2024Updated 2 years ago
- Hardware reference and research notes for the RK3588 NPU and its regcmd interface☆35Updated this week
- High performance inference engine☆17Updated this week
- Llama.cpp with the Rockchip NPU integration as a GGML backend.☆288Oct 7, 2026Updated last month
- A better RKNPU2/RKNPU3 Python/C++ runtime API☆21Jul 20, 2026Updated 3 months ago
- ☆174Nov 5, 2026Updated last week
- Drop-in ggml backend for Rockchip NPUs: offloads llama.cpp/whisper.cpp prefill to the RK3588 NPU☆28Updated this week
- ☆55Jun 26, 2026Updated 4 months ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Userspace driver, matmul, and on-NPU op library for Rockchip NPUs (RK3588 & Subset on RK3576) via the mainline rocket DRM-accel driver☆24Updated this week
- XiaoZhi ESP32 firmware with Ada UI, power management, and OpenClaw gateway integration for SenseCAP Watcher☆10May 13, 2026Updated 6 months ago
- yolo11模型转换工具(onnx->rknn)☆11Jun 1, 2025Updated last year
- top-like script for rockhip NPUs on linux☆69Nov 6, 2025Updated last year
- C++17 header-only ONVIF 客户端库☆20May 23, 2026Updated 5 months ago
- Multiplatform system monitoring tool using Cosmopolitan Libc☆74May 10, 2026Updated 6 months ago
- 通过 Linux gadget 将某个usb host 模拟成 hid设备 提供给pc设备☆11Nov 8, 2022Updated 4 years ago
- 个人主页☆15Nov 1, 2026Updated 2 weeks ago
- Raytracer package including a modeler. Windows and Amiga.☆10Jan 5, 2014Updated 12 years ago
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- VA-API driver for Rockchip RK3588 via MPP☆50Sep 24, 2026Updated last month
- Build a UEFI-bootable Ubuntu RISC-V preinstalled image for the SpacemiT K3 Pico-ITX board and flash it through fastboot.☆18Oct 14, 2026Updated last month
- go 语言学习汇总☆14Dec 14, 2025Updated 11 months ago
- 面向 Windows + WSL2 的本地数字人语音交互整合包,支持实时语音对话、音色克隆、人物管理、口型同步及多模型提供商切换。☆19Aug 13, 2026Updated 3 months ago
- Ollama alternative for Rockchip NPU: An efficient solution for running AI and Deep learning models on Rockchip devices with optimized NPU…☆628Oct 28, 2026Updated 3 weeks ago
- ☆72Sep 23, 2026Updated last month
- ☆18Jan 4, 2025Updated last year
- The params of lightweight infrared small target segmentation network (LW-IRSTNet)is 0.16M and FLOPs is 303M.☆25Sep 24, 2025Updated last year
- Linux with patches for supporting the Surface Pro X (SQ2)☆13Dec 14, 2021Updated 4 years ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- arnold cpc emulator☆16Sep 4, 2026Updated 2 months ago
- Rust bindings for the Rockchip RKNN Runtime API (librknnrt.so), enabling deployment of deep learning models on Rockchip NPUs. This librar…☆31Sep 16, 2025Updated last year
- Support for root over network block device☆12Aug 3, 2016Updated 10 years ago
- 🖥️ myrktop - Orange Pi 5 (RK3588) System Monitoring script CPU,RAM,NPU,GPU,TEMPERATURES☆33Aug 25, 2026Updated 2 months ago
- David McClain's 'Actors' package for LispWorks☆13Dec 12, 2017Updated 8 years ago
- ☆1,771Sep 29, 2026Updated last month
- Automated script to convert Huggingface and GGUF models to rkllm format for running on Rockchip NPU☆50Nov 11, 2024Updated 2 years ago
Are these results useful?