Automated script to convert Huggingface and GGUF models to rkllm format for running on Rockchip NPU
☆47Nov 11, 2024Updated last year
Alternatives and similar repositories for ez-er-rkllm-toolkit
Users that are interested in ez-er-rkllm-toolkit are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆52Feb 18, 2025Updated last year
- Easier usage of LLMs in Rockchip's NPU on SBCs like Orange Pi 5 and Radxa Rock 5 series☆193Aug 3, 2025Updated 9 months ago
- 将LLM 模型部署到 Rockchip Rk3588芯片中,在开发板上使用NPU进行推理☆84Oct 6, 2024Updated last year
- ☆13Sep 7, 2025Updated 8 months ago
- rkllm_talking is a standalone compiled voice communication system based on a large model || rkllm_talking 是一个独立编译的基于大模…☆13Oct 13, 2024Updated last year
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- top-like script for rockhip NPUs on linux☆69Nov 6, 2025Updated 6 months ago
- Ollama alternative for Rockchip NPU: An efficient solution for running AI and Deep learning models on Rockchip devices with optimized NPU…☆519Updated this week
- Unofficial Rockchip RKNN framework rust binding.☆23Mar 6, 2024Updated 2 years ago
- A Rust-based, SenseVoiceSmall☆32Apr 27, 2026Updated last week
- Easy installation and usage of Rockchip's NPUs found in RK3588 and similar SoCs☆239Aug 3, 2025Updated 9 months ago
- Run Large Language Models on RK3588 with GPU-acceleration☆129Aug 16, 2023Updated 2 years ago
- Understand yolov8 structure,custom data traininig☆23Jun 29, 2023Updated 2 years ago
- Allows access via HTTP to LLM running on RK3588 NPU. Returns JSON response.☆30May 29, 2024Updated last year
- ☆13Apr 2, 2024Updated 2 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- A Rust-based, OpenAI-style API server for large language models (LLMs)☆21Mar 26, 2026Updated last month
- Utility of RKNN C API of Rockchip RK3588 written in Rust.☆14Oct 9, 2025Updated 7 months ago
- My develoopment fork of llama.cpp. For now working on RK3588 NPU and Tenstorrent backend☆119Apr 30, 2026Updated last week
- Inference YOLOv8 detection on ONNX, RKNN, Horizon and TensorRT☆16Sep 20, 2023Updated 2 years ago
- Guide I wrote mostly for myself on how to run mlc-llm on the Orange Pi 5 Pro☆25Aug 15, 2025Updated 8 months ago
- rk3588 kernel开启docler需要依赖配置☆16Dec 21, 2023Updated 2 years ago
- Rockchip系SoCのHWエンコ ーダ(rkmpp)の性能実験☆108Mar 15, 2026Updated last month
- watch the npu & cpu load of rk3588 chip.观察瑞芯微 RK3588 芯片的 NPU 和 CPU 负载。☆44Feb 11, 2025Updated last year
- radxa debian packages repository☆37Mar 16, 2023Updated 3 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- Additional camera tuning profiles for Rockchip SoC☆13Apr 13, 2026Updated 3 weeks ago
- The proxied-worker tech for NodeJS☆17Jul 4, 2023Updated 2 years ago
- Patches needed to build VMware (Player and Workstation) host modules against recent kernels☆17Sep 20, 2025Updated 7 months ago
- A tool for humans to interact with a Chroma vector database☆16Apr 25, 2026Updated 2 weeks ago
- The rkllm server which is compatible with OpenAI API, Ollama API, and Claude API format.☆40Mar 22, 2026Updated last month
- Managed Development Environment for RadxaOS☆70Apr 29, 2026Updated last week
- Starter template for SvelteKit + Threlte projects☆11Dec 27, 2022Updated 3 years ago
- Configs and Symbols needed for building out of tree drivers.☆10Jan 31, 2026Updated 3 months ago
- Modify the atheros wireless driver to enable the card to initiate radiation (IR) on 5GHz bands for AP mode☆13Sep 30, 2022Updated 3 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- ☆10Jun 6, 2024Updated last year
- libmali for rockchip☆13Aug 23, 2022Updated 3 years ago
- This repository contains instructions on how to get root access in Termux, without root.☆27Mar 28, 2024Updated 2 years ago
- Create 3D files in the CLI with Small Language Model☆45Oct 15, 2025Updated 6 months ago
- ☆59Feb 18, 2026Updated 2 months ago
- ☆13May 1, 2026Updated last week
- Support for OpenWrt in Amlogic, Rockchip and Allwinner boxes.☆38Dec 18, 2025Updated 4 months ago