Automated script to convert Huggingface and GGUF models to rkllm format for running on Rockchip NPU
☆41Nov 11, 2024Updated last year
Alternatives and similar repositories for ez-er-rkllm-toolkit
Users that are interested in ez-er-rkllm-toolkit are comparing it to the libraries listed below
Sorting:
- ☆51Feb 18, 2025Updated last year
- Easier usage of LLMs in Rockchip's NPU on SBCs like Orange Pi 5 and Radxa Rock 5 series☆173Aug 3, 2025Updated 7 months ago
- 将LLM 模型部署到 Rockchip Rk3588芯片中，在开发板上使用NPU进行推理☆70Oct 6, 2024Updated last year
- top-like script for rockhip NPUs on linux☆67Nov 6, 2025Updated 4 months ago
- ☆12Sep 7, 2025Updated 6 months ago
- rkllm_talking is a standalone compiled voice communication system based on a large model || rkllm_talking 是一个独立编译的基于大模…☆13Oct 13, 2024Updated last year
- Ollama alternative for Rockchip NPU: An efficient solution for running AI and Deep learning models on Rockchip devices with optimized NPU…☆436Updated this week
- A Rust-based, SenseVoiceSmall☆27Updated this week
- Unofficial Rockchip RKNN framework rust binding.☆21Mar 6, 2024Updated 2 years ago
- ☆18Jan 4, 2025Updated last year
- Guide I wrote mostly for myself on how to run mlc-llm on the Orange Pi 5 Pro☆23Aug 15, 2025Updated 6 months ago
- Run Large Language Models on RK3588 with GPU-acceleration☆125Aug 16, 2023Updated 2 years ago
- A Rust-based, OpenAI-style API server for large language models (LLMs)☆19Updated this week
- Making Rockchip's RKNN-Toolkit-2 install easier for SBCs like Orange Pi 5 or Radxa Rock 5☆34May 29, 2025Updated 9 months ago
- The rkllm server which is compatible with OpenAI API and Ollama API format.☆33Feb 24, 2026Updated 2 weeks ago
- ☆10Nov 3, 2025Updated 4 months ago
- Allows access via HTTP to LLM running on RK3588 NPU. Returns JSON response.☆29May 29, 2024Updated last year
- watch the npu & cpu load of rk3588 chip.观察瑞芯微 RK3588 芯片的 NPU 和 CPU 负载。☆43Feb 11, 2025Updated last year
- ☆32Mar 13, 2025Updated 11 months ago
- Managed Development Environment for RadxaOS☆63Updated this week
- Support for OpenWrt in Amlogic, Rockchip and Allwinner boxes.☆38Dec 18, 2025Updated 2 months ago
- Upstream version of the "Red Hat Sovereignty Readiness Assessment"☆30Feb 27, 2026Updated last week
- ☆29Dec 20, 2025Updated 2 months ago
- Nanos klib for NVIDIA GPUs☆14Mar 25, 2025Updated 11 months ago
- Russian phonetical transcription☆11Nov 19, 2025Updated 3 months ago
- hass☆10Jan 11, 2023Updated 3 years ago
- Support fetching dual SIMs details for android dual SIM phone☆11Dec 10, 2015Updated 10 years ago
- Rockchip系SoCのHWエンコーダ(rkmpp)の性能実験☆106Jan 6, 2026Updated 2 months ago
- A Docker image for NFS-Ganesha (NFSv4 only).☆10Feb 1, 2026Updated last month
- ☆13Updated this week
- A free simple responsive HTML email template for PHPLIST☆14Jan 4, 2019Updated 7 years ago
- Implementation of Qwen3-ASR-0.6B in GGML☆46Feb 10, 2026Updated 3 weeks ago
- The code that goes into the GroupServer tar-ball.☆13Sep 7, 2017Updated 8 years ago
- Tokenizer for Text to Speech (TTS) models☆13Jan 16, 2025Updated last year
- ☆10Dec 30, 2022Updated 3 years ago
- Configs and Symbols needed for building out of tree drivers.☆10Jan 31, 2026Updated last month
- Transcoding optimizations for Synology Photo☆12Feb 23, 2026Updated 2 weeks ago
- Shell script to send PJ Link instructions to a projector☆12Dec 15, 2017Updated 8 years ago
- Plugin for phplist 3.x to view an email in a browser☆12Mar 27, 2025Updated 11 months ago