Ollama alternative for Rockchip NPU: An efficient solution for running AI and Deep learning models on Rockchip devices with optimized NPU support ( rkllm )
☆540May 18, 2026Updated last week
Alternatives and similar repositories for rkllama
Users that are interested in rkllama are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Easier usage of LLMs in Rockchip's NPU on SBCs like Orange Pi 5 and Radxa Rock 5 series☆194Aug 3, 2025Updated 9 months ago
- ☆1,464Mar 12, 2026Updated 2 months ago
- ☆53Feb 18, 2025Updated last year
- Easy installation and usage of Rockchip's NPUs found in RK3588 and similar SoCs☆244Aug 3, 2025Updated 9 months ago
- A Rust-based, OpenAI-style API server for large language models (LLMs)☆21Mar 26, 2026Updated 2 months ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- Automated script to convert Huggingface and GGUF models to rkllm format for running on Rockchip NPU☆48Nov 11, 2024Updated last year
- Streaming TTS based on Piper with optional RK3588 NPU support☆129Feb 28, 2026Updated 2 months ago
- The rkllm server which is compatible with OpenAI API, Ollama API, and Claude API format.☆44Mar 22, 2026Updated 2 months ago
- top-like script for rockhip NPUs on linux☆70Nov 6, 2025Updated 6 months ago
- 将LLM 模型部署到 Rockchip Rk3588芯片中，在开发板上使用NPU进行推理☆86Oct 6, 2024Updated last year
- Allows access via HTTP to LLM running on RK3588 NPU. Returns JSON response.☆30May 29, 2024Updated last year
- Run Large Language Models on RK3588 with GPU-acceleration☆130Aug 16, 2023Updated 2 years ago
- Ubuntu for Rockchip RK35XX Devices☆4,063Sep 13, 2025Updated 8 months ago
- Reverse engineering the rk3588 npu☆121May 30, 2024Updated last year
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Web chat front end for rk3588_npu_llm_server / RK3588 LLM chat interface☆16Jul 16, 2024Updated last year
- Qwen3-VL-2B on the RK3588 NPU☆31Feb 2, 2026Updated 3 months ago
- Ubuntu for Rockchip RK35XX Devices☆26May 15, 2026Updated last week
- YoloV5 NPU multithread for the RK3566/68/88 (200 FPS)☆29Dec 24, 2024Updated last year
- Useful resources for developing with the RK3588.☆509Dec 7, 2025Updated 5 months ago
- 🖥️ myrktop - Orange Pi 5 (RK3588) System Monitoring script CPU,RAM,NPU,GPU,TEMPERATURES☆31Apr 20, 2026Updated last month
- ❄️ NixOS configuration for the Turing RK1☆24May 16, 2026Updated last week
- ☆3,003Jul 29, 2025Updated 9 months ago
- ☆43Apr 27, 2025Updated last year
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Superresolution running on Rockchip NPU (RK3588, etc..)☆22Jul 7, 2024Updated last year
- rtop, a performance monitor for the Rockchips RK3566/68/88☆23Aug 16, 2025Updated 9 months ago
- EDK2 UEFI firmware for Rockchip RK3588 platforms☆974Dec 7, 2025Updated 5 months ago
- ☆18Jan 4, 2025Updated last year
- Turing Pi V2 K3S Cluster bootstrapping with Ansible and Argo CD. Dependency monitoring and updating with Renovate Bot. Running CI tests w…☆24Updated this week
- Matrix multiplication on the NPU inside RK3588☆17Jun 27, 2024Updated last year
- Guide I wrote mostly for myself on how to run mlc-llm on the Orange Pi 5 Pro☆25Aug 15, 2025Updated 9 months ago
- Explore LLM model deployment based on AXera's AI chips☆151May 19, 2026Updated last week
- ☆1,157Mar 25, 2024Updated 2 years ago
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- Dockerfiles for poetry/mlc-llm(rk3588)/...☆10Sep 13, 2023Updated 2 years ago
- ☆20Oct 9, 2023Updated 2 years ago
- FFmpeg with async and zero-copy Rockchip MPP & RGA support☆1,203Apr 23, 2026Updated last month
- Customized version of the Linux kernel maintained by Armbian team to support Rockchip SoCs☆446May 18, 2026Updated last week
- ☆10May 30, 2024Updated last year
- Infrastructure as code☆33Updated this week
- inference on tvm runtime using c++ with gpu enabled☆10Apr 25, 2018Updated 8 years ago