OpenAI-compatible API server for Rockchip NPU (RK3588/RK3576) — local LLM inference on Orange Pi with Open WebUI support
☆28Aug 25, 2026Updated 2 months ago
Alternatives and similar repositories for RKLLM-API-Server
Users that are interested in RKLLM-API-Server are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Export and Run Hugging Face Transformers Models on Rockchip NPUs☆29Dec 2, 2025Updated 11 months ago
- A Deeplearn Model to rec table in photo with ncnn. 一个深度学习模型用于检测图片中的表格 画像内のテーブルを検出するためのディープラーニング モデル☆20Mar 2, 2025Updated last year
- ☆52Feb 18, 2025Updated last year
- Llama.cpp with the Rockchip NPU integration as a GGML backend.☆288Oct 7, 2026Updated last month
- Ollama alternative for Rockchip NPU: An efficient solution for running AI and Deep learning models on Rockchip devices with optimized NPU…☆628Oct 28, 2026Updated 3 weeks ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- How to integrate Arduino, NODE-RED, RPi3 and Ethereum☆11Feb 14, 2017Updated 9 years ago
- Deploy RF-DETR model on Rockchip NPU: Split Backbone on NPU, Detector on CPU☆43Feb 25, 2026Updated 8 months ago
- Clipboard management plugin for Cordova/PhoneGap☆11Apr 4, 2023Updated 3 years ago
- Armbian H96 Max RK3566 device tree bring Up☆12May 10, 2026Updated 6 months ago
- Run RKLLM only in one docker command. Already converted models here.☆23Oct 23, 2026Updated 3 weeks ago
- GLM-5.3-Flash EXL3 K2 2.33bpw on ONE DGX Spark: native MTP (layer 45, 288 experts), CUDA graphs on, full 262,144 ctx. Measured ~19 tok/s …☆11Sep 19, 2026Updated 2 months ago
- Qwen3-ASR-FastAPI-Docker: Lightweight FastAPI service containerizing Qwen3-ASR for low-latency multilingual speech, music, and singing re…☆15Jan 31, 2026Updated 9 months ago
- A lightweight rkllm server.☆53Nov 4, 2026Updated 2 weeks ago
- linux kernel 3.4.113-sun8i OrangePi Zero☆12Feb 18, 2017Updated 9 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- ☆12May 23, 2023Updated 3 years ago
- Mainline Linux 6.18 support for the Orange Pi 4A (Allwinner T527 / A523): HDMI KMS, Mali-G57 Panfrost, WiFi, HDMI audio, ethernet, USB, c…☆16Oct 14, 2026Updated last month
- Supply chains on a blockchain. It's magic.☆16Apr 24, 2017Updated 9 years ago
- Simple Implementation of TinyGPTV in super simple Zeta lego blocks☆16Nov 11, 2024Updated 2 years ago
- A Rust-native LLM serving engine. One binary, no Python runtime.☆22Updated this week
- WebRTC stack wrapper for node.js. This fork adds most of the media stream features.☆13Jan 17, 2018Updated 8 years ago
- ChatGPT中文学习和实践资料汇总——LLaMA、ChatGLM等大模型的Finetune☆14Updated this week
- Fast and memory-efficient exact attention☆11Oct 21, 2026Updated 3 weeks ago
- Shell script and AWK based iw dev scan -> JSON converter. Busybox AWK compatible.☆16Jul 25, 2022Updated 4 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- chatgpt库的调用, 支持流式和非流式,可以实现类似官方chatgpt的显示效果☆11Jan 30, 2024Updated 2 years ago
- This repository is created to provide a straight forward reference for running Custom Yolov5 models on the NPU for Orangepi 5 boards - RK…☆13Feb 19, 2025Updated last year
- ☆15Sep 11, 2025Updated last year
- ☆14Aug 8, 2025Updated last year
- PyTorch code for 2023 paper "Raw Image Based Over-Exposure Correction Using Channel-Guidance Strategy"☆17Feb 24, 2024Updated 2 years ago
- mp3-proxy-MusicVN-for-xiaozhi-music☆19Nov 5, 2025Updated last year
- 基于YOLOv11的交通信号灯检测,包含完整程序及网页端界面显示☆17Apr 8, 2025Updated last year
- ☆1,774Sep 29, 2026Updated last month
- Deploy streaming ASR + TTS on RK3576/RK3588 — 120ms TTS, 52-language ASR, one Docker command☆48Nov 6, 2026Updated last week
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- Dynamic Frame Interpolation in Wavelet Domain (TIP 2023)☆20Sep 23, 2023Updated 3 years ago
- ☆17May 20, 2026Updated 5 months ago
- Highly configurable drag and drop module for Angular.☆16Sep 7, 2018Updated 8 years ago
- Gemma 4 26B-A4B inference in ~2 GB of RAM on any M-series MacBook☆14Jul 31, 2026Updated 3 months ago
- Fire & Smoke Detection Algorithm☆11Dec 2, 2023Updated 2 years ago
- Data preparation utility for the finetuning of OpenAI's Whisper model.☆18Sep 17, 2026Updated 2 months ago
- pytorch实现Grad-CAM和Grad-CAM++,可以可视化任意分类网络的Class Activation Map (CAM)图,包括自定义的网络;同时也实现了目标检测faster r-cnn和retinanet两个网络的CAM图;欢迎试用、关注并反馈问题...☆11May 18, 2020Updated 6 years ago
Are these results useful?