OpenAI-compatible API server for Rockchip NPU (RK3588/RK3576) — local LLM inference on Orange Pi with Open WebUI support
☆27Aug 25, 2026Updated last month
Alternatives and similar repositories for RKLLM-API-Server
Users that are interested in RKLLM-API-Server are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- miniblink go☆11Jan 7, 2024Updated 2 years ago
- 酷宅科技设备端文档☆24Nov 24, 2022Updated 3 years ago
- ☆12May 6, 2025Updated last year
- PaddleOCR Lite license plate detection on bare Raspberry Pi 4☆12Apr 16, 2024Updated 2 years ago
- Llama.cpp with the Rockchip NPU integration as a GGML backend.☆280Aug 30, 2026Updated last month
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- ☆52Jun 26, 2026Updated 3 months ago
- mp3-proxy-MusicVN-for-xiaozhi-music☆19Nov 5, 2025Updated 11 months ago
- ☆19Sep 24, 2026Updated 2 weeks ago
- This project aims to provide a quick and efficient way to capture any thought to your AnyType second brain. It leverages the protobuf GRP…☆15Aug 26, 2024Updated 2 years ago
- A repo for building just the audio processing module of WebRTC using CMake☆15Oct 18, 2024Updated last year
- GhostStream turns any PC into a GPU–powered transcoding backend for your self-hosted apps. HLS, ABR, HDR→SDR, hardware detection, zero co…☆29May 13, 2026Updated 4 months ago
- YoloV10 NPU for the RK3566/68/88☆23Jun 19, 2024Updated 2 years ago
- ☆24Feb 22, 2026Updated 7 months ago
- ☆25Jan 18, 2026Updated 8 months ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- PaddleOCR Lite document scanner on bare Raspberry Pi 4☆31Mar 15, 2026Updated 6 months ago
- ☆16Jan 18, 2025Updated last year
- BaseHalf desktop version!☆15Aug 29, 2026Updated last month
- Automated converter for ONNX models (particularly ESRGAN) to RKNN format for Rockchip NPUs. Features include Docker-based conversion and …☆27May 18, 2025Updated last year
- ☆33Mar 13, 2025Updated last year
- A fully local document intelligence system that allows users to build a persistent private knowledge base from documents and query it usi…☆20Apr 15, 2026Updated 5 months ago
- ☆70Jan 17, 2025Updated last year
- Stop MITM on the first SSH connection, on any VPS/cloud provider☆27Sep 6, 2026Updated last month
- The rkllm server which is compatible with OpenAI API, Ollama API, and Claude API format.☆52Mar 22, 2026Updated 6 months ago
- Deploy open-source AI quickly and easily - Special Bonus Offer • AdRunpod Hub is built for open source. One-click deployment and autoscaling endpoints without provisioning your own infrastructure.
- This toolkit is used to evaluate trackers on infrared UAV tracking benchmark called CST Anti—UAV.☆30Sep 6, 2026Updated last month
- ☆27Aug 1, 2026Updated 2 months ago
- Open-source AI video platform: a self-hosted NVR (ONVIF/RTSP, recording, WebRTC) plus any AI model through one adapter contract, an app S…☆152Updated this week
- Generate 3D models of aruco markers to 3D print☆19Mar 19, 2025Updated last year
- WordPress Object Cache using Redis.☆60Jun 3, 2021Updated 5 years ago
- Guest lecture in MIT 6.566 on AI Agent Security☆35May 18, 2026Updated 4 months ago
- 🖥️ myrktop - Orange Pi 5 (RK3588) System Monitoring script CPU,RAM,NPU,GPU,TEMPERATURES☆33Aug 25, 2026Updated last month
- 在index-tts-vllm的基础上，实现了并提供了模拟流式合成音频的接口服务及客户端测试脚本☆25Sep 2, 2025Updated last year
- Ubuntu for Rockchip RK35XX Devices☆38May 15, 2026Updated 4 months ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- Global vision positioning system for UAVs in outdoor GNSS-denied environments☆43Updated this week
- Jetbot tools is a set of ROS2 nodes that utilize the Jetson inference DNN vision library for NVIDIA Jetson☆28May 29, 2026Updated 4 months ago
- Streaming TTS based on Piper with optional RK3588 NPU support☆136Feb 28, 2026Updated 7 months ago
- Examples to use Rockchip RK3588s RGA2-E/RGA3 platform.☆28Nov 24, 2023Updated 2 years ago
- ☆25Mar 8, 2026Updated 7 months ago
- Code to reproduce the experiments from the paper: S. Glüge, M. Nyfeler, A. Aghaebrahimian, N. Ramagnano and C. Schüpbach, "Robust Low-Cos…☆25Nov 14, 2024Updated last year
- Dashboard for docker and custom links☆52May 25, 2026Updated 4 months ago