OpenAI-compatible API server for Rockchip NPU (RK3588/RK3576) — local LLM inference on Orange Pi with Open WebUI support
☆23Aug 25, 2026Updated this week
Alternatives and similar repositories for RKLLM-API-Server
Users that are interested in RKLLM-API-Server are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- A Rust-based, OpenAI-style API server for large language models (LLMs)☆25Mar 26, 2026Updated 5 months ago
- PaddleOCR Lite license plate detection on bare Raspberry Pi 4☆12Apr 16, 2024Updated 2 years ago
- Llama.cpp with the Rockchip NPU integration as a GGML backend.☆265May 20, 2026Updated 3 months ago
- 用于计算数学表达式的MCP☆14Mar 30, 2026Updated 5 months ago
- ☆49Jun 26, 2026Updated 2 months ago
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- Proxmox VE port kernel☆34Jul 16, 2026Updated last month
- vosk wake word plugin for OpenVoiceOS☆13Aug 1, 2026Updated 3 weeks ago
- mp3-proxy-MusicVN-for-xiaozhi-music☆17Nov 5, 2025Updated 9 months ago
- This project aims to provide a quick and efficient way to capture any thought to your AnyType second brain. It leverages the protobuf GRP…☆15Aug 26, 2024Updated 2 years ago
- Simple Implementation of TinyGPTV in super simple Zeta lego blocks☆16Nov 11, 2024Updated last year
- 基于YOLOv11的交通信号灯检测，包含完整程序及网页端界面显示☆16Apr 8, 2025Updated last year
- ☆17May 20, 2026Updated 3 months ago
- Server side perfected. A general-use modpack, allowing for fully modded experience without installing a single mod on the client.☆18Aug 16, 2026Updated 2 weeks ago
- A repo for building just the audio processing module of WebRTC using CMake☆15Oct 18, 2024Updated last year
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Alpha Rover Project☆15Sep 11, 2025Updated 11 months ago
- Text Query based Traffic Video Event Retrieval with Global-Local Fusion Embedding☆13Aug 2, 2023Updated 3 years ago
- To convert CosyVoice model to ONNX☆16Dec 22, 2025Updated 8 months ago
- ☆21Apr 16, 2026Updated 4 months ago
- My Favorite Theme for Plank dock☆18Mar 27, 2023Updated 3 years ago
- A thread safe implementation of ByteTrack with (COCO) labels.☆16Jul 7, 2026Updated last month
- Export and Run Hugging Face Transformers Models on Rockchip NPUs☆27Dec 2, 2025Updated 8 months ago
- YoloV10 NPU for the RK3566/68/88☆22Jun 19, 2024Updated 2 years ago
- ☆24Jan 18, 2026Updated 7 months ago
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- Automated converter for ONNX models (particularly ESRGAN) to RKNN format for Rockchip NPUs. Features include Docker-based conversion and …☆26May 18, 2025Updated last year
- ☆17Jan 18, 2025Updated last year
- Library for creating serverside content using Animated-Java for custom models and animations.☆28Jun 18, 2026Updated 2 months ago
- OpenNVR is a security-first, open-source AI-powered NVR platform. Built for scalability and flexibility, it supports real-time video proc…☆74Updated this week
- ☆32Mar 13, 2025Updated last year
- A fully local document intelligence system that allows users to build a persistent private knowledge base from documents and query it usi…☆18Apr 15, 2026Updated 4 months ago
- A Simple, Explainable Vision Language Model for detecting manifacturing defects into products☆17Sep 23, 2025Updated 11 months ago
- Stop MITM on the first SSH connection, on any VPS/cloud provider☆27May 8, 2026Updated 3 months ago
- Official repository for paper: Code Aesthetics with Agentic Reward Feedback☆19Jan 27, 2026Updated 7 months ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- ☆20Jun 18, 2025Updated last year
- The rkllm server which is compatible with OpenAI API, Ollama API, and Claude API format.☆51Mar 22, 2026Updated 5 months ago
- Qwen3-VL-2B on the RK3588 NPU☆40Jul 22, 2026Updated last month
- NVIDIA-accelerated visual-only mapping and global localization☆22Aug 19, 2026Updated last week
- This toolkit is used to evaluate trackers on infrared UAV tracking benchmark called CST Anti—UAV.☆28Jul 6, 2026Updated last month
- ☆27Aug 1, 2026Updated 3 weeks ago
- Learning Continuous Grasping Function with a Dexterous Hand from Human Demonstrations, RA-L 2023☆25Aug 28, 2024Updated 2 years ago