OpenAI-compatible API server for Rockchip NPU (RK3588/RK3576) — local LLM inference on Orange Pi with Open WebUI support
☆25Aug 25, 2026Updated 3 weeks ago
Alternatives and similar repositories for RKLLM-API-Server
Users that are interested in RKLLM-API-Server are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- PaddleOCR Lite license plate detection on bare Raspberry Pi 4☆12Apr 16, 2024Updated 2 years ago
- Llama.cpp with the Rockchip NPU integration as a GGML backend.☆278Aug 30, 2026Updated 2 weeks ago
- ☆51Jun 26, 2026Updated 2 months ago
- Proxmox VE port kernel☆34Jul 16, 2026Updated 2 months ago
- Build a Debian APT repository from packages on GitHub☆17Updated this week
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- This project aims to provide a quick and efficient way to capture any thought to your AnyType second brain. It leverages the protobuf GRP…☆16Aug 26, 2024Updated 2 years ago
- 1、基于gensim的word2vec模型的训练 2、基于skip_gram模型的词向量模型的训练 3、词向量模型的评估（近义词、反义词） 4、兼容基于gensim的word2vec模型的训练、基于skip_gram模型的词向量模型的训练的增量模型的训练 5、转换词向量☆10Jul 1, 2020Updated 6 years ago
- ☆17May 20, 2026Updated 3 months ago
- Ollama alternative for Rockchip NPU: An efficient solution for running AI and Deep learning models on Rockchip devices with optimized NPU…☆605Aug 25, 2026Updated 3 weeks ago
- This repository is a mirror of https://git.openwrt.org/openwrt/openwrt.git It is for reference only and is not active for check-ins or fo…☆21Aug 18, 2026Updated last month
- Alpha Rover Project☆15Sep 11, 2025Updated last year
- To convert CosyVoice model to ONNX☆16Dec 22, 2025Updated 8 months ago
- eProsima extended ROS 2 distribution. Looking for commercial support? Contact info@eprosima.com☆32Updated this week
- GhostStream turns any PC into a GPU–powered transcoding backend for your self-hosted apps. HLS, ABR, HDR→SDR, hardware detection, zero co…☆29May 13, 2026Updated 4 months ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- A thread safe implementation of ByteTrack with (COCO) labels.☆16Jul 7, 2026Updated 2 months ago
- Export and Run Hugging Face Transformers Models on Rockchip NPUs☆27Dec 2, 2025Updated 9 months ago
- [CVPR25 Event Camera Workshop] Official repository for "EV-Flying: an Event-based Dataset for In-The-Wild Recognition of Flying Objects".☆17Apr 20, 2026Updated 4 months ago
- ☆24Feb 22, 2026Updated 6 months ago
- PaddleOCR Lite document scanner on bare Raspberry Pi 4☆31Mar 15, 2026Updated 6 months ago
- ☆16Jan 18, 2025Updated last year
- Automated converter for ONNX models (particularly ESRGAN) to RKNN format for Rockchip NPUs. Features include Docker-based conversion and …☆27May 18, 2025Updated last year
- ☆33Mar 13, 2025Updated last year
- A fully local document intelligence system that allows users to build a persistent private knowledge base from documents and query it usi…☆19Apr 15, 2026Updated 5 months ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- A Simple, Explainable Vision Language Model for detecting manifacturing defects into products☆17Sep 23, 2025Updated 11 months ago
- Stop MITM on the first SSH connection, on any VPS/cloud provider☆27Sep 6, 2026Updated last week
- Media-monitoring app for tracking your keywords across Twitter and Telegram☆17Dec 7, 2022Updated 3 years ago
- Official repository for paper: Code Aesthetics with Agentic Reward Feedback☆20Jan 27, 2026Updated 7 months ago
- ☆22Jun 18, 2025Updated last year
- The rkllm server which is compatible with OpenAI API, Ollama API, and Claude API format.☆51Mar 22, 2026Updated 5 months ago
- Demo of ME-rPPG, streaming BVP & heart rate inference☆16May 10, 2025Updated last year
- NVIDIA-accelerated visual-only mapping and global localization☆23Aug 19, 2026Updated last month
- This toolkit is used to evaluate trackers on infrared UAV tracking benchmark called CST Anti—UAV.☆29Sep 6, 2026Updated last week
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- OpenNVR is a security-first, open-source AI-powered NVR platform. Built for scalability and flexibility, it supports real-time video proc…☆101Updated this week
- YoloV5 NPU multithread for the RK3566/68/88 (200 FPS)☆33Dec 24, 2024Updated last year
- Learning Continuous Grasping Function with a Dexterous Hand from Human Demonstrations, RA-L 2023☆25Aug 28, 2024Updated 2 years ago
- Generate 3D models of aruco markers to 3D print☆19Mar 19, 2025Updated last year
- ☆17Jan 7, 2024Updated 2 years ago
- Tools, ComfyUI workflows and benchmark configs from a 4x RTX 3090 local-inference rig☆295Updated this week
- Search-based low-intelligence international chess AI with visible UI☆31Aug 5, 2023Updated 3 years ago