OpenAI-compatible API server for Rockchip NPU (RK3588/RK3576) — local LLM inference on Orange Pi with Open WebUI support
☆27Aug 25, 2026Updated 2 months ago
Alternatives and similar repositories for RKLLM-API-Server
Users that are interested in RKLLM-API-Server are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- rkllm rust ffi binding☆13Oct 19, 2026Updated last week
- A Rust-based, OpenAI-style API server for large language models (LLMs)☆25Sep 28, 2026Updated last month
- ☆11Feb 3, 2025Updated last year
- miniblink go☆11Jan 7, 2024Updated 2 years ago
- A Deeplearn Model to rec table in photo with ncnn. 一个深度学习模型用于检测图片中的表格 画像内のテーブルを検出するためのディープラーニング モデル☆20Mar 2, 2025Updated last year
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- GLM-5.3-Flash EXL3 K2 2.33bpw on ONE DGX Spark: native MTP (layer 45, 288 experts), CUDA graphs on, full 262,144 ctx. Measured ~19 tok/s …☆11Sep 19, 2026Updated last month
- A Rust-native LLM serving engine. One binary, no Python runtime.☆21Updated this week
- A high performance authentication and access-control gateway for LLM API backends☆17Jun 11, 2026Updated 4 months ago
- FortiAnalyzer mimick using an ELK stack☆12Aug 3, 2020Updated 6 years ago
- PaddleOCR Lite license plate detection on bare Raspberry Pi 4☆12Apr 16, 2024Updated 2 years ago
- Deploy streaming ASR + TTS on RK3576/RK3588 — 120ms TTS, 52-language ASR, one Docker command☆46Updated this week
- The rkllm server which is compatible with OpenAI API, Ollama API, and Claude API format.☆53Mar 22, 2026Updated 7 months ago
- Ollama alternative for Rockchip NPU: An efficient solution for running AI and Deep learning models on Rockchip devices with optimized NPU…☆618Updated this week
- This repository is created to provide a straight forward reference for running Custom Yolov5 models on the NPU for Orangepi 5 boards - RK…☆13Feb 19, 2025Updated last year
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- CMS 120 - Introduction to Computer Science☆27Updated this week
- 这是一个基于everything-claude-code仓库编写的一份的ecc使用指南。在本人不断的使用中，我将持续更新这个仓库，欢迎大家讨论自己的使用技巧☆15Jun 25, 2026Updated 4 months ago
- Llama.cpp with the Rockchip NPU integration as a GGML backend.☆283Oct 7, 2026Updated 3 weeks ago
- ☆55Jun 26, 2026Updated 4 months ago
- Build a Debian APT repository from packages on GitHub☆17Updated this week
- Simple Implementation of TinyGPTV in super simple Zeta lego blocks☆16Nov 11, 2024Updated last year
- A rabbit hole you shouldn't enter, once entered you can't get out. | Recording tools☆16Dec 8, 2022Updated 3 years ago
- Fast and memory-efficient exact attention☆11Oct 21, 2026Updated last week
- Application for converting Gerber solder mask files into g-code, to use on an extruding solder paste 3D printer☆17Dec 4, 2019Updated 6 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- chatgpt库的调用, 支持流式和非流式，可以实现类似官方chatgpt的显示效果☆11Jan 30, 2024Updated 2 years ago
- ☆15Jan 1, 2026Updated 9 months ago
- Qwen3.8 Local Coding on a 16GB GPU☆26Sep 18, 2026Updated last month
- ResFi - a framework supporting creation of RRM functionality in residential WiFi deployments.☆11Jun 1, 2017Updated 9 years ago
- mp3-proxy-MusicVN-for-xiaozhi-music☆19Nov 5, 2025Updated 11 months ago
- Open source PHP based Inventory / WMS management for the rest of us☆29Updated this week
- 基于YOLOv11的交通信号灯检测，包含完整程序及网页端界面显示☆17Apr 8, 2025Updated last year
- Fast reactive RF jammer for 2.4GHz FHSS signals using dual HackRF SDRs - DJI drone tested☆22Feb 5, 2026Updated 8 months ago
- Omnichannel Video Auto-Scheduler & Desktop Studio☆21Oct 1, 2026Updated 3 weeks ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Data preparation utility for the finetuning of OpenAI's Whisper model.☆18Sep 17, 2026Updated last month
- MBRjun-Blog 的源码仓库（Hexo 版） • 我们生活在大地上，但我们的梦想超越天空☆18Oct 12, 2026Updated 2 weeks ago
- SDK for Pacecat LDS-M300 LiDAR☆10Dec 5, 2025Updated 10 months ago
- Fire & Smoke Detection Algorithm☆11Dec 2, 2023Updated 2 years ago
- ☆17May 20, 2026Updated 5 months ago
- An unbiased CPU benchmark by OpenCV that provides an evaluation of different CPUs under real-world computer vision and AI workloads.☆12Aug 20, 2026Updated 2 months ago
- Fastest way to setup a docker based GAZEBO-PX4-ROS2 SITL project☆11Nov 30, 2024Updated last year