An OpenAI-compatible API server for Rockchip NPUs (RK3588/RK3576). Run LLMs locally on the edge with hardware acceleration.
☆20Mar 20, 2026Updated 7 months ago
Alternatives and similar repositories for rkllm-openai
Users that are interested in rkllm-openai are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- RK3576 NPU mainlining and bring-up☆17Updated this week
- rkllm rust ffi binding☆13Oct 19, 2026Updated 2 weeks ago
- Hardware reference and research notes for the RK3588 NPU and its regcmd interface☆28Updated this week
- RK3588-based face recognition attendance system with a rich Qt interface, utilizing YOLO and MBF models integrated with an LLM Agent fo…☆19Jun 29, 2026Updated 4 months ago
- Run RKLLM only in one docker command. Already converted models here.☆21Oct 23, 2026Updated last week
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- This code repository is the source code of the paper "Deep Long-Range Spatiotemporal Dependency Synthetic Minority Oversampling Technique…☆15Nov 21, 2025Updated 11 months ago
- 基于 RK3576 的多并发视频智能分析平台：全链路零拷贝、硬件编解码、模型推理与流媒体高并发代理。☆17Mar 18, 2026Updated 7 months ago
- Userspace driver, matmul, and on-NPU op library for Rockchip NPUs (RK3588 & Subset on RK3576) via the mainline rocket DRM-accel driver☆23Updated this week
- Drop-in ggml backend for Rockchip NPUs: offloads llama.cpp/whisper.cpp prefill to the RK3588 NPU☆25Updated this week
- The open-source code of "CS-SHAP: Extending SHAP to "SHapley Estimated Explanation (SHEP): A Fast post-hoc attribution method for interpr…☆18Jan 22, 2026Updated 9 months ago
- The rkllm server which is compatible with OpenAI API, Ollama API, and Claude API format.☆53Mar 22, 2026Updated 7 months ago
- Realtime charting of live go-metrics metrics data.☆10May 28, 2019Updated 7 years ago
- ☆11Feb 11, 2025Updated last year
- 本项目致力于设计和实现一个创新的基于嵌入式AI的ROI区域视频传输系统，旨在通过智能识别和优先传输视频中的关键区域（ROI），大幅提高视频监控和远程通信的效率与质量。利用先进的嵌入式AI技术，本系统能够在不牺牲视频质量的前提下，显著降低数据传输的带宽需求，为安全监控、远程教…☆18Oct 23, 2025Updated last year
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- ☆12Feb 8, 2024Updated 2 years ago
- Wrapping a socks5 proxy client to be HTTP/HTTPS proxy☆13Apr 22, 2015Updated 11 years ago
- 在rk3588上实现硬件编解码，并接入live555进行推拉流☆23Mar 17, 2025Updated last year
- A replay system with Entitas framework.☆14Oct 24, 2017Updated 9 years ago
- The open-source code of "CS-SHAP: Extending SHAP to Cyclic-Spectral Domain for Better Interpretability of Intelligent Fault Diagnosis".☆19Jul 12, 2025Updated last year
- Qwen3-ASR-FastAPI-Docker: Lightweight FastAPI service containerizing Qwen3-ASR for low-latency multilingual speech, music, and singing re…☆15Jan 31, 2026Updated 9 months ago
- transparent proxy to cccccros the GFW, cooperate with iptables; also see redsocks: https://github.com/darkk/redsocks☆10Jun 5, 2017Updated 9 years ago
- Generate lk2nd and U-Boot based bootchain for msm8916 devices☆14Apr 26, 2025Updated last year
- A Rust-based, OpenAI-style API server for large language models (LLMs)☆25Sep 28, 2026Updated last month
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Local, offline AI for RimWorld. Runs Phi-3 on your own machine to generate in-game content. No API keys, no cloud.☆10Oct 15, 2026Updated 2 weeks ago
- UEFI firmware for RK3576 devices☆22Oct 24, 2026Updated last week
- Behavior Tree in Go☆13Feb 9, 2020Updated 6 years ago
- Configuration file parser for INI format☆10Jun 22, 2012Updated 14 years ago
- GLM-5.3-Flash EXL3 K2 2.33bpw on ONE DGX Spark: native MTP (layer 45, 288 experts), CUDA graphs on, full 262,144 ctx. Measured ~19 tok/s …☆11Sep 19, 2026Updated last month
- A high performance authentication and access-control gateway for LLM API backends☆17Jun 11, 2026Updated 4 months ago
- A Go wrapper for the C based ENet UDP network library.☆10Jan 8, 2021Updated 5 years ago
- A cross-platform graphical utility for Rockchip firmware flashing and partition management on macOS and Linux☆68Updated this week
- A Rust-native LLM serving engine. One binary, no Python runtime.☆21Updated this week
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- Out-of-tree mainline Linux patches for Rockchip RK3588☆34Jul 1, 2026Updated 4 months ago
- ☆21Oct 6, 2026Updated 3 weeks ago
- 一个为Claude Code定制的 UEFI/BIOS 固件安全漏洞分析技能。将资深 BIOS 安全研究者积累的经验打包为可复用的 AI 能力，覆盖从固件镜像解析、深度解压、微码提取、证书审计到最终报告输出的全流程。A Claude Code skill for compr…☆18Jun 3, 2026Updated 5 months ago
- unity3d里面用来生成vr视频的脚本☆10Feb 4, 2017Updated 9 years ago
- rkdeveloptool porting to wasm/webusb☆36May 27, 2026Updated 5 months ago
- A modular Python bot for World of Warships, automating port and battle routines with image recognition and hotkey control. / 一个模块化的《战舰世界》…☆22Mar 3, 2026Updated 8 months ago
- Inference code for Haas, fast and accurate Japanese speech recognition☆34Updated this week