The rkllm server which is compatible with OpenAI API, Ollama API, and Claude API format.
☆53Mar 22, 2026Updated 7 months ago
Alternatives and similar repositories for rkllm_openai_like_api
Users that are interested in rkllm_openai_like_api are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- An OpenAI-compatible API server for Rockchip NPUs (RK3588/RK3576). Run LLMs locally on the edge with hardware acceleration.☆20Mar 20, 2026Updated 7 months ago
- Easy installation and usage of Rockchip's NPUs found in RK3588 and similar SoCs☆255Aug 3, 2025Updated last year
- Armbian Linux Build Framework☆36Apr 20, 2024Updated 2 years ago
- ☆23Updated this week
- OpenAI-compatible API server for Rockchip NPU (RK3588/RK3576) — local LLM inference on Orange Pi with Open WebUI support☆28Aug 25, 2026Updated 2 months ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- Redroid images for Rockchip RK3588 series SoC☆378Jan 24, 2026Updated 9 months ago
- ☆18Updated this week
- ☆23Updated this week
- 将LLM 模型部署到 Rockchip Rk3588芯片中，在开发板上使用NPU进行推理☆93Oct 6, 2024Updated 2 years ago
- Web chat front end for rk3588_npu_llm_server / RK3588 LLM chat interface☆16Jul 16, 2024Updated 2 years ago
- uboot mod for ipq40xx devices☆10Feb 16, 2026Updated 8 months ago
- 只有中文! 一步步教你在RK3588(Debian-based OS)上运行各种游戏☆114Jan 3, 2023Updated 3 years ago
- ☆16Oct 27, 2026Updated last week
- 常用的docker镜像☆12Aug 13, 2026Updated 2 months ago
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- ☆10Oct 16, 2024Updated 2 years ago
- coolpi 4b/cm5☆13Jul 15, 2024Updated 2 years ago
- This repo is deprecated, please use https://github.com/radxa-repo/rbuild instead☆130Mar 22, 2024Updated 2 years ago
- ☆16Jan 16, 2025Updated last year
- PWM fan speed control for rock5B; ROCK5B风扇速度控制软件。☆119Oct 28, 2023Updated 3 years ago
- ☆13Jul 29, 2023Updated 3 years ago
- Access the statistics plug-in for Typecho, which supports data visualization.☆13Sep 23, 2026Updated last month
- ArControl: Arduino UNO/Mega based, visual programming & real-time behavioral platform for neuroscience. It can run Go/No-Go, 2AFPC and O…☆23Jan 2, 2024Updated 2 years ago
- pve安装dxp4800虚拟机，解决在线更新系统问题☆19Jul 19, 2024Updated 2 years ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- Deb packages for gpu and vpu☆16Sep 28, 2026Updated last month
- Rock5B/RK3588工具箱☆59May 16, 2024Updated 2 years ago
- ROCK 5B☆84Jul 24, 2026Updated 3 months ago
- chinese-laya☆17Oct 13, 2026Updated 3 weeks ago
- A universal IPv4 to IPv6 virtual host reverse proxy☆12Jul 10, 2025Updated last year
- ESPHome component for Kältebringer climates☆14May 22, 2026Updated 5 months ago
- Export and Run Hugging Face Transformers Models on Rockchip NPUs☆28Dec 2, 2025Updated 11 months ago
- Rockchip Userspace Mali GPU Driver and Debian Packages (Mirror of https://github.com/JeffyCN/mirrors/tree/libmali) (See Also: https://git…☆250Sep 22, 2026Updated last month
- Allows access via HTTP to LLM running on RK3588 NPU. Returns JSON response.☆29May 29, 2024Updated 2 years ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- ContainerNetwork AutoFix (CNAF) - Automatically recreates dependent containers when master container restarts☆15Oct 17, 2025Updated last year
- Arch Linux ARM image builder and installer for aarch64 UEFI devices, focusing on rk3588☆73Jan 19, 2026Updated 9 months ago
- images for n2ns-1☆11Aug 20, 2024Updated 2 years ago
- On-device speech AI runtime for ASR, TTS, VAD, and voice cloning. Python-simple, C++-native, GGUF-powered.☆32Aug 7, 2026Updated 3 months ago
- ☆13Sep 4, 2025Updated last year
- Multiplatform serial communications library☆18Jun 5, 2025Updated last year
- ESP32 port of the keyble library☆15May 22, 2023Updated 3 years ago