The rkllm server which is compatible with OpenAI API, Ollama API, and Claude API format.
☆52Mar 22, 2026Updated 6 months ago
Alternatives and similar repositories for rkllm_openai_like_api
Users that are interested in rkllm_openai_like_api are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Dockerfiles for poetry/mlc-llm(rk3588)/...☆10Sep 13, 2023Updated 3 years ago
- Easy installation and usage of Rockchip's NPUs found in RK3588 and similar SoCs☆255Aug 3, 2025Updated last year
- ☆23Dec 27, 2025Updated 9 months ago
- openFyde supported hardware RADXA Rock5 Model B build artefacts and pre-built image releases.☆39Mar 18, 2026Updated 6 months ago
- ☆1,695Jun 17, 2026Updated 3 months ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- Redroid images for Rockchip RK3588 series SoC☆371Jan 24, 2026Updated 8 months ago
- 将LLM 模型部署到 Rockchip Rk3588芯片中，在开发板上使用NPU进行推理☆91Oct 6, 2024Updated last year
- ☆18Jan 4, 2025Updated last year
- Easier usage of LLMs in Rockchip's NPU on SBCs like Orange Pi 5 and Radxa Rock 5 series☆200Aug 3, 2025Updated last year
- Llama.cpp with the Rockchip NPU integration as a GGML backend.☆278Aug 30, 2026Updated 3 weeks ago
- coolpi 4b/cm5☆13Jul 15, 2024Updated 2 years ago
- ☆10Oct 16, 2024Updated last year
- Import / export entries with csv on your strapi V5 instance☆13Apr 29, 2026Updated 4 months ago
- This repo is deprecated, please use https://github.com/radxa-repo/rbuild instead☆131Mar 22, 2024Updated 2 years ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- ArControl: Arduino UNO/Mega based, visual programming & real-time behavioral platform for neuroscience. It can run Go/No-Go, 2AFPC and O…☆23Jan 2, 2024Updated 2 years ago
- vite技术揭秘、还原与实战☆10Mar 6, 2024Updated 2 years ago
- Userspace interface to Rockchip RGA 2D accelerator and Debian Packages (Mirror of https://github.com/JeffyCN/mirrors/tree/linux-rga-multi…☆64Jan 20, 2026Updated 8 months ago
- Rock5B/RK3588工具箱☆60May 16, 2024Updated 2 years ago
- ROCK 5B☆83Jul 24, 2026Updated 2 months ago
- OpenAI-compatible API server for Rockchip NPU (RK3588/RK3576) — local LLM inference on Orange Pi with Open WebUI support☆25Aug 25, 2026Updated last month
- On-device speech AI runtime for ASR, TTS, VAD, and voice cloning. Python-simple, C++-native, GGUF-powered.☆29Aug 7, 2026Updated last month
- Decentralized Identifiers refers to a decentralized on-chain mapping of the identity of the real entity, where any individual/organizatio…☆11Jun 9, 2022Updated 4 years ago
- Export and Run Hugging Face Transformers Models on Rockchip NPUs☆27Dec 2, 2025Updated 9 months ago
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- RT-Hypervisor: A real-time hypervisor for automotive embedded system☆14Feb 1, 2023Updated 3 years ago
- Rockchip Userspace Mali GPU Driver and Debian Packages (Mirror of https://github.com/JeffyCN/mirrors/tree/libmali) (See Also: https://git…☆246Updated this week
- XtratuM Mirror☆21Apr 7, 2017Updated 9 years ago
- Communicate with your UPS☆13Aug 4, 2024Updated 2 years ago
- Run stable-diffusion-webui with Radeon RX 580 8GB on Ubuntu 22.04.2 LTS☆13Jul 10, 2023Updated 3 years ago
- rkllm_talking is a standalone compiled voice communication system based on a large model || rkllm_talking 是一个独立编译的基于大模…☆15Oct 13, 2024Updated last year
- Dockerfile for cross compiling environment☆24Aug 13, 2025Updated last year
- pushdeer server by node☆11May 30, 2022Updated 4 years ago
- 🔍 让我帮你google一下？Let Me Google That For You☆14Jul 14, 2020Updated 6 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- PWM fan speed control for rock5B; ROCK5B风扇速度控制软件。☆121Oct 28, 2023Updated 2 years ago
- Support for OpenWrt in Amlogic, Rockchip and Allwinner boxes.☆37Dec 18, 2025Updated 9 months ago
- BU-maintained version of the Jailhouse partitioning hypervisor with real-time features☆16Feb 28, 2021Updated 5 years ago
- 使用esp32+ollama实现本地模型的对话以及联网+工具调用☆159Jul 27, 2025Updated last year
- 本爬虫是一个备份贴吧用的爬虫，他可以从网上下载整个吧的帖子，也可以备份个人的帖子，个人的帖子有你的主题帖，你的回复，你的收藏，你的贴吧，你的被@的，你的粉丝，你的关注，你的举报，你的投诉☆20Dec 7, 2020Updated 5 years ago
- Web chat front end for rk3588_npu_llm_server / RK3588 LLM chat interface☆16Jul 16, 2024Updated 2 years ago
- ZSC - College of Computing New Member Q&A☆14Jul 22, 2023Updated 3 years ago