Web chat front end for rk3588_npu_llm_server / RK3588 LLM chat interface
☆16Jul 16, 2024Updated 2 years ago
Alternatives and similar repositories for NPU-Chat
Users that are interested in NPU-Chat are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Allows access via HTTP to LLM running on RK3588 NPU. Returns JSON response.☆29May 29, 2024Updated 2 years ago
- rkllm_talking is a standalone compiled voice communication system based on a large model || rkllm_talking 是一个独立编译的基于大模…☆15Oct 13, 2024Updated 2 years ago
- Easier usage of LLMs in Rockchip's NPU on SBCs like Orange Pi 5 and Radxa Rock 5 series☆200Aug 3, 2025Updated last year
- Easy installation and usage of Rockchip's NPUs found in RK3588 and similar SoCs☆255Aug 3, 2025Updated last year
- ☆36Aug 4, 2026Updated 2 months ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- This repository contains guide on how to setup toolkits to use NPU present on Axon for running various CNN models☆38Updated this week
- 将LLM 模型部署到 Rockchip Rk3588芯片中，在开发板上使用NPU进行推理☆93Oct 6, 2024Updated 2 years ago
- Linear Algebra and Deep Learning Zig library with GPGPU and heterogeneous computing☆11Aug 26, 2026Updated 2 months ago
- 这是一个基于 DotsOCR 库开发的 OCR（光学字符识别）处理工具箱，包含 PDF 转 Word (DOCX) 的完整应用。 本项目旨在提供简单易用的工具，帮助用户将 PDF 文档或图片转换为可编 辑的 Word 文档或 Markdown 格式，支持复杂的版面分析（如表…☆17Dec 15, 2025Updated 10 months ago
- ☆11Nov 4, 2021Updated 5 years ago
- Self-hosted, NPU-accelerated LLM chat on Turing RK1 running Talos Linux☆12Updated this week
- Streaming TTS based on Piper with optional RK3588 NPU support☆136Feb 28, 2026Updated 8 months ago
- MegaD HomeAssistant integration☆22Sep 16, 2025Updated last year
- Dockerfiles for poetry/mlc-llm(rk3588)/...☆10Sep 13, 2023Updated 3 years ago
- Simple, predictable pricing with DigitalOcean hosting • AdAlways know what you'll pay with monthly caps and flat pricing. Enterprise-grade infrastructure trusted by 600k+ customers.
- ☆16Mar 16, 2026Updated 7 months ago
- Simple class for driving a st7735s LCD display in python 3☆11Nov 1, 2018Updated 8 years ago
- ContainerNetwork AutoFix (CNAF) - Automatically recreates dependent containers when master container restarts☆15Oct 17, 2025Updated last year
- A Rust-based, OpenAI-style API server for large language models (LLMs)☆25Sep 28, 2026Updated last month
- ☆21Oct 6, 2026Updated 3 weeks ago
- This custom component for Home Assistant allows you to generate text responses using GigaChain LLM framework (like GigaChat, YandexGPT, C…☆19Oct 11, 2026Updated 3 weeks ago
- Hardware reference and research notes for the RK3588 NPU and its regcmd interface☆28Updated this week
- AI agent that helps you learn Tinygrad and updates you on the bounties☆14Aug 5, 2025Updated last year
- experimental ui (underconstruction)☆15May 2, 2025Updated last year
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- Open Sourse MicroPython Car☆27Jun 25, 2025Updated last year
- ☆13Jan 31, 2024Updated 2 years ago
- MegaD for home assistant☆32Oct 11, 2026Updated 3 weeks ago
- Wirehole like container setup with inclusion of wireguard control gui by WeeJeWel☆13May 30, 2022Updated 4 years ago
- ☆53Feb 18, 2025Updated last year
- KiCad footprints for Mini PCI Express cards☆13Mar 6, 2020Updated 6 years ago
- Run ops on Apple ANE in NPU register with pure python on M1 Asahi Linux. No Espresso, No CoreML, no metal, no .mlmodels file, no .hwx fil…☆21Oct 8, 2026Updated 3 weeks ago
- Useful resources for developing with the RK3588.☆611Dec 7, 2025Updated 10 months ago
- SmolVLM2 on the RK3588 NPU☆13Jul 25, 2026Updated 3 months ago
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- CLI tool to control your Turing Pi 2 board☆61Feb 23, 2025Updated last year
- Llama.cpp with the Rockchip NPU integration as a GGML backend.☆283Oct 7, 2026Updated 3 weeks ago
- Matrix multiplication on the NPU inside RK3588☆18Jun 27, 2024Updated 2 years ago
- ☆12Sep 30, 2021Updated 5 years ago
- An obsidian plugin to post to linkedin directly from the obsidian app.☆10Apr 27, 2024Updated 2 years ago
- Hit it（攻击它），为个人编写的渗透练习靶场，使用java8+html进行编写，方便用户部署起见，前后端不分离，mysql版本使用5及以上（不含5.6），windows环境开发，支持linux部署☆10Nov 2, 2021Updated 5 years ago
- Reverse engineering the rk3588 npu☆132May 30, 2024Updated 2 years ago