rkllm rust ffi binding
☆13Oct 19, 2026Updated 2 weeks ago
Alternatives and similar repositories for rkllm-rs
Users that are interested in rkllm-rs are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- A Rust-based, OpenAI-style API server for large language models (LLMs)☆25Sep 28, 2026Updated last month
- OpenAI-compatible API server for Rockchip NPU (RK3588/RK3576) — local LLM inference on Orange Pi with Open WebUI support☆28Aug 25, 2026Updated 2 months ago
- An OpenAI-compatible API server for Rockchip NPUs (RK3588/RK3576). Run LLMs locally on the edge with hardware acceleration.☆20Mar 20, 2026Updated 7 months ago
- rknn rust ffi binding☆20Feb 26, 2026Updated 8 months ago
- A Rust-based, SenseVoiceSmall☆43Sep 28, 2026Updated last month
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- ☆11Feb 3, 2025Updated last year
- ☆52Feb 18, 2025Updated last year
- Go iSCSI initiator netlink library☆15Feb 25, 2023Updated 3 years ago
- rkllm_talking is a standalone compiled voice communication system based on a large model || rkllm_talking 是一个独立编译的基于大模…☆15Oct 13, 2024Updated 2 years ago
- Deploy streaming ASR + TTS on RK3576/RK3588 — 120ms TTS, 52-language ASR, one Docker command☆48Updated this week
- Automated script to convert Huggingface and GGUF models to rkllm format for running on Rockchip NPU☆50Nov 11, 2024Updated last year
- Nearest neighbor search algorithms including a ball tree and a vantage point tree.☆12Oct 2, 2026Updated last month
- Qwen3-ASR-FastAPI-Docker: Lightweight FastAPI service containerizing Qwen3-ASR for low-latency multilingual speech, music, and singing re…☆15Jan 31, 2026Updated 9 months ago
- CS2W Datasets☆14Jul 13, 2024Updated 2 years ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- Multiplatform system monitoring tool using Cosmopolitan Libc☆74May 10, 2026Updated 5 months ago
- GLM-5.3-Flash EXL3 K2 2.33bpw on ONE DGX Spark: native MTP (layer 45, 288 experts), CUDA graphs on, full 262,144 ctx. Measured ~19 tok/s …☆10Sep 19, 2026Updated last month
- Yet Another Rockchip top-like Tool☆12Nov 9, 2025Updated 11 months ago
- A high performance authentication and access-control gateway for LLM API backends☆17Jun 11, 2026Updated 4 months ago
- Mainline Linux 6.18 support for the Orange Pi 4A (Allwinner T527 / A523): HDMI KMS, Mali-G57 Panfrost, WiFi, HDMI audio, ethernet, USB, c…☆15Oct 14, 2026Updated 3 weeks ago
- Rust bindings to libopus☆21Updated this week
- MCP CLI is a tool for managing MCP server configuration files☆13Aug 19, 2026Updated 2 months ago
- images for n2ns-1☆11Aug 20, 2024Updated 2 years ago
- PaddleOCR Lite license plate detection on bare Raspberry Pi 4☆12Apr 16, 2024Updated 2 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Tftp server which can running on Kubernetes.☆11Jan 29, 2021Updated 5 years ago
- Deterministic prompt compression for coding agents, in one Rust binary. Retrievable compression, works locally.☆35Updated this week
- Ollama alternative for Rockchip NPU: An efficient solution for running AI and Deep learning models on Rockchip devices with optimized NPU…☆622Oct 28, 2026Updated last week
- A Rust-native LLM serving engine. One binary, no Python runtime.☆22Updated this week
- This world best SFO editor ever! Support UTF-8.☆18May 22, 2017Updated 9 years ago
- ☆32Mar 13, 2025Updated last year
- DIY Makecode Arcade console with Rp2040 Pico☆17Oct 3, 2023Updated 3 years ago
- BC3-MM(kal) development☆18Apr 10, 2020Updated 6 years ago
- LGT8Fx8P ISP download protocol implementation☆19Nov 10, 2020Updated 5 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- Claude can now control Gemini CLI and Openrouter agents as part of it's swarm, thanks to The Hive! 🐝☆14Sep 7, 2025Updated last year
- CGO bindings to RKNN-Toolkit2 to perform Inferencing in Go on Rockchip NPU☆197May 25, 2026Updated 5 months ago
- This repository is created to provide a straight forward reference for running Custom Yolov5 models on the NPU for Orangepi 5 boards - RK…☆13Feb 19, 2025Updated last year
- 目前市面上图形化编程教育游戏机大多是基于MakeCode Arcade设计，但MakeCode并不符合中国教育环境，大部分人只熟悉Scratch图形编程，于是诞生了这个基于Scratch设计的游戏机。☆20Dec 23, 2024Updated last year
- 🔍 让我帮你google一下？Let Me Google That For You☆14Jul 14, 2020Updated 6 years ago
- pushdeer server by node☆11May 30, 2022Updated 4 years ago
- Virtual Machine used to represent, run, and maintain the state of programs for OpenBlock☆15Jun 9, 2025Updated last year