A Rust-based, OpenAI-style API server for large language models (LLMs)
☆19Mar 26, 2026Updated 2 weeks ago
Alternatives and similar repositories for llmserver-rs
Users that are interested in llmserver-rs are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Qwen3-VL-2B on the RK3588 NPU☆26Feb 2, 2026Updated 2 months ago
- Ollama alternative for Rockchip NPU: An efficient solution for running AI and Deep learning models on Rockchip devices with optimized NPU…☆495Mar 26, 2026Updated 2 weeks ago
- Streaming TTS based on Piper with optional RK3588 NPU support☆126Feb 28, 2026Updated last month
- Easy installation and usage of Rockchip's NPUs found in RK3588 and similar SoCs☆236Aug 3, 2025Updated 8 months ago
- 🖥️ myrktop - Orange Pi 5 (RK3588) System Monitoring script CPU,RAM,NPU,GPU,TEMPERATURES☆30Apr 22, 2025Updated 11 months ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Web chat front end for rk3588_npu_llm_server / RK3588 LLM chat interface☆16Jul 16, 2024Updated last year
- ☆13Jan 28, 2026Updated 2 months ago
- 目前市面上图形化编程教育游戏机大多是基于MakeCode Arcade设计，但MakeCode并不符合中国教育环境，大部分人只熟悉Scratch图形编程，于是诞生了这个基于Scratch设计的游戏机。☆16Dec 23, 2024Updated last year
- CGO bindings to RKNN-Toolkit2 to perform Inferencing in Go on Rockchip NPU☆174Mar 21, 2026Updated 3 weeks ago
- yolov8 旋转目标检测部署，瑞芯微RKNN芯片部署、地平线Horizon芯片部署、TensorRT部署☆28Jun 4, 2024Updated last year
- Python command-line tool for interacting with AI models through the OpenRouter API/Cloudflare AI Gateway, or local self-hosted Ollama. O…☆21Dec 28, 2025Updated 3 months ago
- Create 3D files in the CLI with Small Language Model☆44Oct 15, 2025Updated 5 months ago
- ☆14Apr 8, 2025Updated last year
- LDC: Lightweight Dense CNN for Edge DetectionのPythonでのONNX推論サンプル☆15May 6, 2023Updated 2 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- DETR tensor去除推理过程无用辅助头+fp16部署再次加速+解决转tensorrt 输出全为0问题的新方法。☆11Jan 9, 2024Updated 2 years ago
- ☆11Jun 17, 2025Updated 9 months ago
- ESP32 based version of WireShark compatible nRF24/RFM7x packet sniffer☆12May 2, 2020Updated 5 years ago
- The installation of the InsightFace package on a Windows environment, including the necessary dependencies and configurations.☆17Sep 10, 2024Updated last year
- 使用OpenCV部署图像描述Image_Captioning，包含C++和Python两个版本的程序☆12Dec 22, 2023Updated 2 years ago
- Provides ComfyUI nodes for OIDN image denoising☆10Nov 27, 2024Updated last year
- yolov5_obb C++ onnxruntime deployment☆10Mar 11, 2024Updated 2 years ago
- NextCaligo is a VPS infrastructure management system that allows you to deploy and manage Linux containers from a web interface. Create …☆10Apr 15, 2024Updated last year
- ☆13Jan 6, 2022Updated 4 years ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- Python scripts performing Open Vocabulary Object Detection using the YOLO-World model in ONNX. And Export the ONNX model for AXera's NPU☆12Aug 11, 2025Updated 8 months ago
- ff-rknn - Real-time Object Detection with NPU (Rockchip)☆14Sep 5, 2023Updated 2 years ago
- ☆12Oct 7, 2018Updated 7 years ago
- ComfyUI nodes to use DiLightNet☆11Oct 6, 2024Updated last year
- Traccar reverse geocoding service☆189Mar 24, 2026Updated 3 weeks ago
- ComfyUI-KokoroTTS: A text-to-speech model that utilizes the Kokoro TTS framework to convert text into natural-sounding speech. It suppor…☆14Apr 18, 2025Updated 11 months ago
- MangoPI MQ-Quad board Linux (Allwinner H616)☆12Apr 6, 2023Updated 3 years ago
- MeloTTS demo on Axera☆12Nov 18, 2025Updated 4 months ago
- User and Programmer Tutorials for JeVois☆14Feb 6, 2025Updated last year
- Wordpress hosting with auto-scaling - Free Trial • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- A simplified build of Super Mario War specific to the Raspberry Pi☆11Jan 14, 2017Updated 9 years ago
- OpenAI Whisper demo on Axera☆15Jan 15, 2026Updated 2 months ago
- ILI9225 SPI TFT Library for RaspberryPi/OrangePi☆22Feb 27, 2020Updated 6 years ago
- Mirror of ONScripter official source code.☆15Jan 2, 2023Updated 3 years ago
- Demonstrates different validation strategies with MVVM Toolkit☆12May 19, 2021Updated 4 years ago
- ☆16Jun 8, 2021Updated 4 years ago
- This repository is a mirror of https://git.openwrt.org/openwrt/openwrt.git It is for reference only and is not active for check-ins. We …☆12Mar 10, 2026Updated last month