A Rust-based, OpenAI-style API server for large language models (LLMs)
☆25Mar 26, 2026Updated 4 months ago
Alternatives and similar repositories for llmserver-rs
Users that are interested in llmserver-rs are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- A Rust-based, SenseVoiceSmall☆39Apr 27, 2026Updated 3 months ago
- RKLLM API Server - Open WebUI Managed Version☆19Updated this week
- Ollama alternative for Rockchip NPU: An efficient solution for running AI and Deep learning models on Rockchip devices with optimized NPU…☆584Jul 7, 2026Updated last month
- Automated script to convert Huggingface and GGUF models to rkllm format for running on Rockchip NPU☆48Nov 11, 2024Updated last year
- rknn rust ffi binding☆19Feb 26, 2026Updated 5 months ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Easy installation and usage of Rockchip's NPUs found in RK3588 and similar SoCs☆252Aug 3, 2025Updated last year
- Streaming TTS based on Piper with optional RK3588 NPU support☆134Feb 28, 2026Updated 5 months ago
- Qwen3-VL-2B on the RK3588 NPU☆38Jul 22, 2026Updated 3 weeks ago
- 🖥️ myrktop - Orange Pi 5 (RK3588) System Monitoring script CPU,RAM,NPU,GPU,TEMPERATURES☆32Apr 20, 2026Updated 3 months ago
- Web chat front end for rk3588_npu_llm_server / RK3588 LLM chat interface☆16Jul 16, 2024Updated 2 years ago
- A high performance authentication and access-control gateway for LLM API backends☆16Jun 11, 2026Updated 2 months ago
- PaddleOCR Lite license plate detection on bare Raspberry Pi 4☆12Apr 16, 2024Updated 2 years ago
- Automated converter for ONNX models (particularly ESRGAN) to RKNN format for Rockchip NPUs. Features include Docker-based conversion and …☆26May 18, 2025Updated last year
- Developing K - a language model to generate OPENSCAD code from prompt☆19Dec 3, 2025Updated 8 months ago
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- openFrameworks implementation of whisper.cpp☆13Sep 14, 2023Updated 2 years ago
- Converts CLIP models to ONNX☆11Jan 17, 2023Updated 3 years ago
- LDC: Lightweight Dense CNN for Edge DetectionのPythonでのONNX推論サンプル☆15May 6, 2023Updated 3 years ago
- mp3-proxy-MusicVN-for-xiaozhi-music☆16Nov 5, 2025Updated 9 months ago
- linux allwinner h616 kernel based on the orangepi zero 2 version of the legacy allwinner 4.9 bsp kernel☆10Jan 25, 2021Updated 5 years ago
- ☆14Apr 8, 2025Updated last year
- Qwen 3.5 in C☆24Mar 28, 2026Updated 4 months ago
- ☆14Feb 13, 2024Updated 2 years ago
- Example of onnx quantization☆11Feb 8, 2023Updated 3 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Investigation of the core VPN technologies | Penetration testing of an IPsec-VPN (using Ike-scan and psk-crack) | MitM Attack on PPTP-VPN…☆16May 15, 2016Updated 10 years ago
- ComfyUI-KokoroTTS: A text-to-speech model that utilizes the Kokoro TTS framework to convert text into natural-sounding speech. It suppor…☆13Apr 18, 2025Updated last year
- User and Programmer Tutorials for JeVois☆14Feb 6, 2025Updated last year
- A simplified build of Super Mario War specific to the Raspberry Pi☆11Jan 14, 2017Updated 9 years ago
- ☆18Jan 28, 2026Updated 6 months ago
- Mirror of ONScripter official source code.☆15Jan 2, 2023Updated 3 years ago
- Simple inference for Vits2 TTS Using ONNXRUNTIME and espeak-ng on C++☆19Apr 17, 2024Updated 2 years ago
- 最寄り駅の電車が何分後に来るか表示します。☆11Aug 25, 2019Updated 6 years ago
- MangoPI MQ-Quad board Linux (Allwinner H616)☆12Apr 6, 2023Updated 3 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- ☆11Feb 13, 2024Updated 2 years ago
- ☆48Jun 26, 2026Updated last month
- ☆12Nov 9, 2019Updated 6 years ago
- Train model from scratch and save to OpenMV☆11Jul 22, 2026Updated 3 weeks ago
- This repository contains guide on how to setup toolkits to use NPU present on Axon for running various CNN models☆36Apr 14, 2026Updated 4 months ago
- ☆11Jul 30, 2025Updated last year
- M5Stack dropdown menu code sample☆15Feb 5, 2019Updated 7 years ago