A Rust-based, OpenAI-style API server for large language models (LLMs)
☆25Mar 26, 2026Updated 3 months ago
Alternatives and similar repositories for llmserver-rs
Users that are interested in llmserver-rs are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- A Rust-based, SenseVoiceSmall☆39Apr 27, 2026Updated 2 months ago
- RKLLM API Server - Open WebUI Managed Version☆18Mar 3, 2026Updated 4 months ago
- Ollama alternative for Rockchip NPU: An efficient solution for running AI and Deep learning models on Rockchip devices with optimized NPU…☆577Jul 7, 2026Updated 2 weeks ago
- Easy installation and usage of Rockchip's NPUs found in RK3588 and similar SoCs☆251Aug 3, 2025Updated 11 months ago
- Streaming TTS based on Piper with optional RK3588 NPU support☆133Feb 28, 2026Updated 4 months ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- Qwen3-VL-2B on the RK3588 NPU☆36Updated this week
- Automated converter for ONNX models (particularly ESRGAN) to RKNN format for Rockchip NPUs. Features include Docker-based conversion and …☆26May 18, 2025Updated last year
- Rust bindings to libopus☆21May 2, 2026Updated 2 months ago
- Converts CLIP models to ONNX☆11Jan 17, 2023Updated 3 years ago
- IoT Scanner by ASA - Scan for active IoT devices and find their vulnerabilities☆11Apr 28, 2022Updated 4 years ago
- MegaD for home assistant☆26Jun 12, 2026Updated last month
- linux allwinner h616 kernel based on the orangepi zero 2 version of the legacy allwinner 4.9 bsp kernel☆10Jan 25, 2021Updated 5 years ago
- Bongo cat in python! Good for streaming.☆11Jun 6, 2025Updated last year
- Example of onnx quantization☆11Feb 8, 2023Updated 3 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- A portable console aimed at making pentesting with PowerShell a little easier.☆10Jun 9, 2016Updated 10 years ago
- Python scripts performing Open Vocabulary Object Detection using the YOLO-World model in ONNX. And Export the ONNX model for AXera's NPU☆12Aug 11, 2025Updated 11 months ago
- Provides ComfyUI nodes for OIDN image denoising☆11Nov 27, 2024Updated last year
- Board Package for Logic Green☆24Mar 2, 2025Updated last year
- Investigation of the core VPN technologies | Penetration testing of an IPsec-VPN (using Ike-scan and psk-crack) | MitM Attack on PPTP-VPN…☆16May 15, 2016Updated 10 years ago
- ComfyUI-KokoroTTS: A text-to-speech model that utilizes the Kokoro TTS framework to convert text into natural-sounding speech. It suppor…☆13Apr 18, 2025Updated last year
- MeloTTS demo on Axera☆14Jul 1, 2026Updated 3 weeks ago
- ff-rknn - Real-time Object Detection with NPU (Rockchip)☆14Sep 5, 2023Updated 2 years ago
- ComfyUI nodes to use DiLightNet☆11Oct 6, 2024Updated last year
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Mirror of ONScripter official source code.☆15Jan 2, 2023Updated 3 years ago
- Simple inference for Vits2 TTS Using ONNXRUNTIME and espeak-ng on C++☆19Apr 17, 2024Updated 2 years ago
- External Buildroot tree for STMicroelectronics boards configurations☆12Dec 1, 2025Updated 7 months ago
- MangoPI MQ-Quad board Linux (Allwinner H616)☆12Apr 6, 2023Updated 3 years ago
- ☆11Feb 13, 2024Updated 2 years ago
- ☆48Jun 26, 2026Updated 3 weeks ago
- NextCaligo is a VPS infrastructure management system that allows you to deploy and manage Linux containers from a web interface. Create …☆11Apr 15, 2024Updated 2 years ago
- workspace for radxa devices, such as the radxa rock pro☆16Oct 19, 2015Updated 10 years ago
- Demonstrates different validation strategies with MVVM Toolkit☆12May 19, 2021Updated 5 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- ☆13Jul 22, 2024Updated 2 years ago
- ☆72May 11, 2026Updated 2 months ago
- BMI270 I2C Python Library (bare bones)☆11Apr 28, 2023Updated 3 years ago
- Guide I wrote mostly for myself on how to run mlc-llm on the Orange Pi 5 Pro☆25Aug 15, 2025Updated 11 months ago
- Small Spyware to Steal All Pictures from Gallery, working on telegram api key☆15May 12, 2023Updated 3 years ago
- build debian packages of ROS 1 Noetic on Jammy☆13Feb 13, 2025Updated last year
- A simple-to-use menu system for Bevy which supports gamepad, keyboard or mouse navigation☆31May 12, 2025Updated last year