A Rust-based, OpenAI-style API server for large language models (LLMs)
☆21Mar 26, 2026Updated last month
Alternatives and similar repositories for llmserver-rs
Users that are interested in llmserver-rs are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- A Rust-based, SenseVoiceSmall☆32Apr 27, 2026Updated 3 weeks ago
- Qwen3-VL-2B on the RK3588 NPU☆29Feb 2, 2026Updated 3 months ago
- Ollama alternative for Rockchip NPU: An efficient solution for running AI and Deep learning models on Rockchip devices with optimized NPU…☆540May 18, 2026Updated last week
- Easy installation and usage of Rockchip's NPUs found in RK3588 and similar SoCs☆244Aug 3, 2025Updated 9 months ago
- 🖥️ myrktop - Orange Pi 5 (RK3588) System Monitoring script CPU,RAM,NPU,GPU,TEMPERATURES☆31Apr 20, 2026Updated last month
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- PaddleOCR Lite license plate detection on bare Raspberry Pi 4☆11Apr 16, 2024Updated 2 years ago
- 目前市面上图形化编程教育游戏机大多是基于MakeCode Arcade设计，但MakeCode并不符合中国教育环境，大部分人只熟悉Scratch图形编程，于是诞生了这个基于Scratch设计的游戏机。☆17Dec 23, 2024Updated last year
- yolov8 旋转目标检测部署，瑞芯微RKNN芯片部署、地平线Horizon芯片部署、TensorRT部署☆28Jun 4, 2024Updated last year
- linux allwinner h616 kernel based on the orangepi zero 2 version of the legacy allwinner 4.9 bsp kernel☆10Jan 25, 2021Updated 5 years ago
- Modify Code From rknn-toolkit2☆54Sep 13, 2024Updated last year
- ☆11Jun 17, 2025Updated 11 months ago
- Automated script to convert Huggingface and GGUF models to rkllm format for running on Rockchip NPU☆48Nov 11, 2024Updated last year
- Provides ComfyUI nodes for OIDN image denoising☆11Nov 27, 2024Updated last year
- Lightweight GANを用いてラグナロクオンラインのキャラクター画像を生成するGAN☆12May 13, 2021Updated 5 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Example of onnx quantization☆11Feb 8, 2023Updated 3 years ago
- Rust Bare Metal implementation of Conway's Game of Life for multiple ESP32 based boards☆40May 12, 2026Updated last week
- ☆12Oct 7, 2018Updated 7 years ago
- BreezyLidar - Simple, efficient, Lidar access in Python and C++☆12Dec 2, 2023Updated 2 years ago
- Rewrite of the MVVM App with Community toolkit 8☆11May 14, 2023Updated 3 years ago
- ComfyUI nodes to use DiLightNet☆11Oct 6, 2024Updated last year
- ComfyUI-KokoroTTS: A text-to-speech model that utilizes the Kokoro TTS framework to convert text into natural-sounding speech. It suppor…☆13Apr 18, 2025Updated last year
- MangoPI MQ-Quad board Linux (Allwinner H616)☆12Apr 6, 2023Updated 3 years ago
- A simplified build of Super Mario War specific to the Raspberry Pi☆11Jan 14, 2017Updated 9 years ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- Demonstrates different validation strategies with MVVM Toolkit☆12May 19, 2021Updated 5 years ago
- Matrix multiplication on the NPU inside RK3588☆17Jun 27, 2024Updated last year
- ILI9225 SPI TFT Library for RaspberryPi/OrangePi☆22Feb 27, 2020Updated 6 years ago
- QT5 Linux programmer software for the readind/writing SPI NOR FLASH use the CH347 device.☆16Apr 19, 2024Updated 2 years ago
- This repository is a mirror of https://git.openwrt.org/openwrt/openwrt.git It is for reference only and is not active for check-ins. We …☆15Mar 10, 2026Updated 2 months ago
- ☆16Jun 8, 2021Updated 4 years ago
- ☆11Feb 13, 2024Updated 2 years ago
- ☆11Feb 19, 2020Updated 6 years ago
- A flutter webusb plugin☆25Apr 12, 2023Updated 3 years ago
- End-to-end encrypted email - Proton Mail • AdSpecial offer: 40% Off Yearly / 80% Off First Month. All Proton services are open source and independently audited for security.
- This is a repository which step by step teaches you how to use the "Ultralytics Hub" to train your own yolov8n model and deploy it to FVP…☆14Apr 11, 2025Updated last year
- ☆13Jul 22, 2024Updated last year
- Landmarks are detected by instantiating a class and feeding it with an image☆13May 22, 2022Updated 4 years ago
- Vision Foundation Models: SAM, ViT, CLIP, DINOv2, object detection, segmentation, and multimodal AI for computer vision.☆22Nov 10, 2025Updated 6 months ago
- Attach a debug node to an output to get more information.☆14Jun 14, 2024Updated last year
- Real-time golden ratio pattern - a composition evaluation tool node for ComfyUI. Color, move, rotate and scale the pattern to find new th…☆17Jun 30, 2025Updated 10 months ago
- ☆13Dec 21, 2012Updated 13 years ago