A Rust-based, OpenAI-style API server for large language models (LLMs)
☆25Mar 26, 2026Updated 5 months ago
Alternatives and similar repositories for llmserver-rs
Users that are interested in llmserver-rs are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- A Rust-based, SenseVoiceSmall☆40Apr 27, 2026Updated 4 months ago
- Automated script to convert Huggingface and GGUF models to rkllm format for running on Rockchip NPU☆49Nov 11, 2024Updated last year
- 🖥️ myrktop - Orange Pi 5 (RK3588) System Monitoring script CPU,RAM,NPU,GPU,TEMPERATURES☆33Aug 25, 2026Updated last week
- Web chat front end for rk3588_npu_llm_server / RK3588 LLM chat interface☆16Jul 16, 2024Updated 2 years ago
- 目前市面上图形化编程教育游戏机大多是基于MakeCode Arcade设计，但MakeCode并不符合中国教育环境，大部分人只熟悉Scratch图形编程，于是诞生了这个基于Scratch设计的游戏机。☆20Dec 23, 2024Updated last year
- Deploy open-source AI quickly and easily - Special Bonus Offer • AdRunpod Hub is built for open source. One-click deployment and autoscaling endpoints without provisioning your own infrastructure.
- Automated converter for ONNX models (particularly ESRGAN) to RKNN format for Rockchip NPUs. Features include Docker-based conversion and …☆26May 18, 2025Updated last year
- yolov8 旋转目标检测部署，瑞芯微RKNN芯片部署、地平线Horizon芯片部署、TensorRT部署☆28Jun 4, 2024Updated 2 years ago
- openFrameworks implementation of whisper.cpp☆13Sep 14, 2023Updated 2 years ago
- based on https://github.com/PimenovAlexander/r4s-bluetooth☆22Feb 20, 2019Updated 7 years ago
- Converts CLIP models to ONNX☆11Jan 17, 2023Updated 3 years ago
- Run Large Language Models on RK3588 with GPU-acceleration☆131Aug 16, 2023Updated 3 years ago
- LDC: Lightweight Dense CNN for Edge DetectionのPythonでのONNX推論サンプル☆15May 6, 2023Updated 3 years ago
- DIY Makecode Arcade console with Rp2040 Pico☆17Oct 3, 2023Updated 2 years ago
- DETR tensor去除推理过程无用辅助头+fp16部署再次加速+解决转tensorrt 输出全为0问题的新方法。☆12Jan 9, 2024Updated 2 years ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- ☆11Jun 17, 2025Updated last year
- linux allwinner h616 kernel based on the orangepi zero 2 version of the legacy allwinner 4.9 bsp kernel☆10Jan 25, 2021Updated 5 years ago
- ☆14Apr 8, 2025Updated last year
- yolov5_obb C++ onnxruntime deployment☆10Mar 11, 2024Updated 2 years ago
- 使用OpenCV部署图像描述Image_Captioning，包含C++和Python两个版本的程序☆12Dec 22, 2023Updated 2 years ago
- StarLine custom card for Home Assistant☆34Mar 25, 2026Updated 5 months ago
- Lightweight GANを用いてラグナロクオンラインのキャラクター画像を生成するGAN☆12May 13, 2021Updated 5 years ago
- Qwen 3.5 in C☆24Mar 28, 2026Updated 5 months ago
- ☆14Feb 13, 2024Updated 2 years ago
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- Example of onnx quantization☆11Feb 8, 2023Updated 3 years ago
- Python scripts performing Open Vocabulary Object Detection using the YOLO-World model in ONNX. And Export the ONNX model for AXera's NPU☆12Aug 11, 2025Updated last year
- ☆12Oct 7, 2018Updated 7 years ago
- ComfyUI-KokoroTTS: A text-to-speech model that utilizes the Kokoro TTS framework to convert text into natural-sounding speech. It suppor…☆13Apr 18, 2025Updated last year
- User and Programmer Tutorials for JeVois☆14Feb 6, 2025Updated last year
- A simplified build of Super Mario War specific to the Raspberry Pi☆11Jan 14, 2017Updated 9 years ago
- ☆19Jan 28, 2026Updated 7 months ago
- Mirror of ONScripter official source code.☆15Jan 2, 2023Updated 3 years ago
- Rewrite of the MVVM App with Community toolkit 8☆11May 14, 2023Updated 3 years ago
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- Simple inference for Vits2 TTS Using ONNXRUNTIME and espeak-ng on C++☆19Apr 17, 2024Updated 2 years ago
- 最寄り駅の電車が何分後に来るか表示します。☆11Aug 25, 2019Updated 7 years ago
- External Buildroot tree for STMicroelectronics boards configurations☆12Dec 1, 2025Updated 9 months ago
- debian arm64 linux for the rock 5b☆19May 3, 2026Updated 4 months ago
- MangoPI MQ-Quad board Linux (Allwinner H616)☆12Apr 6, 2023Updated 3 years ago
- ☆11Feb 13, 2024Updated 2 years ago
- ☆49Jun 26, 2026Updated 2 months ago