A Rust-based, OpenAI-style API server for large language models (LLMs)
☆19Mar 4, 2026Updated 2 weeks ago
Alternatives and similar repositories for llmserver-rs
Users that are interested in llmserver-rs are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- A Rust-based, SenseVoiceSmall☆27Mar 9, 2026Updated 2 weeks ago
- Ollama alternative for Rockchip NPU: An efficient solution for running AI and Deep learning models on Rockchip devices with optimized NPU…☆461Mar 15, 2026Updated last week
- Easy installation and usage of Rockchip's NPUs found in RK3588 and similar SoCs☆233Aug 3, 2025Updated 7 months ago
- 🖥️ myrktop - Orange Pi 5 (RK3588) System Monitoring script CPU,RAM,NPU,GPU,TEMPERATURES☆29Apr 22, 2025Updated 11 months ago
- Fire & Smoke Detection Algorithm☆10Dec 2, 2023Updated 2 years ago
- Web chat front end for rk3588_npu_llm_server / RK3588 LLM chat interface☆16Jul 16, 2024Updated last year
- This repository contains guide on how to setup toolkits to use NPU present on Axon for running various CNN models☆26Updated this week
- A tool for humans to interact with a Chroma vector database☆16Mar 2, 2025Updated last year
- CGO bindings to RKNN-Toolkit2 to perform Inferencing in Go on Rockchip NPU☆171Updated this week
- yolov8 旋转目标检测部署，瑞芯微RKNN芯片部署、地平线Horizon芯片部署、TensorRT部署☆27Jun 4, 2024Updated last year
- openFrameworks implementation of whisper.cpp☆13Sep 14, 2023Updated 2 years ago
- BOSSA is the programming software used to program SAM-based Arduino boards like Flutter. We added our chip.☆12Mar 17, 2015Updated 11 years ago
- linux allwinner h616 kernel based on the orangepi zero 2 version of the legacy allwinner 4.9 bsp kernel☆10Jan 25, 2021Updated 5 years ago
- A space to control your Raspeberry Pi☆14Feb 12, 2025Updated last year
- LDC: Lightweight Dense CNN for Edge DetectionのPythonでのONNX推論サンプル☆14May 6, 2023Updated 2 years ago
- Modify Code From rknn-toolkit2☆54Sep 13, 2024Updated last year
- DETR tensor去除推理过程无用辅助头+fp16部署再次加速+解决转tensorrt 输出全为0问题的新方法。☆10Jan 9, 2024Updated 2 years ago
- Change LastOrigin language to Chinese Trandictional or English☆22Mar 4, 2026Updated 2 weeks ago
- 使用OpenCV部署图像描述Image_Captioning，包含C++和Python两个版本的程序☆12Dec 22, 2023Updated 2 years ago
- yolov5_obb C++ onnxruntime deployment☆10Mar 11, 2024Updated 2 years ago
- Lightweight GANを用いてラグナロクオンラインのキャラクター画像を生成するGAN☆12May 13, 2021Updated 4 years ago
- ☆23Jul 30, 2025Updated 7 months ago
- ☆13Jan 6, 2022Updated 4 years ago
- Python scripts performing Open Vocabulary Object Detection using the YOLO-World model in ONNX. And Export the ONNX model for AXera's NPU☆11Aug 11, 2025Updated 7 months ago
- ☆12Oct 7, 2018Updated 7 years ago
- BreezyLidar - Simple, efficient, Lidar access in Python and C++☆12Dec 2, 2023Updated 2 years ago
- Rewrite of the MVVM App with Community toolkit 8☆11May 14, 2023Updated 2 years ago
- ComfyUI nodes to use DiLightNet☆11Oct 6, 2024Updated last year
- A thread safe implementation of ByteTrack with (COCO) labels.☆15Feb 26, 2024Updated 2 years ago
- Board Package for Logic Green☆23Mar 2, 2025Updated last year
- ComfyUI-KokoroTTS: A text-to-speech model that utilizes the Kokoro TTS framework to convert text into natural-sounding speech. It suppor…☆14Apr 18, 2025Updated 11 months ago
- Real-time AI video segmentation of USB camera and streaming over HTTP☆12Apr 23, 2025Updated 11 months ago
- MangoPI MQ-Quad board Linux (Allwinner H616)☆12Apr 6, 2023Updated 2 years ago
- MeloTTS demo on Axera☆12Nov 18, 2025Updated 4 months ago
- ILI9225 SPI TFT Library for RaspberryPi/OrangePi☆22Feb 27, 2020Updated 6 years ago
- User and Programmer Tutorials for JeVois☆14Feb 6, 2025Updated last year
- A simplified build of Super Mario War specific to the Raspberry Pi☆11Jan 14, 2017Updated 9 years ago
- Summary of bugs in Xuantie C9XX core design. include C906/C908/C910/C920☆29Feb 10, 2026Updated last month
- Demonstrates different validation strategies with MVVM Toolkit☆12May 19, 2021Updated 4 years ago