A Rust-based, OpenAI-style API server for large language models (LLMs)
☆18Feb 23, 2026Updated last week
Alternatives and similar repositories for llmserver-rs
Users that are interested in llmserver-rs are comparing it to the libraries listed below
Sorting:
- yolov8 旋转目标检测部署，瑞芯微RKNN芯片部署、地平线Horizon芯片部署、TensorRT部署☆28Jun 4, 2024Updated last year
- InSales e-commerce platform API bindings☆14Jul 13, 2024Updated last year
- Quake for the ESP32-P4 evaluation board☆43Mar 3, 2025Updated last year
- ☆29Dec 20, 2025Updated 2 months ago
- Nanos klib for NVIDIA GPUs☆14Mar 25, 2025Updated 11 months ago
- Implementation of a fast semantic chunker in C++, installable in python 3.7+ projects.☆22Sep 20, 2025Updated 5 months ago
- Russian phonetical transcription☆11Nov 19, 2025Updated 3 months ago
- Edge Impulse FOMO Implementation from scratch☆18Updated this week
- yolo目标检测算法☆15Jul 27, 2025Updated 7 months ago
- The goal of this toolbox is provide a set of batch line editing tools for ArcGIS that allow for the efficient creation of polyline featur…☆14Feb 19, 2026Updated last week
- ff-rknn - Real-time Object Detection with NPU (Rockchip)☆14Sep 5, 2023Updated 2 years ago
- Kaleidux is a high-performance, dynamic wallpaper daemon for Linux, supporting both Wayland (via Layer-Shell) and X11. It transforms your…☆18Updated this week
- A menu applet for COSMIC Desktop☆17Updated this week
- OpenAI Whisper demo on Axera☆14Jan 15, 2026Updated last month
- A library for COSMIC online account management.☆19Oct 1, 2025Updated 5 months ago
- ☆13Jan 6, 2022Updated 4 years ago
- External Buildroot tree for STMicroelectronics boards configurations☆11Dec 1, 2025Updated 3 months ago
- A fast terminal-based viewer and command-line toolkit for molecular sequences (DNA, AA). View, translate, convert (to FASTA), and combine…☆35Feb 2, 2026Updated last month
- A very segsy desktop shell ported to niri wm.☆34Updated this week
- DETR tensor去除推理过程无用辅助头+fp16部署再次加速+解决转tensorrt 输出全为0问题的新方法。☆12Jan 9, 2024Updated 2 years ago
- 🎵 muse: Music Separation☆11Feb 14, 2024Updated 2 years ago
- A declarative and ergonomic internationalization for Rust using Fluent. Mirror of https://gitlab.archlinux.org/orhun/fluent-i18n☆19Sep 29, 2025Updated 5 months ago
- Tokenizer for Text to Speech (TTS) models☆13Jan 16, 2025Updated last year
- Modern OS written in the rust programming language☆14Jun 25, 2025Updated 8 months ago
- ComfyUI nodes to use DiLightNet☆11Oct 6, 2024Updated last year
- A hackable library for running and fine-tuning modern transformer models on commodity and alternative GPUs, powered by tinygrad.☆28Feb 10, 2026Updated 3 weeks ago
- ☆15Jun 8, 2021Updated 4 years ago
- A simple and likely improvable Hangman Game created using the Rust Programming Language.☆13Dec 30, 2017Updated 8 years ago
- 🦀 📚 🧑🎓 Aprendendo Rust | Learning Rust - Personal Studies about Rust Language☆10Aug 10, 2023Updated 2 years ago
- Fork of RecurrentGPT with modifications☆10Sep 18, 2024Updated last year
- [wip] ssh agent for bitwarden☆12Sep 9, 2024Updated last year
- DTOF COAXIAL BRUSHLESS LiDAR with Raspberry pi SBC☆12Jun 14, 2022Updated 3 years ago
- A lightweight, type-safe service construction pattern for Rust applications that leverages the builder pattern.☆10Aug 16, 2025Updated 6 months ago
- Code showing how to use a model based on the ML model base class.☆10Sep 30, 2022Updated 3 years ago
- ☆13Jul 22, 2024Updated last year
- BreezyLidar - Simple, efficient, Lidar access in Python and C++☆12Dec 2, 2023Updated 2 years ago
- MeloTTS demo on Axera☆10Nov 18, 2025Updated 3 months ago
- 💠 The Terminal-Based Fractal Explorer. Rsfrac is your terminal gateway to Mandelbrot, Burning Ship, and Julia. 💠☆18Feb 3, 2026Updated last month
- QT5 Linux programmer software for the readind/writing SPI NOR FLASH use the CH347 device.☆14Apr 19, 2024Updated last year