Lightning-fast LLM inference engine - Built with Rust (inspiration from https://github.com/GeeeekExplorer/nano-vllm)
☆38Jun 24, 2025Updated last year
Alternatives and similar repositories for nano-vllm-rs
Users that are interested in nano-vllm-rs are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- A type-safe, composable directed graph workflow system written in Rust☆18May 9, 2025Updated last year
- ☆15Mar 11, 2026Updated 7 months ago
- Candle Pipelines provides a simple, intuitive interface for Rust developers who want to work with Large Language Models locally, powered …☆23Jan 5, 2026Updated 9 months ago
- OpenAI compatible API for open source LLMs☆16Oct 30, 2023Updated 2 years ago
- Rust crate for some audio utilities☆32Jun 17, 2026Updated 3 months ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- ☆10Dec 1, 2021Updated 4 years ago
- Implicit Data Markup☆13Jan 15, 2025Updated last year
- A benchmark framework for decision forest inferences☆11Jan 19, 2024Updated 2 years ago
- Incremental View Maintenance support for DuckDB☆18Oct 24, 2023Updated 2 years ago
- The desktop application for a local viralmind.ai training gym.☆12Apr 25, 2025Updated last year
- A c_import macro for Rust☆16Apr 21, 2025Updated last year
- 📚🍳Recipes and best practices for awesome digital teams☆16Dec 23, 2024Updated last year
- proc-macro examples for my post☆15Nov 27, 2021Updated 4 years ago
- Pcap recording of Heralding sessions☆10Jan 19, 2018Updated 8 years ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- ☆12Apr 22, 2026Updated 5 months ago
- A MCP (Model Context Protocol) server to allow code security reviews using https://osv.dev (Open Source Vulnerabilities Database)☆15Dec 24, 2025Updated 9 months ago
- Tantivy-search is a C++ wrapper for Tantivy, a full-text search engine written in Rust. It is designed to integrate with MyScaleDB and Cl…☆25Nov 27, 2024Updated last year
- File differences/patches.☆17Apr 9, 2026Updated 6 months ago
- Crowdsourced ratings website for freely licensed images and media from Wikimedia Commons. PHP, SQLite, MediaWiki API, Curators backend.☆10Jul 12, 2026Updated 3 months ago
- A novel system that unifies LLM serving with query optimization to efficiently process batch agentic workflows.☆16Oct 7, 2026Updated last week
- 本笔记基于哈工大李治军老师的课程，以及王道考研资料，B站CodeSheep的知识梳理，各大论坛的博客等，从各个渠道中获取精华，成为这些笔记。☆13Nov 26, 2020Updated 5 years ago
- original 8bit CPU of ICF3-Z☆12Feb 20, 2020Updated 6 years ago
- MIT NIHS image format implementations☆10Dec 11, 2019Updated 6 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- A rich desktop application for tracking tv shows☆19Oct 8, 2026Updated last week
- Nano vLLM☆25Aug 11, 2025Updated last year
- A learning-focused, high-performance tensor computation library built from scratch in Rust, featuring automatic differentiation and CPU/C…☆79May 31, 2025Updated last year
- 一键下载哔哩哔哩视频☆10May 11, 2020Updated 6 years ago
- 阿里云物联网设备端 Rust SDK / Alink 协议☆11Apr 23, 2023Updated 3 years ago
- A port scanner lib written in the Rust language☆17Nov 3, 2016Updated 9 years ago
- 参考 Chat2DB 的效果，使用 chatgpt 进行自然语言翻译，然后对数据库进行操作，使用 rust 语言实现的 web 应用。☆10Jan 13, 2025Updated last year
- Attendance Monitoring System using QR Code build in Laravel and MySQL☆11Oct 25, 2025Updated 11 months ago
- Efficent platform for inference and serving local LLMs including an OpenAI compatible API server.☆733Sep 17, 2026Updated 3 weeks ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- AI Hedge Fund Repo integrate with DeepSeek V3 and R1 hosted on SiliconFlow.☆14Feb 3, 2025Updated last year
- Example projects for using Kaiko SDK in various languages☆14Jul 20, 2026Updated 2 months ago
- pixi.js中文教程/文档。访问地址http://pixijs.huashengweilai.com☆14Aug 16, 2024Updated 2 years ago
- A repetition detector written in Rust☆14Mar 16, 2017Updated 9 years ago
- ☆10Aug 20, 2018Updated 8 years ago
- A userspace tunnel between two hosts mapping ports on client machine to addresses reachable from server machine.☆18Feb 25, 2022Updated 4 years ago
- Incremental View Maintenance on DuckDB☆58Updated this week