Lightning-fast LLM inference engine - Built with Rust (inspiration from https://github.com/GeeeekExplorer/nano-vllm)
☆38Jun 24, 2025Updated last year
Alternatives and similar repositories for nano-vllm-rs
Users that are interested in nano-vllm-rs are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Nano vLLM Triton☆14Aug 27, 2025Updated last year
- A type-safe, composable directed graph workflow system written in Rust☆18May 9, 2025Updated last year
- fused MoE kernel in Candle backend☆14Feb 3, 2026Updated 9 months ago
- ☆15Mar 11, 2026Updated 7 months ago
- ☆15Jul 10, 2026Updated 3 months ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Your AI now has a face. A pixel-art companion that reads LLM emotions in real time — 4 MB brain, WebGPU inference, zero cloud, 40+ charac…☆12May 14, 2026Updated 5 months ago
- Secure HTTP tunneling solution written in Rust that exposes local services to the internet☆34Feb 25, 2026Updated 8 months ago
- OpenAI compatible API for open source LLMs☆16Oct 30, 2023Updated 3 years ago
- Rust crate for some audio utilities☆32Jun 17, 2026Updated 4 months ago
- Candle Pipelines provides a simple, intuitive interface for Rust developers who want to work with Large Language Models locally, powered …☆23Jan 5, 2026Updated 10 months ago
- An easy-use coroutine lib implement by C++ coroutine and liburing☆34Jun 6, 2025Updated last year
- Upstream-compatible vLLM fork for domestic hardware enablement and AGI4S serving☆12Aug 31, 2026Updated 2 months ago
- A multi-platform file-configurable folder comparison tool with html-reporting written in rust☆13Jul 7, 2026Updated 3 months ago
- Lock-free ARENA allocator and a set of lock-free data structures based on the ARENA allocator.☆17Mar 14, 2026Updated 7 months ago
- Deploy open-source AI quickly and easily - Special Bonus Offer • AdRunpod Hub is built for open source. One-click deployment and autoscaling endpoints without provisioning your own infrastructure.
- standalone react MCP client using SSE☆13Mar 10, 2025Updated last year
- Technical infrastructure for empirical journalism. Evidence before interpretation; provenance before narrative.☆10Oct 30, 2025Updated last year
- A benchmark for UDF queries☆14Jun 30, 2026Updated 4 months ago
- Local-first AI agent mesh in Rust. Hard budget enforcement, adaptive model routing, and end-to-end OpenTDF encryption. Built for individu…☆13Oct 31, 2026Updated last week
- Neural MMO - A Massively Multiagent Environment for Artificial Intelligence Research☆15May 30, 2024Updated 2 years ago
- BLAKE3 on FPGA☆10Feb 21, 2022Updated 4 years ago
- Cross-platform ROBLOX input manager☆14Jul 6, 2025Updated last year
- Incremental View Maintenance support for DuckDB☆18Oct 24, 2023Updated 3 years ago
- High population city simulation in Unity ECS☆12Jul 20, 2018Updated 8 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Open ML Compiler Foundation for the Agentic Era☆82Updated this week
- Fast serverless LLM inference, in Rust.☆136Sep 11, 2026Updated last month
- SvelteKit & Tailwindcss Landing Page☆12Dec 6, 2025Updated 11 months ago
- The official repo for the paper "Optimizing LLM Inference Throughput via Memory-aware and SLA-constrained Dynamic Batching"☆17Mar 17, 2025Updated last year
- Smolagents with gradio UI and dynamic tools support.☆11Jun 7, 2025Updated last year
- High-performance Rust text engine for massive files, with mmap-backed reads, incremental line indexing, and responsive editing.☆13Sep 26, 2026Updated last month
- ☆20Oct 15, 2024Updated 2 years ago
- Library for doing RAG☆84Aug 6, 2026Updated 3 months ago
- Analyze LLM inference: FLOPs, memory, Roofline model. Supports GQA, MoE, MLA, RoPE, SwiGLU. 19 models × 20+ hardware platforms.☆23Updated this week
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- A pixel-style rougelike RPG dungeon game in unity3d. Weapon Forging will be the primary element .☆14Dec 19, 2016Updated 9 years ago
- Guified is a GUI library for LÖVE (Love2D) that simplifies window management and UI element creation. It allows developers to create inte…☆16Apr 15, 2026Updated 6 months ago
- An open source implementation of a vehicle controller using Unity's ECS.☆16Mar 19, 2019Updated 7 years ago
- A MCP (Model Context Protocol) server to allow code security reviews using https://osv.dev (Open Source Vulnerabilities Database)☆15Dec 24, 2025Updated 10 months ago
- Made a CPU in Logisim when I was 14 (2009), and wrote a naive assembler and compiler for it in Flash. The CPU's design is inspired by Don…☆10Sep 30, 2016Updated 10 years ago
- Claude Computer Use desktop app built with Tauri and the Vercel AI SDK.☆15Oct 28, 2024Updated 2 years ago
- A powerful terminal-based coding assistant that combines the convenience of a modern TUI with the intelligence of large language models. …☆15Nov 26, 2025Updated 11 months ago