Lightning-fast LLM inference engine - Built with Rust (inspiration from https://github.com/GeeeekExplorer/nano-vllm)
☆35Jun 24, 2025Updated 10 months ago
Alternatives and similar repositories for nano-vllm-rs
Users that are interested in nano-vllm-rs are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- A Haskell implementation of the tiger compiler☆10May 2, 2020Updated 6 years ago
- Ocaml code from Writing an Interpreter in Go☆11Aug 16, 2019Updated 6 years ago
- A RPC Server implement base on Raft Paper in Golang☆10Jun 17, 2016Updated 9 years ago
- Compiler for the Tiger programming language☆12Oct 27, 2018Updated 7 years ago
- A concise Hindley-Milner type inferencer (algorithm W) implemented with Scala☆17May 13, 2013Updated 12 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- ☆15Nov 8, 2021Updated 4 years ago
- A set of tools that make working with the Scala ecosystem even better.☆13Apr 4, 2026Updated last month
- A small bottle chat application.☆22Sep 16, 2011Updated 14 years ago
- Spark—Python学习笔记☆11Sep 25, 2018Updated 7 years ago
- 简单的字典翻译组件☆10Mar 18, 2024Updated 2 years ago
- Simple, safe way to store and distribute tensors☆15Apr 23, 2026Updated 2 weeks ago
- A C compiler with SSA-based backend optimzation☆15Mar 19, 2016Updated 10 years ago
- Nearest neighbor search for Ruby and S3 Vectors☆13Apr 9, 2026Updated last month
- zero cost Apply/Applicative syntax☆13May 2, 2026Updated last week
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Hands-On Scala Programming [Video], published by Packt☆13Oct 31, 2022Updated 3 years ago
- Official Java Client for Ipregistry, a Fast, Reliable IP Geolocation and Threat Data API.☆16Dec 7, 2025Updated 5 months ago
- SmartBuf is a cross-language serialization and deserialization framework, and it has high performance and compression ratio like …☆11Dec 5, 2023Updated 2 years ago
- OpenAI compatible API for open source LLMs☆17Oct 30, 2023Updated 2 years ago
- Composable data loading for Ruby☆13Apr 8, 2026Updated last month
- Write events for TensorBoard☆13Apr 27, 2026Updated 2 weeks ago
- A MiniJava compiler written in Rust.☆29Jan 12, 2024Updated 2 years ago
- sh - Super fast Alfred 3+ workflow to search through Chrome history 🕵️♀️☆13Nov 28, 2020Updated 5 years ago
- VecoLuc is a scalable vector search engine that leverages Apache Lucene and the JDK's incubator vector API for high-performance vector op…☆11Aug 22, 2024Updated last year
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- Wrap RocksDB inside a server talks like the REDIS.☆31Feb 20, 2014Updated 12 years ago
- special node-red node used in Distrbuted Node-RED☆16May 14, 2019Updated 6 years ago
- 本实例采用sys_id + organization_id来标识一个租户，重写了mybatis-plus中的tenant_id的租户类型☆13Mar 3, 2020Updated 6 years ago
- Liga: Let Data Dance with ML Models☆13Sep 12, 2023Updated 2 years ago
- http server to take screenshots of websites☆15Sep 13, 2012Updated 13 years ago
- Tensor-based Spectral LDA on Spark☆18Jun 5, 2018Updated 7 years ago
- SBT plugin for running mocha JavaScript unit tests on node☆17Apr 11, 2026Updated last month
- ☆11May 21, 2021Updated 4 years ago
- IANA IPv4 and IPv6 number database☆17Jul 16, 2021Updated 4 years ago
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- Simple HTTP serving for PyTorch 🚀☆10Oct 15, 2020Updated 5 years ago
- Scraper for aqicn.org☆11Sep 4, 2018Updated 7 years ago
- Invoke Pandas plotting by piping in SQL output via PSQL (Can be used with Postgres or Greenplum or any SQL engine).☆16Nov 8, 2014Updated 11 years ago
- ☆14Jan 28, 2024Updated 2 years ago
- Beat for traceroute command☆14Oct 5, 2018Updated 7 years ago
- A powerful ingestion framework with support for Strategies☆18Nov 24, 2025Updated 5 months ago
- A Neural Network implemented from scratch as per http://neuralnetworksanddeeplearning.com/ in Rust. This is then trained on MNIST. This i…☆10Jul 17, 2020Updated 5 years ago