Lightning-fast LLM inference engine - Built with Rust (inspiration from https://github.com/GeeeekExplorer/nano-vllm)
☆34Jun 24, 2025Updated 9 months ago
Alternatives and similar repositories for nano-vllm-rs
Users that are interested in nano-vllm-rs are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Ocaml code from Writing an Interpreter in Go☆11Aug 16, 2019Updated 6 years ago
- [MobiCom 24] Memory-adaptive DNN inference on edge☆58Jan 22, 2025Updated last year
- A Go wrapper for Gravatar☆12Mar 27, 2021Updated 5 years ago
- Operator for web-ui☆12Nov 25, 2024Updated last year
- A RPC Server implement base on Raft Paper in Golang☆10Jun 17, 2016Updated 9 years ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- ☆36Feb 9, 2024Updated 2 years ago
- Llama causal LM fully recreated in LibTorch. Designed to be used in Unreal Engine 5☆16Sep 19, 2024Updated last year
- A concise Hindley-Milner type inferencer (algorithm W) implemented with Scala☆17May 13, 2013Updated 12 years ago
- An Interpreted Languages Written in Go☆14May 23, 2017Updated 8 years ago
- ☆15Nov 8, 2021Updated 4 years ago
- A set of tools that make working with the Scala ecosystem even better.☆12Mar 16, 2026Updated 2 weeks ago
- Spark—Python学习笔记☆11Sep 25, 2018Updated 7 years ago
- Basic paxos☆30Apr 10, 2014Updated 11 years ago
- 简单的字典翻译组件☆10Mar 18, 2024Updated 2 years ago
- Open source password manager - Proton Pass • AdSecurely store, share, and autofill your credentials with Proton Pass, the end-to-end encrypted password manager trusted by millions.
- Simple, safe way to store and distribute tensors☆15Feb 19, 2026Updated last month
- ☆15Aug 24, 2023Updated 2 years ago
- Nearest neighbor search for Ruby and S3 Vectors☆13Dec 28, 2025Updated 3 months ago
- Postgres protocol support for finagle☆36Sep 4, 2013Updated 12 years ago
- zero cost Apply/Applicative syntax☆13Updated this week
- Modern Compiler Implementation in ML, in Haskell☆22May 29, 2021Updated 4 years ago
- Hands-On Scala Programming [Video], published by Packt☆13Oct 31, 2022Updated 3 years ago
- OpenAI compatible API for open source LLMs☆17Oct 30, 2023Updated 2 years ago
- A C compiler written in Kotlin☆19Jun 22, 2024Updated last year
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- Composable data loading for Ruby☆13Updated this week
- ☆15Aug 31, 2023Updated 2 years ago
- Write events for TensorBoard☆11Jun 27, 2024Updated last year
- ゼロから作るDeep Learning ❸ をC++で実装する。自習用リポジトリ。☆17Aug 12, 2020Updated 5 years ago
- A MiniJava compiler written in Rust.☆29Jan 12, 2024Updated 2 years ago
- Code from Learn You A Haskell book: http://learnyouahaskell.com/☆17Aug 19, 2012Updated 13 years ago
- sh - Super fast Alfred 3+ workflow to search through Chrome history 🕵️♀️☆13Nov 28, 2020Updated 5 years ago
- Mini C Compiler☆24Nov 24, 2020Updated 5 years ago
- VecoLuc is a scalable vector search engine that leverages Apache Lucene and the JDK's incubator vector API for high-performance vector op…☆11Aug 22, 2024Updated last year
- End-to-end encrypted cloud storage - Proton Drive • AdSpecial offer: 40% Off Yearly / 80% Off First Month. Protect your most important files, photos, and documents from prying eyes.
- human in the loop in dify workflow by plugin☆15Jan 7, 2025Updated last year
- 本实例采用sys_id + organization_id来标识一个租户，重写了mybatis-plus中的tenant_id的租户类型☆13Mar 3, 2020Updated 6 years ago
- A simple JIT compiler targeting x64 for the lox programming language☆21Feb 7, 2024Updated 2 years ago
- Liga: Let Data Dance with ML Models☆13Sep 12, 2023Updated 2 years ago
- Tensor-based Spectral LDA on Spark☆18Jun 5, 2018Updated 7 years ago
- SBT plugin for running mocha JavaScript unit tests on node☆17Feb 25, 2026Updated last month
- ☆11May 21, 2021Updated 4 years ago