Build your own high performance LLM inference engine in C++ and CUDA - a smaller version of vLLM
☆120Apr 14, 2026Updated 2 weeks ago
Alternatives and similar repositories for tiny-vllm
Users that are interested in tiny-vllm are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Lossless normalization of uppercase characters☆11Jul 3, 2023Updated 2 years ago
- ☆20Updated this week
- Stream Claude Code's hidden output (thinking, tool calls, subagents) to a separate terminal in real-time☆138Updated this week
- A playground to make it easy to try crazy things☆33Feb 13, 2026Updated 2 months ago
- A pure-Python implementation of the Nvidia CuTe layout algebra intended to be approachable and easy to learn.☆169Apr 23, 2026Updated last week
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- ☆129Apr 15, 2026Updated 2 weeks ago
- LL-HLS implementation written in Python3☆50Dec 10, 2024Updated last year
- Providing wrapper types for safely performing panic-free checked arithmetic on instants and durations.☆17Apr 10, 2026Updated 2 weeks ago
- A coöperative multitasking framework based on `liburing` and `libucontext`☆16Jan 2, 2026Updated 3 months ago
- An alternative to OpenFaaS nats-queue-worker for long-running functions☆11Dec 14, 2022Updated 3 years ago
- finding set bits in large bitmaps☆15Nov 30, 2015Updated 10 years ago
- ☆39Feb 2, 2021Updated 5 years ago
- A definitive guide to build Tensorflow with Intel MKL support on Mac☆16Mar 28, 2018Updated 8 years ago
- Command-line utility for iteratively developing pipelines, deploying them at scale, and sharing data and derivatives☆10Jun 15, 2020Updated 5 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Utility for dumping all the information Capstone has on given instructions.☆23Oct 1, 2021Updated 4 years ago
- ☆14Aug 22, 2025Updated 8 months ago
- Crit-bit tree☆26Nov 9, 2021Updated 4 years ago
- Query, analysis, and visualization of large video collections☆10Dec 9, 2022Updated 3 years ago
- Timer facilities for Tokio based on OS-level primitives.☆14May 7, 2020Updated 5 years ago
- Coq & Haskell code for Calculating Correct Compilers II☆12Feb 22, 2022Updated 4 years ago
- Nonblocking data structures☆12Jan 25, 2015Updated 11 years ago
- ☆11Apr 24, 2018Updated 8 years ago
- Evaluate state-of-the-art GPU joins☆14Nov 29, 2023Updated 2 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- ☆13Sep 30, 2020Updated 5 years ago
- kerf is a tool designed to orchestrate and manage multiple kernel instances on a single host.☆26Jan 23, 2026Updated 3 months ago
- Parseit - Parseit is command line tool to parse data using EBNF or ABNF using the excellent Instaparse library, and serializing the resul…☆16Dec 5, 2022Updated 3 years ago
- Modify ELF executables☆16Mar 5, 2019Updated 7 years ago
- Interesting papers☆11Jun 22, 2024Updated last year
- Asynchronous adapter for byteorder☆20Feb 10, 2021Updated 5 years ago
- pspgen utility on top of DPDK☆14Mar 21, 2016Updated 10 years ago
- ☆15May 6, 2021Updated 4 years ago
- Go Version of Redis on PMEM☆12Dec 20, 2021Updated 4 years ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- A Sparse-tensor Communication Framework for Distributed Deep Learning☆13Nov 1, 2021Updated 4 years ago
- ☆15Sep 9, 2020Updated 5 years ago
- bil verification tool☆12Jun 30, 2022Updated 3 years ago
- Deploy an Image Recognition API using Go, Terraform, Lambda, and API Gateway.☆15May 8, 2018Updated 7 years ago
- A compiler synthesizer for simple languages.☆15Dec 18, 2018Updated 7 years ago
- It's exactly like those graduation gift balloons, except this is a Clang Tool that detects library-level API and ABI compatibility breaki…☆14Apr 8, 2025Updated last year
- Not Another Range Library☆39Mar 9, 2014Updated 12 years ago