Build your own high performance LLM inference engine in C++ and CUDA - a smaller version of vLLM
☆134Apr 14, 2026Updated last month
Alternatives and similar repositories for tiny-vllm
Users that are interested in tiny-vllm are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Lossless normalization of uppercase characters☆11Jul 3, 2023Updated 2 years ago
- ☆20Apr 24, 2026Updated 3 weeks ago
- Stream Claude Code's hidden output (thinking, tool calls, subagents) to a separate terminal in real-time☆144May 6, 2026Updated 2 weeks ago
- A playground to make it easy to try crazy things☆33Feb 13, 2026Updated 3 months ago
- A pure-Python implementation of the Nvidia CuTe layout algebra intended to be approachable and easy to learn.☆179May 7, 2026Updated last week
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- Video chat with Modal's mascots, Moe and Dal, about Modal and its documentation.☆62Apr 8, 2026Updated last month
- Providing wrapper types for safely performing panic-free checked arithmetic on instants and durations.☆17May 9, 2026Updated last week
- A coöperative multitasking framework based on `liburing` and `libucontext`☆16Jan 2, 2026Updated 4 months ago
- An alternative to OpenFaaS nats-queue-worker for long-running functions☆11Dec 14, 2022Updated 3 years ago
- finding set bits in large bitmaps☆15Nov 30, 2015Updated 10 years ago
- ☆39Feb 2, 2021Updated 5 years ago
- Command-line utility for iteratively developing pipelines, deploying them at scale, and sharing data and derivatives☆10Jun 15, 2020Updated 5 years ago
- Utility for dumping all the information Capstone has on given instructions.☆21Oct 1, 2021Updated 4 years ago
- ☆14Aug 22, 2025Updated 8 months ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- Lock-free buddy allocator based on binary heap☆14Mar 3, 2025Updated last year
- Crit-bit tree☆26Nov 9, 2021Updated 4 years ago
- Query, analysis, and visualization of large video collections☆10Dec 9, 2022Updated 3 years ago
- Timer facilities for Tokio based on OS-level primitives.☆14May 7, 2020Updated 6 years ago
- Coq & Haskell code for Calculating Correct Compilers II☆12Feb 22, 2022Updated 4 years ago
- ☆11Apr 24, 2018Updated 8 years ago
- Evaluate state-of-the-art GPU joins☆14Nov 29, 2023Updated 2 years ago
- kerf is a tool designed to orchestrate and manage multiple kernel instances on a single host.☆27Jan 23, 2026Updated 3 months ago
- Parseit - Parseit is command line tool to parse data using EBNF or ABNF using the excellent Instaparse library, and serializing the resul…☆16Dec 5, 2022Updated 3 years ago
- Simple, predictable pricing with DigitalOcean hosting • AdAlways know what you'll pay with monthly caps and flat pricing. Enterprise-grade infrastructure trusted by 600k+ customers.
- Modify ELF executables☆16Mar 5, 2019Updated 7 years ago
- Interesting papers☆11Jun 22, 2024Updated last year
- 🚀 Sliding Window Attention Training for Efficient Large Language Models☆16Dec 8, 2025Updated 5 months ago
- pspgen utility on top of DPDK☆14Mar 21, 2016Updated 10 years ago
- Asynchronous adapter for byteorder☆20Feb 10, 2021Updated 5 years ago
- ☆15May 6, 2021Updated 5 years ago
- Go Version of Redis on PMEM☆12Dec 20, 2021Updated 4 years ago
- ☆15Sep 9, 2020Updated 5 years ago
- bil verification tool☆12Jun 30, 2022Updated 3 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- A compiler synthesizer for simple languages.☆15Dec 18, 2018Updated 7 years ago
- Not Another Range Library☆39Mar 9, 2014Updated 12 years ago
- SMR Benchmark: A Microbenchmark Suite for Concurrent Safe Memory Reclamation Schemes☆48Apr 22, 2026Updated 3 weeks ago
- MESMERIC: A Software-based NVM Emulator Supporting Read/Write Asymmetric Latencies☆10Oct 1, 2020Updated 5 years ago
- Collection of synchronization micro-benchmarks and traces from infrastructure applications☆52Jul 31, 2025Updated 9 months ago
- coming soon☆15Apr 16, 2022Updated 4 years ago
- A tool for checking tool output inspired by LLVM's FileCheck☆13Aug 29, 2025Updated 8 months ago