A high-throughput and memory-efficient inference and serving engine for LLMs
☆30Aug 14, 2026Updated this week
Alternatives and similar repositories for vllm
Users that are interested in vllm are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆69Updated this week
- Tenstorrent Kernel Module☆71Updated this week
- Tenstorrent Topology (TT-Topology) is a command line utility used to flash multiple NB cards on a system to use specific eth routing conf…☆16Jul 23, 2026Updated 3 weeks ago
- User-Mode Driver for Tenstorrent hardware☆45Updated this week
- The Tenstorrent Studio (TT-Studio) is an easy to use web interface for running AI models on Tenstorrent hardware. It handles all the tech…☆49Updated this week
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- TT-NN operator library, and TT-Metalium low level kernel programming model.☆1,624Updated this week
- Repository for AI model benchmarking on TT-Buda☆16Feb 9, 2026Updated 6 months ago
- Tenstorrent Firmware Update Utility☆13Updated this week
- Repo for AI Compiler team. The intended purpose of this repo is for implementation of a PJRT device.☆74Updated this week
- ☆125Aug 10, 2026Updated last week
- ☆40Updated this week
- A fast full-system simulator of Tenstorrent hardware☆148Updated this week
- Tenstorrent TT-BUDA Repository☆314Feb 9, 2026Updated 6 months ago
- ☆12Oct 25, 2022Updated 3 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Tenstorrent console based hardware information program☆62Updated this week
- A comprehensive tool for visualizing and analyzing model execution, offering interactive graphs, memory plots, tensor details, buffer ove…☆54Updated this week
- Proxy app for Nek5000☆13Mar 20, 2018Updated 8 years ago
- Repository of model demos using TT-Buda☆64Apr 2, 2025Updated last year
- torchtrail: trace the graph of torch functions and modules for visualization, reports, etc☆25May 25, 2025Updated last year
- 2018 International Student Car Competition: Autonomous Car SKKU Team. HEVEN☆16Mar 9, 2021Updated 5 years ago
- Tenstorrent MLIR compiler☆296Updated this week
- Nebula: Deep Neural Network Benchmarks in C++☆13Aug 8, 2026Updated last week
- Tenstorrent's MLIR Based Compiler. We aim to enable developers to run AI on all configurations of Tenstorrent hardware, through an open-s…☆346Updated this week
- End-to-end encrypted email - Proton Mail • AdSpecial offer: 40% Off Yearly / 80% Off First Month. All Proton services are open source and independently audited for security.
- A low level hardware debugger☆21Updated this week
- A Modelica library for simulation of recirculating aquaculture systems☆18Feb 18, 2019Updated 7 years ago
- Infrastructure-as-code and machine configuration used to deploy my personal website☆29Jan 11, 2026Updated 7 months ago
- This GitHub repo contains the artifact for CPElide, which appears at MICRO '24☆17Sep 7, 2024Updated last year
- ☆23Apr 24, 2026Updated 3 months ago
- MIPS simulator in C++☆14Oct 2, 2019Updated 6 years ago
- ☆11May 4, 2025Updated last year
- System firmware for Tenstorrent hardware☆42Updated this week
- tiny code to access tenstorrent blackhole☆69May 26, 2025Updated last year
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Frontend integration for PyTorch with tt-mlir☆26Mar 2, 2026Updated 5 months ago
- Inbound email processing server with LLM-powered automation☆36Aug 5, 2026Updated last week
- A repository where GPU applications are aggregated using a common build flow that supports multiple CUDA versions.☆95Apr 14, 2026Updated 4 months ago
- Custom error type of nom to improve accuracy of error position☆12Mar 23, 2023Updated 3 years ago
- Buildings Unified Data point naming schema for Operation management☆15Mar 31, 2023Updated 3 years ago
- ☆14Jun 20, 2019Updated 7 years ago
- ☆25May 18, 2025Updated last year