A high-throughput and memory-efficient inference and serving engine for LLMs
☆30Sep 16, 2026Updated last month
Alternatives and similar repositories for vllm
Users that are interested in vllm are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆79Updated this week
- Tenstorrent Firmware repository☆24Feb 25, 2026Updated 8 months ago
- Tenstorrent Kernel Module☆75Updated this week
- The Tenstorrent Studio (TT-Studio) is an easy to use web interface for running AI models on Tenstorrent hardware. It handles all the tech…☆52Updated this week
- User-Mode Driver for Tenstorrent hardware☆51Updated this week
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- TT-NN operator library, and TT-Metalium low level kernel programming model.☆1,747Updated this week
- The TT-Forge ONNX is a graph compiler designed to optimize and transform computational graphs for deep learning models, enhancing their p…☆68Updated this week
- A fast full-system simulator of Tenstorrent hardware☆171Updated this week
- Tenstorrent console based hardware information program☆68Updated this week
- Repository for AI model benchmarking on TT-Buda☆15Feb 9, 2026Updated 8 months ago
- ☆136Updated this week
- Tenstorrent TT-BUDA Repository☆314Feb 9, 2026Updated 8 months ago
- A comprehensive tool for visualizing and analyzing model execution, offering interactive graphs, memory plots, tensor details, buffer ove…☆59Updated this week
- ☆16Updated this week
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Tenstorrent Plugin for Triton☆14Aug 25, 2026Updated 2 months ago
- Repository of model demos using TT-Buda☆63Apr 2, 2025Updated last year
- 2018 International Student Car Competition: Autonomous Car SKKU Team. HEVEN☆16Mar 9, 2021Updated 5 years ago
- A Python-based Domain-Specific Language (DSL) for authoring custom operations on Tenstorrent hardware.☆68Updated this week
- Nebula: Deep Neural Network Benchmarks in C++☆13Sep 2, 2026Updated 2 months ago
- ☆13Oct 6, 2024Updated 2 years ago
- Re-implementation of Bi- (or, Dual-) encoder for Entity Linking. You can run experiments only in 3 seconds.☆11Jun 12, 2023Updated 3 years ago
- Code for KVDirect: Distributed Disaggregated LLM Inference☆10Apr 28, 2025Updated last year
- ☆14Feb 4, 2026Updated 9 months ago
- Simple, predictable pricing with DigitalOcean hosting • AdAlways know what you'll pay with monthly caps and flat pricing. Enterprise-grade infrastructure trusted by 600k+ customers.
- Tenstorrent MLIR compiler☆320Updated this week
- Surgically de-slop LLMs☆15Jun 1, 2025Updated last year
- Tenstorrent system interface library☆35Updated this week
- JANOG Public Repo☆13Apr 15, 2026Updated 6 months ago
- MLCommons Inference Endpoints repository☆27Updated this week
- ☆18Jun 19, 2026Updated 4 months ago
- Welcome to BuildingControlLib, a Modelica library for modelling and simulation of standardized and non-standardized control functions fro…☆13Jan 19, 2018Updated 8 years ago
- Academic Operating System from Scratch☆14May 2, 2016Updated 10 years ago
- This GitHub repo contains the artifact for CPElide, which appears at MICRO '24☆17Sep 7, 2024Updated 2 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- A low level hardware debugger☆21Updated this week
- ☆15Updated this week
- Tenstorrent's MLIR Based Compiler. We aim to enable developers to run AI on all configurations of Tenstorrent hardware, through an open-s…☆382Updated this week
- A Modelica library for simulation of recirculating aquaculture systems☆19Feb 18, 2019Updated 7 years ago
- [Deprecated] ⭐️ TT-NN Compiler for PyTorch 2 ⭐️ Enables running PyTorch models on Tenstorrent hardware using eager or compile path☆62Updated this week
- ☆14Mar 20, 2026Updated 7 months ago
- A collection of papers on awesome genome acceleration, e.g., architectures, systems, and algorithms.☆11Jun 9, 2026Updated 4 months ago