A high-throughput and memory-efficient inference and serving engine for LLMs
☆30Aug 28, 2026Updated last week
Alternatives and similar repositories for vllm
Users that are interested in vllm are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆71Updated this week
- Tenstorrent Firmware repository☆24Feb 25, 2026Updated 6 months ago
- Tenstorrent Topology (TT-Topology) is a command line utility used to flash multiple NB cards on a system to use specific eth routing conf…☆16Jul 23, 2026Updated last month
- The Tenstorrent Studio (TT-Studio) is an easy to use web interface for running AI models on Tenstorrent hardware. It handles all the tech…☆49Updated this week
- TT-NN operator library, and TT-Metalium low level kernel programming model.☆1,661Updated this week
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- The TT-Forge ONNX is a graph compiler designed to optimize and transform computational graphs for deep learning models, enhancing their p…☆65Updated this week
- Repository for AI model benchmarking on TT-Buda☆15Feb 9, 2026Updated 6 months ago
- Tenstorrent Firmware Update Utility☆13Updated this week
- ☆40Updated this week
- ☆14Updated this week
- A fast full-system simulator of Tenstorrent hardware☆152Updated this week
- Tenstorrent TT-BUDA Repository☆313Feb 9, 2026Updated 6 months ago
- ☆12Oct 25, 2022Updated 3 years ago
- Tenstorrent console based hardware information program☆65Updated this week
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- A comprehensive tool for visualizing and analyzing model execution, offering interactive graphs, memory plots, tensor details, buffer ove…☆56Updated this week
- Proxy app for Nek5000☆13Mar 20, 2018Updated 8 years ago
- ☆10Jul 2, 2019Updated 7 years ago
- ☆13Oct 6, 2024Updated last year
- Repository of model demos using TT-Buda☆64Apr 2, 2025Updated last year
- Tenstorrent MLIR compiler☆305Updated this week
- Nebula: Deep Neural Network Benchmarks in C++☆13Updated this week
- Academic Operating System from Scratch☆14May 2, 2016Updated 10 years ago
- Re-implementation of Bi- (or, Dual-) encoder for Entity Linking. You can run experiments only in 3 seconds.☆11Jun 12, 2023Updated 3 years ago
- Simple, predictable pricing with DigitalOcean hosting • AdAlways know what you'll pay with monthly caps and flat pricing. Enterprise-grade infrastructure trusted by 600k+ customers.
- JANOG Public Repo☆13Apr 15, 2026Updated 4 months ago
- Tenstorrent's MLIR Based Compiler. We aim to enable developers to run AI on all configurations of Tenstorrent hardware, through an open-s…☆357Updated this week
- RISC-V Directed Test Framework and Compliance Suite, RiESCUE☆70Aug 11, 2026Updated 3 weeks ago
- ☆26Apr 24, 2026Updated 4 months ago
- A low level hardware debugger☆21Updated this week
- Welcome to BuildingControlLib, a Modelica library for modelling and simulation of standardized and non-standardized control functions fro…☆13Jan 19, 2018Updated 8 years ago
- KV cache compression via sparse coding☆18Oct 26, 2025Updated 10 months ago
- ☆15Jun 30, 2026Updated 2 months ago
- This GitHub repo contains the artifact for CPElide, which appears at MICRO '24☆17Sep 7, 2024Updated 2 years ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- ☆23Apr 24, 2026Updated 4 months ago
- MIPS simulator in C++☆14Oct 2, 2019Updated 6 years ago
- ☆11May 4, 2025Updated last year
- System firmware for Tenstorrent hardware☆43Updated this week
- Personal portfolio and blog built in Jekyll☆10May 23, 2024Updated 2 years ago
- tiny code to access tenstorrent blackhole☆70May 26, 2025Updated last year
- A repository where GPU applications are aggregated using a common build flow that supports multiple CUDA versions.☆95Apr 14, 2026Updated 4 months ago