tenstorrent / vllmLinks
A high-throughput and memory-efficient inference and serving engine for LLMs
☆16Updated this week
Alternatives and similar repositories for vllm
Users that are interested in vllm are comparing it to the libraries listed below
Sorting:
- The TT-Forge FE is a graph compiler designed to optimize and transform computational graphs for deep learning models, enhancing their per…☆44Updated this week
- Tenstorrent MLIR compiler☆132Updated this week
- TVM for Tenstorrent ASICs☆23Updated this week
- Tenstorrent Firmware repository☆13Updated this week
- ⭐️ TTNN Compiler for PyTorch 2 ⭐️ It enables running PyTorch models on Tenstorrent hardware using torch.compile path☆42Updated this week
- Tenstorrent Kernel Module☆44Updated this week
- Buda Compiler Backend for Tenstorrent devices☆29Updated 2 months ago
- Tenstorrent Firmware Update Utility☆13Updated 3 weeks ago
- Tenstorrent TT-BUDA Repository☆312Updated 2 months ago
- Tenstorrent console based hardware information program☆37Updated last week
- Tenstorrent's MLIR Based Compiler. We aim to enable developers to run AI on all configurations of Tenstorrent hardware, through an open-s…☆60Updated this week
- Frontend integration for PyTorch with tt-mlir☆21Updated this week
- Repository of model demos using TT-Buda☆62Updated 2 months ago
- TT-NN operator library, and TT-Metalium low level kernel programming model.☆898Updated this week
- TT-Studio : An all-in-one platform to deploy and manage AI models optimized for Tenstorrent hardware with dedicated front-end demo applic…☆19Updated this week
- An experimental CPU backend for Triton☆119Updated this week
- Repo for AI Compiler team. The intended purpose of this repo is for implementation of a PJRT device.☆17Updated this week
- OpenAI Triton backend for Intel® GPUs☆189Updated this week
- AI Tensor Engine for ROCm☆201Updated this week
- ☆15Updated this week
- MLIR-based partitioning system☆87Updated this week
- IREE plugin repository for the AMD AIE accelerator☆97Updated this week
- IREE's PyTorch Frontend, based on Torch Dynamo.☆86Updated this week
- Shared Middle-Layer for Triton Compilation☆252Updated this week
- Composable Kernel: Performance Portable Programming Model for Machine Learning Tensor Operators☆401Updated this week
- QuickReduce is a performant all-reduce library designed for AMD ROCm that supports inline compression.☆27Updated 2 months ago
- Development repository for the Triton language and compiler☆122Updated this week
- Attention in SRAM on Tenstorrent Grayskull☆35Updated 10 months ago
- An experimental CPU backend for Triton (https//github.com/openai/triton)☆43Updated 2 months ago
- An MLIR-based toolchain for AMD AI Engine-enabled devices.☆408Updated this week