tenstorrent / vllmLinks
A high-throughput and memory-efficient inference and serving engine for LLMs
☆26Updated this week
Alternatives and similar repositories for vllm
Users that are interested in vllm are comparing it to the libraries listed below
Sorting:
- Tenstorrent TT-BUDA Repository☆314Updated 8 months ago
- A fast full-system simulator of Tenstorrent hardware☆34Updated this week
- Tenstorrent MLIR compiler☆218Updated last week
- The TT-Forge FE is a graph compiler designed to optimize and transform computational graphs for deep learning models, enhancing their per…☆53Updated this week
- Buda Compiler Backend for Tenstorrent devices☆30Updated 8 months ago
- Tenstorrent's MLIR Based Compiler. We aim to enable developers to run AI on all configurations of Tenstorrent hardware, through an open-s…☆148Updated this week
- TT-NN operator library, and TT-Metalium low level kernel programming model.☆1,279Updated this week
- [Deprecated] ⭐️ TT-NN Compiler for PyTorch 2 ⭐️ Enables running PyTorch models on Tenstorrent hardware using eager or compile path☆61Updated this week
- Tenstorrent Kernel Module☆56Updated 2 weeks ago
- TT-Studio : An all-in-one platform to deploy and manage AI models optimized for Tenstorrent hardware with dedicated front-end demo applic…☆39Updated last week
- TVM for Tenstorrent ASICs☆28Updated 3 months ago
- Repository of model demos using TT-Buda☆63Updated 8 months ago
- Tenstorrent Firmware repository☆23Updated 2 weeks ago
- ☆40Updated this week
- OpenAI Triton backend for Intel® GPUs☆222Updated this week
- IREE's PyTorch Frontend, based on Torch Dynamo.☆102Updated this week
- QuickReduce is a performant all-reduce library designed for AMD ROCm that supports inline compression.☆36Updated 3 months ago
- Frontend integration for PyTorch with tt-mlir☆24Updated 2 weeks ago
- PyTorch emulation library for Microscaling (MX)-compatible data formats☆327Updated 6 months ago
- An experimental CPU backend for Triton☆167Updated last month
- An MLIR-based toolchain for AMD AI Engine-enabled devices.☆546Updated this week
- Tenstorrent console based hardware information program☆57Updated this week
- Development repository for the Triton language and compiler☆137Updated this week
- An experimental CPU backend for Triton (https//github.com/openai/triton)☆47Updated 4 months ago
- Repo for AI Compiler team. The intended purpose of this repo is for implementation of a PJRT device.☆47Updated this week
- Evaluating Large Language Models for CUDA Code Generation ComputeEval is a framework designed to generate and evaluate CUDA code from Lar…☆84Updated last month
- Fast low-bit matmul kernels in Triton☆410Updated this week
- Attention in SRAM on Tenstorrent Grayskull☆39Updated last year
- Tenstorrent Firmware Update Utility☆10Updated last week
- AMD RAD's multi-GPU Triton-based framework for seamless multi-GPU programming☆133Updated this week