tenstorrent / vllmLinks
A high-throughput and memory-efficient inference and serving engine for LLMs
☆17Updated last week
Alternatives and similar repositories for vllm
Users that are interested in vllm are comparing it to the libraries listed below
Sorting:
- TVM for Tenstorrent ASICs☆23Updated this week
- Tenstorrent MLIR compiler☆141Updated this week
- Tenstorrent Firmware repository☆14Updated last week
- The TT-Forge FE is a graph compiler designed to optimize and transform computational graphs for deep learning models, enhancing their per…☆44Updated this week
- Tenstorrent's MLIR Based Compiler. We aim to enable developers to run AI on all configurations of Tenstorrent hardware, through an open-s…☆72Updated this week
- Tenstorrent Firmware Update Utility☆5Updated 3 weeks ago
- Tenstorrent Kernel Module☆46Updated last week
- Buda Compiler Backend for Tenstorrent devices☆29Updated 2 months ago
- Tenstorrent TT-BUDA Repository☆313Updated 2 months ago
- ⭐️ TTNN Compiler for PyTorch 2 ⭐️ Enables running PyTorch models on Tenstorrent hardware using eager or compile path☆47Updated this week
- TT-Studio : An all-in-one platform to deploy and manage AI models optimized for Tenstorrent hardware with dedicated front-end demo applic…☆20Updated this week
- Repository of model demos using TT-Buda☆62Updated 2 months ago
- Tenstorrent console based hardware information program☆43Updated this week
- Repo for AI Compiler team. The intended purpose of this repo is for implementation of a PJRT device.☆18Updated this week
- An experimental CPU backend for Triton☆127Updated 3 weeks ago
- Development repository for the Triton language and compiler☆125Updated this week
- Frontend integration for PyTorch with tt-mlir☆21Updated this week
- Experimental projects related to TensorRT☆105Updated last week
- OpenAI Triton backend for Intel® GPUs☆191Updated this week
- IREE's PyTorch Frontend, based on Torch Dynamo.☆87Updated this week
- QuickReduce is a performant all-reduce library designed for AMD ROCm that supports inline compression.☆28Updated 3 months ago
- TT-NN operator library, and TT-Metalium low level kernel programming model.☆942Updated this week
- Shared Middle-Layer for Triton Compilation☆256Updated this week
- AI Tensor Engine for ROCm☆208Updated this week
- ☆16Updated this week
- IREE plugin repository for the AMD AIE accelerator☆98Updated this week
- A Fusion Code Generator for NVIDIA GPUs (commonly known as "nvFuser")☆339Updated this week
- Composable Kernel: Performance Portable Programming Model for Machine Learning Tensor Operators☆427Updated this week
- Attention in SRAM on Tenstorrent Grayskull☆36Updated 11 months ago
- An experimental CPU backend for Triton (https//github.com/openai/triton)☆43Updated 3 months ago