tenstorrent / tt-inference-server
☆13Updated this week
Alternatives and similar repositories for tt-inference-server
Users that are interested in tt-inference-server are comparing it to the libraries listed below
Sorting:
- Tenstorrent console based hardware information program☆37Updated this week
- The TT-Forge FE is a graph compiler designed to optimize and transform computational graphs for deep learning models, enhancing their per…☆42Updated this week
- TT-Studio : An all-in-one platform to deploy and manage AI models optimized for Tenstorrent hardware with dedicated front-end demo applic…☆17Updated this week
- Tenstorrent Kernel Module☆43Updated last week
- TVM for Tenstorrent ASICs☆23Updated this week
- Tenstorrent MLIR compiler☆122Updated this week
- Tenstorrent Firmware repository☆13Updated last week
- Repository of model demos using TT-Buda☆63Updated last month
- Repository for AI model benchmarking on TT-Buda☆14Updated 2 months ago
- Buda Compiler Backend for Tenstorrent devices☆28Updated last month
- Frontend integration for PyTorch with tt-mlir☆15Updated this week
- A high-throughput and memory-efficient inference and serving engine for LLMs☆14Updated this week
- QuickReduce is a performant all-reduce library designed for AMD ROCm that supports inline compression.☆24Updated 2 months ago
- IREE plugin repository for the AMD AIE accelerator☆94Updated this week
- Tenstorrent TT-BUDA Repository☆311Updated last month
- ⭐️ TTNN Compiler for PyTorch 2 ⭐️ It enables running PyTorch models on Tenstorrent hardware using torch.compile path☆38Updated this week
- ☆29Updated 2 months ago
- Attention in SRAM on Tenstorrent Grayskull☆35Updated 10 months ago
- Repo for AI Compiler team. The intended purpose of this repo is for implementation of a PJRT device.☆16Updated this week
- PyTorch emulation library for Microscaling (MX)-compatible data formats☆226Updated last month
- ARIES: An Agile MLIR-Based Compilation Flow for Reconfigurable Devices with AI Engines (FPGA 2025 Best Paper Nominee)☆26Updated this week
- Efficient Neural Network Deployment on Heterogenous TinyML Platforms☆14Updated last year
- ☆28Updated 2 years ago
- GPTPU for SC 2021☆51Updated 2 years ago
- PyTorch extension for emulating FP8 data formats on standard FP32 Xeon/GPU hardware.☆110Updated 5 months ago
- A survey on Hardware Accelerated LLMs☆51Updated 4 months ago
- An experimental CPU backend for Triton☆111Updated 3 weeks ago
- User-Mode Driver for Tenstorrent hardware☆20Updated this week
- Artifact repository for paper Automatic Generation of High-Performance Quantized Machine Learning Kernels☆17Updated 4 years ago
- ☆14Updated 3 years ago