tenstorrent / tt-inference-serverLinks
☆16Updated this week
Alternatives and similar repositories for tt-inference-server
Users that are interested in tt-inference-server are comparing it to the libraries listed below
Sorting:
- Tenstorrent console based hardware information program☆43Updated this week
- The TT-Forge FE is a graph compiler designed to optimize and transform computational graphs for deep learning models, enhancing their per…☆44Updated this week
- Tenstorrent's MLIR Based Compiler. We aim to enable developers to run AI on all configurations of Tenstorrent hardware, through an open-s…☆72Updated this week
- Tenstorrent Kernel Module☆46Updated last week
- Tenstorrent MLIR compiler☆141Updated this week
- TVM for Tenstorrent ASICs☆23Updated this week
- Tenstorrent Firmware repository☆14Updated last week
- Repo for AI Compiler team. The intended purpose of this repo is for implementation of a PJRT device.☆18Updated this week
- ☆29Updated 3 months ago
- QuickReduce is a performant all-reduce library designed for AMD ROCm that supports inline compression.☆28Updated 3 months ago
- Tenstorrent Topology (TT-Topology) is a command line utility used to flash multiple NB cards on a system to use specific eth routing conf…☆11Updated last week
- TT-Studio : An all-in-one platform to deploy and manage AI models optimized for Tenstorrent hardware with dedicated front-end demo applic…☆20Updated last week
- Buda Compiler Backend for Tenstorrent devices☆29Updated 2 months ago
- Custom PTX Instruction Benchmark☆126Updated 4 months ago
- Tenstorrent TT-BUDA Repository☆313Updated 2 months ago
- Repository of model demos using TT-Buda☆62Updated 2 months ago
- IREE's PyTorch Frontend, based on Torch Dynamo.☆87Updated this week
- ⭐️ TTNN Compiler for PyTorch 2 ⭐️ Enables running PyTorch models on Tenstorrent hardware using eager or compile path☆47Updated this week
- Attention in SRAM on Tenstorrent Grayskull☆36Updated 11 months ago
- ☆46Updated last week
- A high-throughput and memory-efficient inference and serving engine for LLMs☆17Updated last week
- User-Mode Driver for Tenstorrent hardware☆24Updated this week
- Tenstorrent Firmware Update Utility☆5Updated 3 weeks ago
- Repository for AI model benchmarking on TT-Buda☆15Updated 3 months ago
- Machine-Learning Accelerator System Exploration Tools☆168Updated 3 weeks ago
- Driving Snax with MLIR☆14Updated this week
- Heron: Automatically Constrained High-Performance Library Generation for Deep Learning Accelerators☆21Updated last year
- Frontend integration for PyTorch with tt-mlir☆21Updated this week
- AI Tensor Engine for ROCm☆208Updated this week
- ☆14Updated 3 years ago