tenstorrent / tt-inference-serverLinks
☆15Updated this week
Alternatives and similar repositories for tt-inference-server
Users that are interested in tt-inference-server are comparing it to the libraries listed below
Sorting:
- Tenstorrent console based hardware information program☆37Updated last week
- Tenstorrent Kernel Module☆44Updated this week
- TVM for Tenstorrent ASICs☆23Updated this week
- Tenstorrent Firmware repository☆13Updated this week
- The TT-Forge FE is a graph compiler designed to optimize and transform computational graphs for deep learning models, enhancing their per…☆44Updated this week
- Buda Compiler Backend for Tenstorrent devices☆29Updated 2 months ago
- A high-throughput and memory-efficient inference and serving engine for LLMs☆16Updated this week
- Tenstorrent MLIR compiler☆132Updated this week
- ⭐️ TTNN Compiler for PyTorch 2 ⭐️ It enables running PyTorch models on Tenstorrent hardware using torch.compile path☆42Updated this week
- Repo for AI Compiler team. The intended purpose of this repo is for implementation of a PJRT device.☆17Updated this week
- QuickReduce is a performant all-reduce library designed for AMD ROCm that supports inline compression.☆27Updated 2 months ago
- IREE plugin repository for the AMD AIE accelerator☆97Updated this week
- LIBRA: Enabling Workload-aware Multi-dimensional Network Topology Optimization for Distributed Training of Large AI Models☆11Updated last year
- ☆19Updated last week
- User-Mode Driver for Tenstorrent hardware☆22Updated this week
- An experimental CPU backend for Triton☆119Updated this week
- Repository for AI model benchmarking on TT-Buda☆15Updated 3 months ago
- A comprehensive tool for visualizing and analyzing model execution, offering interactive graphs, memory plots, tensor details, buffer ove…☆31Updated this week
- GPTPU for SC 2021☆52Updated 2 years ago
- TACOS: [T]opology-[A]ware [Co]llective Algorithm [S]ynthesizer for Distributed Machine Learning☆22Updated last month
- EQueue Dialect☆40Updated 3 years ago
- Alveo Collective Communication Library: MPI-like communication operations for Xilinx Alveo accelerators☆94Updated 2 months ago
- Frontend integration for PyTorch with tt-mlir☆21Updated this week
- Machine-Learning Accelerator System Exploration Tools☆166Updated this week
- This project records the process of optimizing SGEMM (single-precision floating point General Matrix Multiplication) on the riscv platfor…☆20Updated 5 months ago
- ☆15Updated 3 weeks ago
- Repository for MLCommons Chakra schema and tools☆101Updated 2 months ago
- ☆28Updated 2 years ago
- The Riallto Open Source Project from AMD☆80Updated last month
- ARIES: An Agile MLIR-Based Compilation Flow for Reconfigurable Devices with AI Engines (FPGA 2025 Best Paper Nominee)☆30Updated last week