moritztng / grayskull-attention
Attention in SRAM on Tenstorrent Grayskull
☆33Updated 9 months ago
Alternatives and similar repositories for grayskull-attention:
Users that are interested in grayskull-attention are comparing it to the libraries listed below
- Tenstorrent MLIR compiler☆119Updated this week
- An experimental CPU backend for Triton (https//github.com/openai/triton)☆40Updated last month
- High-Performance SGEMM on CUDA devices☆90Updated 2 months ago
- TileFusion is an experimental C++ macro kernel template library that elevates the abstraction level in CUDA C for tile processing.☆80Updated last week
- ☆77Updated 5 months ago
- Buda Compiler Backend for Tenstorrent devices☆28Updated 2 weeks ago
- ☆16Updated 6 months ago
- ☆27Updated this week
- Repo for AI Compiler team. The intended purpose of this repo is for implementation of a PJRT device.☆13Updated this week
- LLM training in simple, raw C/CUDA☆92Updated 11 months ago
- The Riallto Open Source Project from AMD☆77Updated last week
- High-speed GEMV kernels, at most 2.7x speedup compared to pytorch baseline.☆105Updated 9 months ago
- The TT-Forge FE is a graph compiler designed to optimize and transform computational graphs for deep learning models, enhancing their per…☆37Updated this week
- Tenstorrent's MLIR Based Compiler. We aim to enable developers to run AI on all configurations of Tenstorrent hardware, through an open-s…☆35Updated this week
- extensible collectives library in triton☆85Updated 2 weeks ago
- A lightweight, Pythonic, frontend for MLIR☆81Updated last year
- Explore training for quantized models☆17Updated 3 months ago
- Machine Learning Agility (MLAgility) benchmark and benchmarking tools☆39Updated last month
- FractalTensor is a programming framework that introduces a novel approach to organizing data in deep neural networks (DNNs) as a list of …☆26Updated 3 months ago
- An experimental CPU backend for Triton☆105Updated last week
- Test suite for probing the numerical behavior of NVIDIA tensor cores☆37Updated 8 months ago
- ☆50Updated last year
- Unified compiler/runtime for interfacing with PyTorch Dynamo.☆99Updated last month
- ☆94Updated 11 months ago
- Development repository for the Triton language and compiler☆118Updated this week
- MLIR-based partitioning system☆80Updated this week
- IREE's PyTorch Frontend, based on Torch Dynamo.☆76Updated this week
- ☆27Updated last month
- Framework to reduce autotune overhead to zero for well known deployments.☆63Updated this week
- Standalone Flash Attention v2 kernel without libtorch dependency☆108Updated 7 months ago