moritztng / grayskull-attention
Attention in SRAM on Tenstorrent Grayskull
☆32Updated 7 months ago
Alternatives and similar repositories for grayskull-attention:
Users that are interested in grayskull-attention are comparing it to the libraries listed below
- Tenstorrent MLIR compiler☆100Updated this week
- The TT-Forge FE is a graph compiler designed to optimize and transform computational graphs for deep learning models, enhancing their per…☆28Updated this week
- An experimental CPU backend for Triton (https//github.com/openai/triton)☆39Updated 10 months ago
- High-Performance SGEMM on CUDA devices☆86Updated last month
- An experimental CPU backend for Triton☆99Updated this week
- TileFusion is an experimental C++ macro kernel template library that elevates the abstraction level in CUDA C for tile processing. By pro…☆67Updated this week
- Buda Compiler Backend for Tenstorrent devices☆26Updated 2 weeks ago
- ☆15Updated 5 months ago
- ☆73Updated 4 months ago
- Framework to reduce autotune overhead to zero for well known deployments.☆62Updated 2 weeks ago
- High-speed GEMV kernels, at most 2.7x speedup compared to pytorch baseline.☆100Updated 8 months ago
- TVM for Tenstorrent ASICs☆21Updated last week
- The Riallto Open Source Project from AMD☆74Updated 4 months ago
- Explore training for quantized models☆16Updated 2 months ago
- A framework that support executing unmodified CUDA source code on non-NVIDIA devices.☆115Updated 2 months ago
- LLM training in simple, raw C/CUDA☆92Updated 10 months ago
- MLIR-based partitioning system☆71Updated this week
- extensible collectives library in triton☆83Updated 5 months ago
- FlexAttention w/ FlashAttention3 Support☆26Updated 5 months ago
- ☆188Updated 3 weeks ago
- Development repository for the Triton language and compiler☆109Updated this week
- ☆24Updated 2 months ago
- IREE's PyTorch Frontend, based on Torch Dynamo.☆71Updated this week
- ShiftAddLLM: Accelerating Pretrained LLMs via Post-Training Multiplication-Less Reparameterization☆103Updated 5 months ago
- Repository of model demos using TT-Buda☆63Updated 2 weeks ago
- ☆49Updated last year