ROCm/TransformerEngine external links

---

GitHub - View repository

GitHub.dev - Open in online code editor

Star history - Growth chart over time

deps.dev - Dependencies and security vulnerabilities

Gitingest - Export source code for LLM usage

Repomix - Export source code for LLM usage

uithub - Export source code for LLM usage

Close

ROCm/TransformerEngine

Readme badge preview -

If you own this repo, copy the snippet below and add it to your README.md

---

Copy

[![RelatedRepos](https://img.shields.io/badge/related-repos-yellow)](https://relatedrepos.com/gh/ROCm/TransformerEngine)

Close

ROCm / TransformerEngineView on GitHubMore

• External links
• Readme badge

☆60Updated this week

Alternatives and similar repositories for TransformerEngine

Users that are interested in TransformerEngine are comparing it to the libraries listed below

• huggingface / hf-rocm-kernels

  View on GitHub
  ☆23Jul 11, 2025Updated 7 months ago
• brightlaboratory / polydl

  View on GitHub
  ☆11Jun 29, 2021Updated 4 years ago
• ROCm / MAD

  View on GitHub
  MAD (Model Automation and Dashboarding)
  ☆31Feb 11, 2026Updated 2 weeks ago
• ROCm / Megatron-LM

  View on GitHub
  Ongoing research training transformer models at scale
  ☆37Feb 20, 2026Updated last week
• ROCm / flash-attention

  View on GitHub
  Fast and memory-efficient exact attention
  ☆221Updated this week
• simveit / persistent_dense_gemm

  View on GitHub
  Persistent dense gemm for Hopper in `CuTeDSL`
  ☆15Aug 9, 2025Updated 6 months ago
• ROCm / rocmProfileData

  View on GitHub
  ☆30Feb 11, 2026Updated 2 weeks ago
• ROCm / rocSHMEM

  View on GitHub
  [DEPRECATED] Moved to ROCm/rocm-systems repo
  ☆144Updated this week
• luongthecong123 / fp8-quant-matmul

  View on GitHub
  Row-wise block scaling for fp8 quantization matrix multiplication. Solution to GPU mode AMD challenge.
  ☆17Feb 9, 2026Updated 2 weeks ago
• ROCm / composable_kernel

  View on GitHub
  [DEPRECATED] Moved to ROCm/rocm-libraries repo. NOTE: develop branch is maintained as a read-only mirror
  ☆521Updated this week
• ROCm / aotriton

  View on GitHub
  Ahead of Time (AOT) Triton Math Library
  ☆92Updated this week
• TiledTensor / TiledBench

  View on GitHub
  Benchmark tests supporting the TiledCUDA library.
  ☆18Nov 19, 2024Updated last year
• ROCm / aws-ofi-rccl

  View on GitHub
  ☆17Nov 11, 2025Updated 3 months ago
• tile-ai / tilescale

  View on GitHub
  Tile-based language built for AI computation across all scales
  ☆123Feb 14, 2026Updated 2 weeks ago
• ROCm / aiter

  View on GitHub
  AI Tensor Engine for ROCm
  ☆356Feb 21, 2026Updated last week
• ROCm / hipTensor

  View on GitHub
  AMD’s C++ library for accelerating tensor primitives
  ☆49Feb 18, 2026Updated last week
• ROCm / xformers

  View on GitHub
  Hackable and optimized Transformers building blocks, supporting a composable construction.
  ☆34Updated this week
• ROCm / iris

  View on GitHub
  AMD RAD's multi-GPU Triton-based framework for seamless multi-GPU programming
  ☆172Feb 21, 2026Updated last week
• ROCm / TransferBench

  View on GitHub
  TransferBench is a utility capable of benchmarking simultaneous copies between user-specified devices (CPUs/GPUs)
  ☆57Updated this week
• ROCm / rocWMMA

  View on GitHub
  [DEPRECATED] Moved to ROCm/rocm-libraries repo
  ☆139Updated this week
• zhuzilin / flash-attention-with-sink

  View on GitHub
  ☆38Aug 7, 2025Updated 6 months ago
• Snektron / gpumode-amd-fp8-mm

  View on GitHub
  My submission for the GPUMODE/AMD fp8 mm challenge
  ☆29Jun 4, 2025Updated 8 months ago
• AMD-AGI / Primus-SaFE

  View on GitHub
  Primus-SaFE(Stability and Fault Endurance)
  ☆50Feb 21, 2026Updated last week
• ROCm / rccl-tests

  View on GitHub
  [DEPRECATED] Moved to ROCm/rocm-systems repo
  ☆86Feb 11, 2026Updated 2 weeks ago
• ROCm / rocm-blogs

  View on GitHub
  ☆71Feb 21, 2026Updated last week
• ROCm / pytorch-micro-benchmarking

  View on GitHub
  ☆23Feb 17, 2026Updated last week
• microsoft / TileFusion

  View on GitHub
  TileFusion is an experimental C++ macro kernel template library that elevates the abstraction level in CUDA C for tile processing.
  ☆106Jun 28, 2025Updated 8 months ago
• ROCm / apex

  View on GitHub
  A PyTorch Extension: Tools for easy mixed precision and distributed training in Pytorch
  ☆25Updated this week
• AMD-AGI / Primus

  View on GitHub
  ☆74Updated this week
• ROCm / triton

  View on GitHub
  Development repository for the Triton language and compiler
  ☆140Updated this week
• ACA-Lab-SJTU / token-ring

  View on GitHub
  ☆13Jan 7, 2025Updated last year
• HPCToolkit / hpctoolkit-tutorial-examples

  View on GitHub
  CPU and GPU tutorial examples
  ☆13Apr 4, 2025Updated 10 months ago
• deepspeedai / DeepSpeed-Kernels

  View on GitHub
  ☆71Mar 26, 2025Updated 11 months ago
• wmmae / wmma_extension

  View on GitHub
  An extension library of WMMA API (Tensor Core API)
  ☆109Jul 12, 2024Updated last year
• ROCm / hipBLASLt

  View on GitHub
  [DEPRECATED] Moved to ROCm/rocm-libraries repo
  ☆113Feb 20, 2026Updated last week
• ademeure / QuickRunCUDA

  View on GitHub
  ☆15Oct 30, 2025Updated 3 months ago
• powderluv / mm_benchmarks

  View on GitHub
  ☆12Dec 31, 2020Updated 5 years ago
• peichenxie / FPRev

  View on GitHub
  ☆24May 9, 2025Updated 9 months ago
• AMD-AGI / torchtitan-amd

  View on GitHub
  A PyTorch native platform for training generative AI models
  ☆15Nov 18, 2025Updated 3 months ago