ROCm/TransformerEngine external links

---

GitHub - View repository

GitHub.dev - Open in online code editor

Star history - Growth chart over time

deps.dev - Dependencies and security vulnerabilities

Gitingest - Export source code for LLM usage

Repomix - Export source code for LLM usage

uithub - Export source code for LLM usage

Close

ROCm/TransformerEngine

Readme badge preview -

If you own this repo, copy the snippet below and add it to your README.md

---

Copy

[![RelatedRepos](https://img.shields.io/badge/related-repos-yellow)](https://relatedrepos.com/gh/ROCm/TransformerEngine)

Close

ROCm / TransformerEngineView on GitHubMore

• External links
• Readme badge

☆64Mar 15, 2026Updated this week

Alternatives and similar repositories for TransformerEngine

Users that are interested in TransformerEngine are comparing it to the libraries listed below

• ROCm / Megatron-LM

  View on GitHub
  Ongoing research training transformer models at scale
  ☆39Mar 10, 2026Updated last week
• ROCm / flash-attention

  View on GitHub
  Fast and memory-efficient exact attention
  ☆224Updated this week
• ROCm / rocmProfileData

  View on GitHub
  ☆30Mar 2, 2026Updated 2 weeks ago
• huggingface / hf-rocm-kernels

  View on GitHub
  ☆23Jul 11, 2025Updated 8 months ago
• brightlaboratory / polydl

  View on GitHub
  ☆11Jun 29, 2021Updated 4 years ago
• ROCm / MAD

  View on GitHub
  MAD (Model Automation and Dashboarding)
  ☆31Feb 27, 2026Updated 3 weeks ago
• ROCm / composable_kernel

  View on GitHub
  [DEPRECATED] Moved to ROCm/rocm-libraries repo. NOTE: develop branch is maintained as a read-only mirror
  ☆524Mar 13, 2026Updated last week
• AMD-AGI / Primus

  View on GitHub
  ☆82Updated this week
• luongthecong123 / fp8-quant-matmul

  View on GitHub
  Row-wise block scaling for fp8 quantization matrix multiplication. Solution to GPU mode AMD challenge.
  ☆18Feb 9, 2026Updated last month
• simveit / persistent_dense_gemm

  View on GitHub
  Persistent dense gemm for Hopper in `CuTeDSL`
  ☆15Aug 9, 2025Updated 7 months ago
• ROCm / aws-ofi-rccl

  View on GitHub
  ☆16Nov 11, 2025Updated 4 months ago
• ROCm / apex

  View on GitHub
  A PyTorch Extension: Tools for easy mixed precision and distributed training in Pytorch
  ☆25Updated this week
• ROCm / aiter

  View on GitHub
  AI Tensor Engine for ROCm
  ☆381Mar 13, 2026Updated last week
• ROCm / aotriton

  View on GitHub
  Ahead of Time (AOT) Triton Math Library
  ☆94Updated this week
• nod-ai / ossci-fleet

  View on GitHub
  The goal of the OSSCI Fleet is to provide a central mechanism to enable test automation, batch job scheduling, and developer access to a …
  ☆13Feb 27, 2026Updated 3 weeks ago
• AMD-AGI / torchtitan-amd

  View on GitHub
  A PyTorch native platform for training generative AI models
  ☆15Nov 18, 2025Updated 4 months ago
• ROCm / xformers

  View on GitHub
  Hackable and optimized Transformers building blocks, supporting a composable construction.
  ☆34Feb 26, 2026Updated 3 weeks ago
• AMD-AGI / Primus-SaFE

  View on GitHub
  Primus-SaFE(Stability and Fault Endurance)
  ☆53Updated this week
• ROCm / rocWMMA

  View on GitHub
  [DEPRECATED] Moved to ROCm/rocm-libraries repo
  ☆139Mar 13, 2026Updated last week
• ROCm / iris

  View on GitHub
  AMD RAD's multi-GPU Triton-based framework for seamless multi-GPU programming
  ☆181Mar 13, 2026Updated last week
• ROCm / rocm-blogs

  View on GitHub
  ☆72Mar 13, 2026Updated last week
• ROCm / hipTensor

  View on GitHub
  AMD’s C++ library for accelerating tensor primitives
  ☆49Mar 12, 2026Updated last week
• TiledTensor / TiledBench

  View on GitHub
  Benchmark tests supporting the TiledCUDA library.
  ☆18Nov 19, 2024Updated last year
• ROCm / rocSHMEM

  View on GitHub
  [DEPRECATED] Moved to ROCm/rocm-systems repo
  ☆146Mar 10, 2026Updated last week
• ROCm / triton

  View on GitHub
  Development repository for the Triton language and compiler
  ☆143Mar 13, 2026Updated last week
• ROCm / rccl-tests

  View on GitHub
  [DEPRECATED] Moved to ROCm/rocm-systems repo
  ☆88Mar 5, 2026Updated 2 weeks ago
• ROCm / TransferBench

  View on GitHub
  TransferBench is a utility capable of benchmarking simultaneous copies between user-specified devices (CPUs/GPUs)
  ☆60Updated this week
• ROCm / rccl

  View on GitHub
  [DEPRECATED] Moved to ROCm/rocm-systems repo
  ☆413Updated this week
• Snektron / gpumode-amd-fp8-mm

  View on GitHub
  My submission for the GPUMODE/AMD fp8 mm challenge
  ☆29Jun 4, 2025Updated 9 months ago
• ROCm / hipBLASLt

  View on GitHub
  [DEPRECATED] Moved to ROCm/rocm-libraries repo
  ☆113Updated this week
• tile-ai / tilescale

  View on GitHub
  Tile-based language built for AI computation across all scales
  ☆138Mar 12, 2026Updated last week
• amd / scalapack

  View on GitHub
  DEPRECATED. This Scalapck repository is deprecated. The last version in this repository is 3.0. Refer to "aocl-scalapack" repository unde…
  ☆10Mar 15, 2021Updated 5 years ago
• ROCm / rocprofiler-compute

  View on GitHub
  [DEPRECATED] Moved to ROCm/rocm-systems repo
  ☆165Feb 16, 2026Updated last month
• ROCm / amdsmi

  View on GitHub
  AMD SMI
  ☆119Updated this week
• zhuzilin / flash-attention-with-sink

  View on GitHub
  ☆38Aug 7, 2025Updated 7 months ago
• Joshuaalbert / jaxnlds

  View on GitHub
  Inference on non-linear dynamical systems written in JAX
  ☆11Aug 20, 2020Updated 5 years ago
• run-ai / k8s-launcher

  View on GitHub
  ☆13Aug 1, 2023Updated 2 years ago
• AMD-AGI / Primus-Turbo

  View on GitHub
  ☆64Updated this week
• powderluv / mm_benchmarks

  View on GitHub
  ☆12Dec 31, 2020Updated 5 years ago