Alternatives and similar repositories for TransformerEngine:

Users that are interested in TransformerEngine are comparing it to the libraries listed below

• wmmae / wmma_extension
  An extension library of WMMA API (Tensor Core API)
  ☆87Updated 6 months ago
• north-numerical-computing / tensor-cores-numerical-behavior
  Test suite for probing the numerical behavior of NVIDIA tensor cores
  ☆36Updated 5 months ago
• ROCm / rccl-tests
  RCCL Performance Benchmark Tests
  ☆55Updated this week
• pytorch-labs / triton-cpu
  An experimental CPU backend for Triton (https//github.com/openai/triton)
  ☆37Updated 8 months ago
• microsoft / DeepSpeed-Kernels
  ☆57Updated 7 months ago
• ColfaxResearch / cfx-article-src
  ☆66Updated 3 weeks ago
• ROCm / rocm_bandwidth_test
  Bandwidth test for ROCm
  ☆52Updated this week
• flexflow / flexflow-serve
  FlexFlow Serve: Low-Latency, High-Performance LLM Serving
  ☆15Updated this week
• ROCm / aotriton
  Ahead of Time (AOT) Triton Math Library
  ☆49Updated this week
• iree-org / iree-nvgpu
  ☆48Updated 10 months ago
• ROCm / triton
  Development repository for the Triton language and compiler
  ☆102Updated this week
• pytorch-labs / tritonbench
  Tritonbench is a collection of PyTorch custom operators with example inputs to measure their performance.
  ☆75Updated this week
• yifuwang / symm-mem-recipes
  ☆27Updated 3 weeks ago
• Azure / msccl-executor-nccl
  ☆35Updated last month
• ROCm / roctracer
  ROCm Tracer Callback/Activity Library for Performance tracing AMD GPUs
  ☆78Updated this week
• cchan / tccl
  extensible collectives library in triton
  ☆76Updated 3 months ago
• enp1s0 / ozIMMU
  FP64 equivalent GEMM via Int8 Tensor Cores using the Ozaki scheme
  ☆51Updated 4 months ago
• wangsiping97 / FastGEMV
  High-speed GEMV kernels, at most 2.7x speedup compared to pytorch baseline.
  ☆93Updated 6 months ago
• lixiuhong / batched_gemm
  ☆38Updated 4 years ago
• triton-lang / kernels
  ☆64Updated 2 months ago
• mlc-ai / mlc-python
  ☆21Updated last week
• tlc-pack / cutlass_fpA_intB_gemm
  A standalone GEMM kernel for fp16 activation and quantized weight, extracted from FasterTransformer
  ☆87Updated 10 months ago
• tlc-pack / libflash_attn
  Standalone Flash Attention v2 kernel without libtorch dependency
  ☆99Updated 4 months ago
• triton-lang / triton-cpu
  An experimental CPU backend for Triton
  ☆75Updated this week
• ROCm / rocWMMA
  rocWMMA
  ☆97Updated this week
• tonyzhang617 / nomad-dist
  ☆23Updated 10 months ago
• temporal-hpc / reduction-tensor-cores
  Fast GPU based tensor core reductions
  ☆13Updated 2 years ago
• intel / intel-xpu-backend-for-triton
  OpenAI Triton backend for Intel® GPUs
  ☆154Updated this week
• vllm-project / flash-attention
  Fast and memory-efficient exact attention
  ☆41Updated this week
• ROCm / hipBLASLt
  hipBLASLt is a library that provides general matrix-matrix operations with a flexible API and extends functionalities beyond a traditiona…
  ☆72Updated this week