Alternatives and similar repositories for pytorch_open_registration_example

Users that are interested in pytorch_open_registration_example are comparing it to the libraries listed below

• wmmae / wmma_extension
  An extension library of WMMA API (Tensor Core API)
  ☆105Updated last year
• NVIDIA / online-softmax
  Benchmark code for the "Online normalizer calculation for softmax" paper
  ☆99Updated 7 years ago
• tlc-pack / TLCBench
  Benchmark scripts for TVM
  ☆74Updated 3 years ago
• cmu-catalyst / collage
  System for automated integration of deep learning backends.
  ☆47Updated 3 years ago
• tlc-pack / cutlass_fpA_intB_gemm
  A standalone GEMM kernel for fp16 activation and quantized weight, extracted from FasterTransformer
  ☆94Updated last week
• ROCm / aotriton
  Ahead of Time (AOT) Triton Math Library
  ☆76Updated 2 weeks ago
• OpenPPL / ppl.llm.kernel.cuda
  ☆150Updated 8 months ago
• AlibabaPAI / FLASHNN
  ☆98Updated last year
• sunlex0717 / DissectingTensorCores
  ☆107Updated last year
• apache / tvm-rfcs
  A home for the final text of all TVM RFCs.
  ☆106Updated 11 months ago
• mmperf / mmperf
  MatMul Performance Benchmarks for a Single CPU Core comparing both hand engineered and codegen kernels.
  ☆134Updated last year
• nox-410 / tvm.tl
  An extention of TVMScript to write simple and high performance GPU kernels with tensorcore.
  ☆51Updated last year
• tlc-pack / libflash_attn
  Standalone Flash Attention v2 kernel without libtorch dependency
  ☆110Updated last year
• OpenPPL / CuAssembler
  An unofficial cuda assembler, for all generations of SASS, hopefully ：）
  ☆84Updated 2 years ago
• daadaada / turingas
  Assembler for NVIDIA Volta and Turing GPUs
  ☆230Updated 3 years ago
• yifuwang / symm-mem-recipes
  ☆116Updated 8 months ago
• iree-org / iree-nvgpu
  ☆50Updated last year
• Bruce-Lee-LY / flash_attention_inference
  Performance of the C++ interface of flash attention and flash attention v2 in large language model (LLM) inference scenarios.
  ☆40Updated 6 months ago
• lixiuhong / batched_gemm
  ☆39Updated 5 years ago
• thu-pacman / PET
  PET: Optimizing Tensor Programs with Partially Equivalent Transformations and Automated Corrections
  ☆122Updated 3 years ago
• LeiWang1999 / tvm_gpu_gemm
  play gemm with tvm
  ☆91Updated 2 years ago
• pigirons / conv3x3_m1
  This is a demo how to write a high performance convolution run on apple silicon
  ☆54Updated 3 years ago
• ColfaxResearch / cfx-article-src
  ☆139Updated 4 months ago
• infinigence / FlashOverlap
  A lightweight design for computation-communication overlap.
  ☆167Updated last week
• wzsh / wmma_tensorcore_sample
  Matrix Multiply-Accumulate with CUDA and WMMA( Tensor Core)
  ☆143Updated 5 years ago
• intel / xetla
  ☆62Updated 9 months ago
• ankan-ban / llama_cu_awq
  llama INT4 cuda inference with AWQ
  ☆54Updated 8 months ago
• ROCm / TransformerEngine
  ☆44Updated this week
• mlc-ai / mlc-python
  ☆37Updated 2 months ago
• Karbo123 / pytorch_grouped_gemm
  High Performance Grouped GEMM in PyTorch
  ☆30Updated 3 years ago