NVIDIA / TensorRT-Incubator

Related projects ⓘ

Alternatives and complementary repositories for TensorRT-Incubator

• microsoft / triton-shared
  Shared Middle-Layer for Triton Compilation
  ☆191Updated this week
• ColfaxResearch / cutlass-kernels
  ☆167Updated 4 months ago
• ColfaxResearch / cfx-article-src
  ☆48Updated this week
• daadaada / turingas
  Assembler for NVIDIA Volta and Turing GPUs
  ☆201Updated 2 years ago
• wmmae / wmma_extension
  An extension library of WMMA API (Tensor Core API)
  ☆84Updated 4 months ago
• bytedance / flux
  A fast communication-overlapping library for tensor parallelism on GPUs.
  ☆224Updated 3 weeks ago
• microsoft / microxcaling
  PyTorch emulation library for Microscaling (MX)-compatible data formats
  ☆163Updated last month
• te42kyfo / gpu-benches
  collection of benchmarks to measure basic GPU capabilities
  ☆265Updated 5 months ago
• NVIDIA / online-softmax
  Benchmark code for the "Online normalizer calculation for softmax" paper
  ☆59Updated 6 years ago
• sunlex0717 / DissectingTensorCores
  ☆80Updated 7 months ago
• apache / tvm-rfcs
  A home for the final text of all TVM RFCs.
  ☆101Updated last month
• KnowingNothing / MatmulTutorial
  A Easy-to-understand TensorOp Matmul Tutorial
  ☆290Updated 2 months ago
• microsoft / mscclpp
  MSCCL++: A GPU-driven communication stack for scalable AI applications
  ☆250Updated this week
• tlc-pack / relax
  ☆196Updated last year
• TiledTensor / TiledCUDA
  TiledCUDA is a highly efficient kernel template library designed to elevate CUDA C’s level of abstraction for processing tiles.
  ☆154Updated this week
• Bruce-Lee-LY / cuda_hgemm
  Several optimization methods of half-precision general matrix multiplication (HGEMM) using tensor core with WMMA API and MMA PTX instruct…
  ☆302Updated 2 months ago
• reed-lau / cute-gemm
  ☆79Updated 8 months ago
• ROCm / composable_kernel
  Composable Kernel: Performance Portable Programming Model for Machine Learning Tensor Operators
  ☆313Updated this week
• NVIDIA / Fuser
  A Fusion Code Generator for NVIDIA GPUs (commonly known as "nvFuser")
  ☆270Updated this week
• AlibabaPAI / FLASHNN
  ☆79Updated 2 months ago
• intel / intel-xpu-backend-for-triton
  OpenAI Triton backend for Intel® GPUs
  ☆143Updated this week
• iree-org / iree-nvgpu
  ☆48Updated 8 months ago
• sjfeng1999 / gpu-arch-microbenchmark
  Dissecting NVIDIA GPU Architecture
  ☆82Updated 2 years ago
• tlc-pack / libflash_attn
  Standalone Flash Attention v2 kernel without libtorch dependency
  ☆98Updated 2 months ago
• LeiWang1999 / tvm_gpu_gemm
  play gemm with tvm
  ☆84Updated last year
• wangsiping97 / FastGEMV
  High-speed GEMV kernels, at most 2.7x speedup compared to pytorch baseline.
  ☆90Updated 4 months ago
• leimao / CUDA-GEMM-Optimization
  CUDA Matrix Multiplication Optimization
  ☆141Updated 4 months ago
• OpenPPL / ppl.llm.kernel.cuda
  ☆138Updated 2 weeks ago
• mmperf / mmperf
  MatMul Performance Benchmarks for a Single CPU Core comparing both hand engineered and codegen kernels.
  ☆124Updated last year
• DD-DuDa / Cute-Learning
  Examples of CUDA implementations by Cutlass CuTe
  ☆98Updated last week