NVIDIA / cudnn-frontend
cudnn_frontend provides a c++ wrapper for the cudnn backend API and samples on how to use it
☆422Updated 2 weeks ago
Related projects: ⓘ
- Composable Kernel: Performance Portable Programming Model for Machine Learning Tensor Operators☆293Updated this week
- A Fusion Code Generator for NVIDIA GPUs (commonly known as "nvFuser")☆250Updated this week
- CUDA Kernel Benchmarking Library☆482Updated 3 months ago
- The NVIDIA® Tools Extension SDK (NVTX) is a C-based Application Programming Interface (API) for annotating events, code ranges, and resou…☆279Updated last week
- TensorRT Model Optimizer is a unified library of state-of-the-art model optimization techniques such as quantization, sparsity, distillat…☆439Updated this week
- AMD's graph optimization engine.☆183Updated this week
- Representation and Reference Lowering of ONNX Models in MLIR Compiler Infrastructure☆743Updated this week
- Training material for Nsight developer tools☆125Updated last month
- OpenAI Triton backend for Intel® GPUs☆126Updated this week
- ☆392Updated last week
- Examples demonstrating available options to program multiple GPUs in a single node or a cluster☆528Updated last month
- Experimental projects related to TensorRT☆62Updated this week
- A simple high performance CUDA GEMM implementation.☆319Updated 8 months ago
- The Torch-MLIR project aims to provide first class support from the PyTorch ecosystem to the MLIR ecosystem.☆1,301Updated this week
- An open-source efficient deep learning framework/compiler, written in python.☆646Updated 3 weeks ago
- Several optimization methods of half-precision general matrix multiplication (HGEMM) using tensor core with WMMA API and MMA PTX instruct…☆266Updated last week
- Fast CUDA matrix multiplication from scratch☆423Updated 8 months ago
- A library for accelerating Transformer models on NVIDIA GPUs, including using 8-bit floating point (FP8) precision on Hopper and Ada GPUs…☆1,817Updated this week
- Optimizing SGEMM kernel functions on NVIDIA GPUs to a close-to-cuBLAS performance.☆265Updated 2 years ago
- Assembler for NVIDIA Volta and Turing GPUs☆195Updated 2 years ago
- Backward compatible ML compute opset inspired by HLO/MHLO☆381Updated this week
- HIPIFY: Convert CUDA to Portable C++ Code☆499Updated this week
- CUDA Core Compute Libraries☆1,132Updated this week
- A tool for bandwidth measurements on NVIDIA GPUs.☆285Updated 3 months ago
- Step-by-step optimization of CUDA SGEMM☆207Updated 2 years ago
- Shared Middle-Layer for Triton Compilation☆160Updated this week
- ROCm Communication Collectives Library (RCCL)☆251Updated this week
- A collection of examples for the ROCm software stack☆149Updated this week
- ☆221Updated this week
- An unofficial cuda assembler, for all generations of SASS, hopefully ：）☆389Updated last year