NVIDIA / cutlassLinks
CUDA Templates and Python DSLs for High-Performance Linear Algebra
☆8,742Updated this week
Alternatives and similar repositories for cutlass
Users that are interested in cutlass are comparing it to the libraries listed below
Sorting:
- Optimized primitives for collective multi-GPU communication☆4,216Updated this week
- CUDA Core Compute Libraries☆2,019Updated this week
- CUDA Library Samples☆2,164Updated last week
- A library for accelerating Transformer models on NVIDIA GPUs, including using 8-bit and 4-bit floating point (FP8 and FP4) precision on H…☆2,909Updated this week
- A machine learning compiler for GPUs, CPUs, and ML accelerators☆3,670Updated this week
- Tile primitives for speedy kernels☆2,873Updated this week
- FlashInfer: Kernel Library for LLM Serving☆4,062Updated this week
- Transformer related optimization, including BERT, GPT☆6,344Updated last year
- Domain-specific language designed to streamline the development of high-performance GPU/CPU/Accelerators kernels☆3,891Updated this week
- Development repository for the Triton language and compiler☆17,529Updated this week
- A retargetable MLIR-based machine learning compiler and runtime toolkit.☆3,450Updated this week
- CUDA Python: Performance meets Productivity☆3,025Updated this week
- Samples for CUDA Developers which demonstrates features in CUDA Toolkit☆8,435Updated 2 months ago
- [ARCHIVED] Cooperative primitives for CUDA C++. See https://github.com/NVIDIA/cccl☆1,801Updated 2 years ago
- how to optimize some algorithm in cuda.☆2,607Updated this week
- The Torch-MLIR project aims to provide first class support from the PyTorch ecosystem to the MLIR ecosystem.☆1,674Updated this week
- Material for gpu-mode lectures☆5,257Updated last month
- PyTorch native quantization and sparsity for training and inference☆2,500Updated this week
- Mirage Persistent Kernel: Compiling LLMs into a MegaKernel☆1,942Updated this week
- Fast CUDA matrix multiplication from scratch☆939Updated 2 months ago
- Reference implementations of MLPerf® inference benchmarks☆1,480Updated last week
- Training materials associated with NVIDIA's CUDA Training Series (www.olcf.ornl.gov/cuda-training-series/)☆901Updated last year
- Puzzles for learning Triton☆2,105Updated 11 months ago
- NVIDIA® TensorRT™ is an SDK for high-performance deep learning inference on NVIDIA GPUs. This repository contains the open source compone…☆12,347Updated this week
- This is a series of GPU optimization topics. Here we will introduce how to optimize the CUDA kernel in detail. I will introduce several…☆1,186Updated 2 years ago
- A Datacenter Scale Distributed Inference Serving Framework☆5,450Updated this week
- DeepGEMM: clean and efficient FP8 GEMM kernels with fine-grained scaling☆5,874Updated 3 weeks ago
- FB (Facebook) + GEMM (General Matrix-Matrix Multiplication) - https://code.fb.com/ml-applications/fbgemm/☆1,471Updated this week
- ☆1,942Updated 2 years ago
- NCCL Tests☆1,325Updated last week