NVIDIA / cutlass
CUDA Templates for Linear Algebra Subroutines
☆7,097Updated last week
Alternatives and similar repositories for cutlass:
Users that are interested in cutlass are comparing it to the libraries listed below
- CUDA Library Samples☆1,820Updated last week
- Development repository for the Triton language and compiler☆14,931Updated this week
- CUDA Core Compute Libraries☆1,539Updated this week
- A machine learning compiler for GPUs, CPUs, and ML accelerators☆3,037Updated this week
- [ARCHIVED] Cooperative primitives for CUDA C++. See https://github.com/NVIDIA/cccl☆1,734Updated last year
- FB (Facebook) + GEMM (General Matrix-Matrix Multiplication) - https://code.fb.com/ml-applications/fbgemm/☆1,274Updated this week
- A retargetable MLIR-based machine learning compiler and runtime toolkit.☆3,049Updated this week
- Optimized primitives for collective multi-GPU communication☆3,564Updated this week
- A library for accelerating Transformer models on NVIDIA GPUs, including using 8-bit floating point (FP8) precision on Hopper and Ada GPUs…☆2,293Updated this week
- The Torch-MLIR project aims to provide first class support from the PyTorch ecosystem to the MLIR ecosystem.☆1,466Updated last week
- oneAPI Deep Neural Network Library (oneDNN)☆3,747Updated this week
- Transformer related optimization, including BERT, GPT☆6,084Updated 11 months ago
- FlashInfer: Kernel Library for LLM Serving☆2,439Updated this week
- ☆1,841Updated last year
- Tile primitives for speedy kernels☆2,153Updated this week
- PyTorch/TorchScript/FX compiler for NVIDIA GPUs using TensorRT☆2,711Updated this week
- A GPU-accelerated library containing highly optimized building blocks and an execution engine for data processing to accelerate deep lear…☆5,323Updated this week
- Source code examples from the Parallel Forall Blog☆1,269Updated 7 months ago
- 📚200+ Tensor/CUDA Cores Kernels, ⚡️flash-attn-mma, ⚡️hgemm with WMMA, MMA and CuTe (98%~100% TFLOPS of cuBLAS/FA2 🎉🎉).☆2,901Updated this week
- Open deep learning compiler stack for cpu, gpu and specialized accelerators☆12,112Updated this week
- Material for gpu-mode lectures☆4,075Updated last month
- A list of awesome compiler projects and papers for tensor computation and deep learning.☆2,517Updated 5 months ago
- NVIDIA® TensorRT™ is an SDK for high-performance deep learning inference on NVIDIA GPUs. This repository contains the open source compone…☆11,350Updated last week
- how to optimize some algorithm in cuda.☆2,022Updated this week
- The Triton Inference Server provides an optimized cloud and edge inferencing solution.☆8,926Updated this week
- An efficient C++17 GPU numerical computing library with Python-like syntax☆1,296Updated this week
- Samples for CUDA Developers which demonstrates features in CUDA Toolkit☆7,157Updated last week
- A Python-level JIT compiler designed to make unmodified PyTorch programs faster.☆1,037Updated 11 months ago
- [ARCHIVED] The C++ parallel algorithms library. See https://github.com/NVIDIA/cccl☆4,953Updated last year
- Examples demonstrating available options to program multiple GPUs in a single node or a cluster☆657Updated last month