NVIDIA / cutlassLinks
CUDA Templates and Python DSLs for High-Performance Linear Algebra
☆8,559Updated 2 weeks ago
Alternatives and similar repositories for cutlass
Users that are interested in cutlass are comparing it to the libraries listed below
Sorting:
- A library for accelerating Transformer models on NVIDIA GPUs, including using 8-bit floating point (FP8) precision on Hopper, Ada and Bla…☆2,763Updated this week
- A machine learning compiler for GPUs, CPUs, and ML accelerators☆3,583Updated this week
- Optimized primitives for collective multi-GPU communication☆4,134Updated 2 weeks ago
- Development repository for the Triton language and compiler☆17,154Updated this week
- CUDA Core Compute Libraries☆1,964Updated this week
- CUDA Library Samples☆2,121Updated this week
- FlashInfer: Kernel Library for LLM Serving☆3,861Updated this week
- Domain-specific language designed to streamline the development of high-performance GPU/CPU/Accelerators kernels☆3,508Updated this week
- Tile primitives for speedy kernels☆2,803Updated this week
- Transformer related optimization, including BERT, GPT☆6,320Updated last year
- A retargetable MLIR-based machine learning compiler and runtime toolkit.☆3,383Updated this week
- CUDA Python: Performance meets Productivity☆2,995Updated this week
- how to optimize some algorithm in cuda.☆2,548Updated this week
- The Torch-MLIR project aims to provide first class support from the PyTorch ecosystem to the MLIR ecosystem.☆1,653Updated this week
- Material for gpu-mode lectures☆5,143Updated 2 weeks ago
- [ARCHIVED] Cooperative primitives for CUDA C++. See https://github.com/NVIDIA/cccl☆1,792Updated 2 years ago
- TensorRT LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and support state-of-the-art optimizati…☆11,801Updated this week
- SOTA low-bit LLM quantization (INT8/FP8/INT4/FP4/NF4) & sparsity; leading model compression techniques on TensorFlow, PyTorch, and ONNX R…☆2,508Updated this week
- NVIDIA® TensorRT™ is an SDK for high-performance deep learning inference on NVIDIA GPUs. This repository contains the open source compone…☆12,228Updated 2 weeks ago
- Mirage Persistent Kernel: Compiling LLMs into a MegaKernel☆1,877Updated this week
- AITemplate is a Python framework which renders neural network into high performance CUDA/HIP C++ code. Specialized for FP16 TensorCore (N…☆4,682Updated 3 weeks ago
- FB (Facebook) + GEMM (General Matrix-Matrix Multiplication) - https://code.fb.com/ml-applications/fbgemm/☆1,449Updated this week
- Open deep learning compiler stack for cpu, gpu and specialized accelerators☆12,708Updated this week
- PyTorch native quantization and sparsity for training and inference☆2,392Updated this week
- Samples for CUDA Developers which demonstrates features in CUDA Toolkit☆8,213Updated last month
- Puzzles for learning Triton☆2,031Updated 10 months ago
- PyTorch/TorchScript/FX compiler for NVIDIA GPUs using TensorRT☆2,869Updated this week
- This is a series of GPU optimization topics. Here we will introduce how to optimize the CUDA kernel in detail. I will introduce several…☆1,165Updated 2 years ago
- Ongoing research training transformer models at scale☆13,755Updated last week
- ☆1,931Updated 2 years ago