NVIDIA / cutlass

Related projects ⓘ

Alternatives and complementary repositories for cutlass

• openxla / xla
  A machine learning compiler for GPUs, CPUs, and ML accelerators
  ☆2,710Updated this week
• NVIDIA / nccl
  Optimized primitives for collective multi-GPU communication
  ☆3,253Updated 2 months ago
• NVIDIA / TransformerEngine
  A library for accelerating Transformer models on NVIDIA GPUs, including using 8-bit floating point (FP8) precision on Hopper and Ada GPUs…
  ☆1,979Updated this week
• NVIDIA / cub
  [ARCHIVED] Cooperative primitives for CUDA C++. See https://github.com/NVIDIA/cccl
  ☆1,684Updated last year
• iree-org / iree
  A retargetable MLIR-based machine learning compiler and runtime toolkit.
  ☆2,846Updated this week
• pytorch / FBGEMM
  FB (Facebook) + GEMM (General Matrix-Matrix Multiplication) - https://code.fb.com/ml-applications/fbgemm/
  ☆1,210Updated this week
• NVIDIA / cccl
  CUDA Core Compute Libraries
  ☆1,278Updated this week
• NVIDIA / CUDALibrarySamples
  CUDA Library Samples
  ☆1,617Updated this week
• triton-lang / triton
  Development repository for the Triton language and compiler
  ☆13,443Updated this week
• NVIDIA / FasterTransformer
  Transformer related optimization, including BERT, GPT
  ☆5,890Updated 7 months ago
• llvm / torch-mlir
  The Torch-MLIR project aims to provide first class support from the PyTorch ecosystem to the MLIR ecosystem.
  ☆1,355Updated this week
• apache / tvm
  Open deep learning compiler stack for cpu, gpu and specialized accelerators
  ☆11,798Updated this week
• oneapi-src / oneDNN
  oneAPI Deep Neural Network Library (oneDNN)
  ☆3,635Updated this week
• facebookresearch / fairscale
  PyTorch extensions for high performance and large scale training.
  ☆3,195Updated last week
• flashinfer-ai / flashinfer
  FlashInfer: Kernel Library for LLM Serving
  ☆1,452Updated this week
• NVIDIA / cuda-samples
  Samples for CUDA Developers which demonstrates features in CUDA Toolkit
  ☆6,458Updated 3 months ago
• google / gemmlowp
  Low-precision matrix multiplication
  ☆1,780Updated 9 months ago
• flame / how-to-optimize-gemm
  ☆1,760Updated last year
• HazyResearch / ThunderKittens
  Tile primitives for speedy kernels
  ☆1,658Updated this week
• pytorch / TensorRT
  PyTorch/TorchScript/FX compiler for NVIDIA GPUs using TensorRT
  ☆2,597Updated this week
• facebookincubator / AITemplate
  AITemplate is a Python framework which renders neural network into high performance CUDA/HIP C++ code. Specialized for FP16 TensorCore (N…
  ☆4,561Updated 3 weeks ago
• intel / neural-compressor
  SOTA low-bit LLM quantization (INT8/FP8/INT4/FP4/NF4) & sparsity; leading model compression techniques on TensorFlow, PyTorch, and ONNX R…
  ☆2,227Updated this week
• NVIDIA / thrust
  [ARCHIVED] The C++ parallel algorithms library. See https://github.com/NVIDIA/cccl
  ☆4,924Updated 9 months ago
• google / XNNPACK
  High-efficiency floating-point neural network inference operators for mobile, server, and Web
  ☆1,885Updated this week
• gpu-mode / lectures
  Material for gpu-mode lectures
  ☆3,028Updated this week
• Liu-xiandong / How_to_optimize_in_GPU
  This is a series of GPU optimization topics. Here we will introduce how to optimize the CUDA kernel in detail. I will introduce several…
  ☆827Updated last year
• flexflow / FlexFlow
  FlexFlow Serve: Low-Latency, High-Performance LLM Serving
  ☆1,713Updated this week
• microsoft / nnfusion
  A flexible and efficient deep neural network (DNN) compiler that generates high-performance executable from a DNN model description.
  ☆962Updated 2 months ago
• triton-inference-server / server
  The Triton Inference Server provides an optimized cloud and edge inferencing solution.
  ☆8,348Updated this week
• dmlc / dlpack
  common in-memory tensor structure
  ☆912Updated last month