wangsiping97 / GPU-Tutorials

Related projects: ⓘ

• NVIDIA / HMM_sample_code
  CUDA 12.2 HMM demos
  ☆16Updated last month
• habanero-lab / APPy
  APPy (Annotated Parallelism for Python) enables users to annotate loops and tensor expressions in Python with compiler directives akin to…
  ☆20Updated 5 months ago
• LeiWang1999 / AutoGPTQ.tvm
  GPTQ inference TVM kernel
  ☆35Updated 4 months ago
• Lin-Mao / DrGPUM
  A memory profiler for NVIDIA GPUs to explore memory inefficiencies in GPU-accelerated applications.
  ☆20Updated 3 months ago
• lzhangbv / dear_pytorch
  [ICDCS 2023] DeAR: Accelerating Distributed Deep Learning with Fine-Grained All-Reduce Pipelining
  ☆12Updated 9 months ago
• enp1s0 / ozIMMU
  FP64 equivalent GEMM via Int8 Tensor Cores using the Ozaki scheme
  ☆44Updated 2 weeks ago
• tridao / cutlass_quant
  ☆16Updated this week
• sgl-project / tensorrt-demo
  TensorRT LLM Benchmark Configuration
  ☆10Updated last month
• MDK8888 / vllmini
  A minimal implementation of vllm.
  ☆29Updated last month
• TiledTensor / TiledCUDA
  TiledCUDA is a highly efficient kernel template library designed to elevate CUDA C’s level of abstraction for processing tiles.
  ☆114Updated last week
• VITA-Group / llm-kick
  [ICLR 2024] Jaiswal, A., Gan, Z., Du, X., Zhang, B., Wang, Z., & Yang, Y. Compressing llms: The truth is rarely pure and never simple.
  ☆15Updated 6 months ago
• Aleph-Alpha / NeurIPS-WANT-submission-efficient-parallelization-layouts
  ☆23Updated 9 months ago
• tridao / flash-attention-wheels
  ☆38Updated 9 months ago
• dlsyscourse / lecture14
  ☆9Updated 11 months ago
• Ying1123 / llm-caching-multiplexing
  ☆17Updated last year
• Karbo123 / pytorch_grouped_gemm
  High Performance Grouped GEMM in PyTorch
  ☆20Updated 2 years ago
• bytedance / QSync
  Official resporitory for "IPDPS' 24 QSync: Quantization-Minimized Synchronous Distributed Training Across Hybrid Devices".
  ☆19Updated 6 months ago
• BBuf / flash-rwkv
  ☆28Updated 3 months ago
• LeiWang1999 / Stream-k.tvm
  ☆14Updated last week
• ColfaxResearch / cfx-article-src
  ☆17Updated this week
• tlc-pack / libflash_attn
  Standalone Flash Attention v2 kernel without libtorch dependency
  ☆93Updated last week
• InfiniTensor / InfiniTensor
  ☆151Updated this week
• mit-han-lab / tinychat-tutorial
  ☆37Updated 2 months ago
• zhuzilin / pytorch-malloc
  An external memory allocator example for PyTorch.
  ☆13Updated 2 years ago
• mit-han-lab / pruning-sparsity-publications
  ☆20Updated last year
• vesuppi / nanoPyC
  ☆71Updated last year
• thuml / learn_torch.compile
  torch.compile artifacts for common deep learning models, can be used as a learning resource for torch.compile
  ☆13Updated 8 months ago
• roastduck / FreeTensor
  A language and compiler for irregular tensor programs.
  ☆132Updated 4 months ago
• unixpickle / learn-ptx
  Learning about CUDA by writing PTX code.
  ☆28Updated 6 months ago
• mlcommons / logging
  MLPerf™ logging library
  ☆30Updated last week