Alternatives and similar repositories for pytorch-cppcuda-tutorial:

Users that are interested in pytorch-cppcuda-tutorial are comparing it to the libraries listed below

• luliyucoordinate / cute-flash-attention
  Implement Flash Attention using Cute.
  ☆69Updated last month
• CalebDu / Awesome-Cute
  ☆33Updated 3 weeks ago
• li199603 / sgemm_with_cuda
  ☆15Updated 10 months ago
• feifeibear / ChituAttention
  Quantized Attention on GPU
  ☆34Updated 2 months ago
• DefTruth / ffpa-attn-mma
  📚FFPA: Yet antother Faster Flash Prefill Attention with O(1)⚡️SRAM complexity for headdim > 256, 1.8x~3x↑🎉faster than SDPA EA.
  ☆96Updated this week
• DefTruth / hgemm-tensorcores-mma
  ⚡️Write HGEMM from scratch using Tensor Cores with WMMA, MMA and CuTe API, Achieve Peak⚡️ Performance.
  ☆51Updated last week
• Bruce-Lee-LY / decoding_attention
  Decoding Attention is specially optimized for multi head attention (MHA) using CUDA core for the decoding stage of LLM inference.
  ☆29Updated 3 months ago
• mit-han-lab / tinychat-tutorial
  ☆59Updated 3 months ago
• xdit-project / DiTCacheAnalysis
  An auxiliary project analysis of the characteristics of KV in DiT Attention.
  ☆24Updated 2 months ago
• mrzhuzhe / riven
  CPU Memory Compiler and Parallel programing
  ☆25Updated 2 months ago
• thu-nics / DiTFastAttn
  ☆143Updated last month
• sunkx109 / My-Torch-Extension
  A minimalist and extensible PyTorch extension for implementing custom backend operators in PyTorch.
  ☆31Updated 10 months ago
• Juanerx / Q-DiT
  PyTorch code for Q-DiT: Accurate Post-Training Quantization for Diffusion Transformers
  ☆37Updated 5 months ago
• Bruce-Lee-LY / cutlass_gemm
  Multiple GEMM operators are constructed with cutlass to support LLM inference.
  ☆16Updated 4 months ago
• thu-nics / ViDiT-Q
  [ICLR'25] ViDiT-Q: Efficient and Accurate Quantization of Diffusion Transformers for Image and Video Generation
  ☆51Updated this week
• DD-DuDa / Cute-Learning
  Examples of CUDA implementations by Cutlass CuTe
  ☆137Updated last week
• mit-han-lab / patch_conv
  Patch convolution to avoid large GPU memory usage of Conv2D
  ☆84Updated 3 weeks ago
• mdy666 / mdy_triton
  ☆60Updated this week
• mit-han-lab / Block-Sparse-Attention
  A sparse attention kernel supporting mix sparse patterns
  ☆108Updated this week
• thu-ml / Jetfire-INT8Training
  ☆32Updated 6 months ago
• Hsu1023 / DuQuant
  [NeurIPS 2024 Oral🔥] DuQuant: Distributing Outliers via Dual Transformation Makes Stronger Quantized LLMs.
  ☆139Updated 4 months ago
• fla-org / flash-bidirectional-linear-attention
  Triton implement of bi-directional (non-causal) linear attention
  ☆42Updated last week
• interestingLSY / CUDA-From-Correctness-To-Performance-Code
  Codes & examples for "CUDA - From Correctness to Performance"
  ☆80Updated 3 months ago
• Shenyi-Z / ToCa
  Accelerating Diffusion Transformers with Token-wise Feature Caching
  ☆59Updated 2 weeks ago
• ModelTC / QLLM
  [ICLR 2024] This is the official PyTorch implementation of "QLLM: Accurate and Efficient Low-Bitwidth Quantization for Large Language Mod…
  ☆35Updated 11 months ago
• YuxueYang1204 / CudaDemo
  Implement custom operators in PyTorch with cuda/c++
  ☆53Updated 2 years ago
• UofT-EcoSystem / Minuet
  [EuroSys'24] Minuet: Accelerating 3D Sparse Convolutions on GPUs
  ☆75Updated 8 months ago
• BaiTheBest / SparseLLM
  Official Repo for SparseLLM: Global Pruning of LLMs (NeurIPS 2024)
  ☆51Updated last week
• PipeFusion / PipeFusion
  A Suite for Parallel Inference of Diffusion Transformers (DiTs) on multi-GPU Clusters
  ☆38Updated 6 months ago
• INT-FlashAttention2024 / INT-FlashAttention
  ☆60Updated 3 weeks ago