Alternatives and similar repositories for pytorch-cppcuda-tutorial

Users that are interested in pytorch-cppcuda-tutorial are comparing it to the libraries listed below

• luliyucoordinate / cute-flash-attention
  Implement Flash Attention using Cute.
  ☆85Updated 5 months ago
• openmlsys / openmlsys-cuda
  Tutorials for writing high-performance GPU operators in AI frameworks.
  ☆130Updated last year
• mdy666 / mdy_triton
  ☆132Updated last month
• Bruce-Lee-LY / decoding_attention
  Decoding Attention is specially optimized for MHA, MQA, GQA and MLA using CUDA core for the decoding stage of LLM inference.
  ☆36Updated 2 months ago
• xlite-dev / HGEMM
  ⚡️Write HGEMM from scratch using Tensor Cores with WMMA, MMA and CuTe API, Achieve Peak⚡️ Performance.
  ☆79Updated 3 weeks ago
• mrzhuzhe / riven
  CPU Memory Compiler and Parallel programing
  ☆26Updated 6 months ago
• CalebDu / Awesome-Cute
  ☆73Updated 3 weeks ago
• YuxueYang1204 / CudaDemo
  Implement custom operators in PyTorch with cuda/c++
  ☆62Updated 2 years ago
• InternLM / turbomind
  ☆85Updated 2 months ago
• mit-han-lab / tinychat-tutorial
  ☆67Updated 7 months ago
• Aaronhuang-778 / Mixture-Compressor-MoE
  [ICLR 2025] Mixture Compressor for Mixture-of-Experts LLMs Gains More
  ☆45Updated 3 months ago
• interestingLSY / CUDA-From-Correctness-To-Performance-Code
  Codes & examples for "CUDA - From Correctness to Performance"
  ☆98Updated 7 months ago
• feifeibear / ChituAttention
  Quantized Attention on GPU
  ☆44Updated 6 months ago
• mit-han-lab / x-attention
  XAttention: Block Sparse Attention with Antidiagonal Scoring
  ☆160Updated this week
• CalvinXKY / BasicCUDA
  A tutorial for CUDA&PyTorch
  ☆142Updated 4 months ago
• xlite-dev / ffpa-attn
  📚FFPA(Split-D): Extend FlashAttention with Split-D for large headdim, O(1) GPU SRAM complexity, 1.8x~3x↑🎉 faster than SDPA EA.
  ☆184Updated 3 weeks ago
• li199603 / sgemm_with_cuda
  SGEMM optimization with cuda step by step
  ☆19Updated last year
• phonism / genesis
  Gensis is a lightweight deep learning framework written from scratch in Python, with Triton as its backend for high-performance computing…
  ☆13Updated 5 months ago
• Ascend / triton-ascend
  ☆48Updated this week
• iclementine / optimize_softmax
  Optimize softmax in triton in many cases
  ☆21Updated 9 months ago
• DD-DuDa / BitDecoding
  A GPU-optimized system for efficient long-context LLMs decoding with low-bit KV cache.
  ☆36Updated last month
• caiwanxianhust / FasterLLaMA
  使用 CUDA C++ 实现的 llama 模型推理框架
  ☆57Updated 7 months ago
• DD-DuDa / Cute-Learning
  Examples of CUDA implementations by Cutlass CuTe
  ☆190Updated 4 months ago
• PKU-SEC-Lab / HybriMoE
  [DAC'25] Official implement of "HybriMoE: Hybrid CPU-GPU Scheduling and Cache Management for Efficient MoE Inference"
  ☆51Updated 2 weeks ago
• harleyszhang / llm_counts
  llm theoretical performance analysis tools and support params, flops, memory and latency analysis.
  ☆92Updated last week
• 66RING / tiny-flash-attention
  flash attention tutorial written in python, triton, cuda, cutlass
  ☆370Updated 3 weeks ago
• hyperai / triton-cn
  Triton Documentation in Chinese Simplified / Triton 中文文档
  ☆71Updated last month
• feifeibear / LLMRoofline
  Compare different hardware platforms via the Roofline Model for LLM inference tasks.
  ☆100Updated last year
• pzhao-eng / FlashMLA
  ☆48Updated 3 weeks ago
• AyakaGEMM / Hands-on-GEMM
  ☆134Updated last year