Kedreamix / pytorch-cppcuda-tutorial
tutorial for writing custom pytorch cpp+cuda kernel, applied on volume rendering (NeRF)
☆26Updated last year
Alternatives and similar repositories for pytorch-cppcuda-tutorial:
Users that are interested in pytorch-cppcuda-tutorial are comparing it to the libraries listed below
- ☆48Updated 2 months ago
- Decoding Attention is specially optimized for MHA, MQA, GQA and MLA using CUDA core for the decoding stage of LLM inference.☆35Updated 3 weeks ago
- Implement Flash Attention using Cute.☆74Updated 3 months ago
- ☆17Updated last year
- Quantized Attention on GPU☆45Updated 4 months ago
- 📚FFPA(Split-D): Yet another Faster Flash Prefill Attention with O(1) GPU SRAM complexity for headdim > 256, ~2x↑🎉vs SDPA EA.☆157Updated this week
- Tutorials for writing high-performance GPU operators in AI frameworks.☆130Updated last year
- ⚡️Write HGEMM from scratch using Tensor Cores with WMMA, MMA and CuTe API, Achieve Peak⚡️ Performance.☆63Updated this week
- CPU Memory Compiler and Parallel programing☆25Updated 4 months ago
- ☆61Updated 4 months ago
- ☆160Updated last year
- DeeperGEMM: crazy optimized version☆63Updated 2 weeks ago
- An auxiliary project analysis of the characteristics of KV in DiT Attention.☆28Updated 4 months ago
- Implement custom operators in PyTorch with cuda/c++☆56Updated 2 years ago
- [ICLR 2024] This is the official PyTorch implementation of "QLLM: Accurate and Efficient Low-Bitwidth Quantization for Large Language Mod…☆35Updated last year
- [CVPR 2025] Q-DiT: Accurate Post-Training Quantization for Diffusion Transformers☆43Updated 6 months ago
- Examples of CUDA implementations by Cutlass CuTe☆148Updated last month
- Triton Documentation in Chinese Simplified / Triton 中文文档☆62Updated 2 months ago
- A Suite for Parallel Inference of Diffusion Transformers (DiTs) on multi-GPU Clusters☆44Updated 8 months ago
- ☆114Updated last year
- [ICLR'25] ViDiT-Q: Efficient and Accurate Quantization of Diffusion Transformers for Image and Video Generation☆69Updated last week
- 使用 CUDA C++ 实现的 llama 模型推理框架☆48Updated 4 months ago
- The code repository of "MBQ: Modality-Balanced Quantization for Large Vision-Language Models"☆34Updated 2 weeks ago
- Multiple GEMM operators are constructed with cutlass to support LLM inference.☆17Updated 6 months ago
- ☆155Updated 2 months ago
- Code release for book "Efficient Training in PyTorch"☆52Updated 5 months ago
- We invite you to visit and follow our new repository at https://github.com/microsoft/TileFusion. TiledCUDA is a highly efficient kernel …☆179Updated 2 months ago
- ☆23Updated last month
- Codes & examples for "CUDA - From Correctness to Performance"☆89Updated 5 months ago
- ☆75Updated this week