caibucai22 / awesome-cudaLinks
Awesome code, projects, books, etc. related to CUDA
☆17Updated last month
Alternatives and similar repositories for awesome-cuda
Users that are interested in awesome-cuda are comparing it to the libraries listed below
Sorting:
- Multiple GEMM operators are constructed with cutlass to support LLM inference.☆18Updated 8 months ago
- A CUDA kernel for NHWC GroupNorm for PyTorch☆18Updated 6 months ago
- HunyuanDiT with TensorRT and libtorch☆17Updated last year
- Flash Attention in ~100 lines of CUDA (forward pass only)☆10Updated 11 months ago
- A tool convert TensorRT engine/plan to a fake onnx☆39Updated 2 years ago
- Decoding Attention is specially optimized for MHA, MQA, GQA and MLA using CUDA core for the decoding stage of LLM inference.☆36Updated 2 months ago
- ☆11Updated 2 months ago
- NVIDIA TensorRT Hackathon 2023复赛选题:通义千问Qwen-7B用TensorRT-LLM模型搭建及优化☆42Updated last year
- ffmpeg+cuvid+tensorrt+multicamera☆12Updated 5 months ago
- Tutorials of Extending and importing TVM with CMAKE Include dependency.☆13Updated 7 months ago
- Quantized Attention on GPU☆44Updated 6 months ago
- DeepGEMM: clean and efficient FP8 GEMM kernels with fine-grained scaling☆15Updated 3 weeks ago
- llm deploy project based onnx.☆37Updated 7 months ago
- A practical way of learning Swizzle☆19Updated 4 months ago
- study of cutlass☆21Updated 6 months ago
- ☆49Updated 2 weeks ago
- SGEMM optimization with cuda step by step☆19Updated last year
- 🐱 ncnn int8 模型量化评估☆13Updated 2 years ago
- 使用 CUDA C++ 实现的 llama 模型推理框架☆57Updated 6 months ago
- ☆14Updated 9 months ago
- ☆16Updated last year
- ☆29Updated 4 months ago
- paper-read-notes☆11Updated 8 months ago
- 使用 cutlass 仓库在 ada 架构上实现 fp8 的 flash attention☆68Updated 9 months ago
- ☢️ TensorRT 2023复赛——基于TensorRT-LLM的Llama模型推断加速优化☆48Updated last year
- ⚡️Write HGEMM from scratch using Tensor Cores with WMMA, MMA and CuTe API, Achieve Peak⚡️ Performance.☆79Updated 3 weeks ago
- 天池 NVIDIA TensorRT Hackathon 2023 —— 生成式AI模型优化赛 初赛第三名方 案☆49Updated last year
- ☆19Updated last year
- TensorRT encapsulation, learn, rewrite, practice.☆28Updated 2 years ago
- ☆59Updated last month