zjhellofss / triton_courseLinks
☆28Updated last month
Alternatives and similar repositories for triton_course
Users that are interested in triton_course are comparing it to the libraries listed below
Sorting:
- A light llama-like llm inference framework based on the triton kernel.☆128Updated last week
- 使用 CUDA C++ 实现的 llama 模型推理框架☆57Updated 7 months ago
- llm theoretical performance analysis tools and support params, flops, memory and latency analysis.☆96Updated last week
- ☆135Updated last year
- learning how CUDA works☆271Updated 3 months ago
- some hpc project for learning☆22Updated 9 months ago
- A CUDA tutorial to make people learn CUDA program from 0☆234Updated 11 months ago
- ☆22Updated 3 months ago
- A minimalist and extensible PyTorch extension for implementing custom backend operators in PyTorch.☆33Updated last year
- Examples of CUDA implementations by Cutlass CuTe☆197Updated 4 months ago
- Optimize softmax in triton in many cases☆21Updated 9 months ago
- A tutorial for CUDA&PyTorch☆146Updated 5 months ago
- Implement Flash Attention using Cute.☆87Updated 6 months ago
- 校招、秋招、春招、实习好项目,带你从零动手实现支持LLama2/3和Qwen2.5的大模型推理框架。☆369Updated this week
- 分层解耦的深度学习推理引擎☆73Updated 4 months ago
- This project is about convolution operator optimization on GPU, include GEMM based (Implicit GEMM) convolution.☆33Updated 6 months ago
- ☆278Updated 8 months ago
- 飞桨护航计划集训营☆18Updated last month
- b站上的课程☆76Updated last year
- ☆65Updated 5 months ago
- ☆80Updated last month
- ☆123Updated 6 months ago
- Triton Documentation in Chinese Simplified / Triton 中文文档☆71Updated 2 months ago
- ☆58Updated 7 months ago
- my cs notes☆51Updated 8 months ago
- Implement custom operators in PyTorch with cuda/c++☆63Updated 2 years ago
- ☆148Updated 5 months ago
- hands on model tuning with TVM and profile it on a Mac M1, x86 CPU, and GTX-1080 GPU.☆48Updated 2 years ago
- ☆24Updated last week
- Decoding Attention is specially optimized for MHA, MQA, GQA and MLA using CUDA core for the decoding stage of LLM inference.☆38Updated 2 weeks ago