wangsiping97 / GPU-TutorialsLinks
Tutorials to GPU programming. Reading notes.
☆18Updated 2 years ago
Alternatives and similar repositories for GPU-Tutorials
Users that are interested in GPU-Tutorials are comparing it to the libraries listed below
Sorting:
- 分层解耦的深度学习推理引擎☆75Updated 7 months ago
- Tutorials for writing high-performance GPU operators in AI frameworks.☆132Updated 2 years ago
- autoTVM神经网络推理代码优化搜索演示,基于tvm编译开源模型centerface,并使用autoTVM搜索最优推理代码, 最终部署编译为c++代码,演示平台是cuda,可以是其他平台,例如树莓派,安卓手机,苹果手机.Thi is a demonstration of …☆28Updated 4 years ago
- ☆21Updated 4 years ago
- CUDA 6大并行计算模式 代码与笔记☆61Updated 5 years ago
- This is a demo how to write a high performance convolution run on apple silicon☆54Updated 3 years ago
- SGEMM optimization with cuda step by step☆20Updated last year
- ☆98Updated 4 years ago
- 将MNN拆解的简易前向推理框架(for study!)☆23Updated 4 years ago
- 大规模并行处理器编程实战 第二版答案☆33Updated 3 years ago
- Implement custom operators in PyTorch with cuda/c++☆71Updated 2 years ago
- ☆115Updated last month
- ☆124Updated last year
- Decoding Attention is specially optimized for MHA, MQA, GQA and MLA using CUDA core for the decoding stage of LLM inference.☆44Updated 3 months ago
- Snapdragon Neural Processing Engine (SNPE) SDKThe Snapdragon Neural Processing Engine (SNPE) is a Qualcomm Snapdragon software accelerate…☆35Updated 3 years ago
- 鉴定网络热门并行编程框架 - 性能测评(附小彭老师锐评)已评测:Taichi、SyCL、C++、OpenMP、TBB、Mojo☆36Updated 2 years ago
- pdf☆92Updated 7 years ago
- 用C++实现一个简单的Transformer模型。 Attention Is All You Need。☆50Updated 4 years ago
- ResNet Implementation, Training, and Inference Using LibTorch C++ API☆42Updated last year
- mperf是一个面向移动/嵌入式平台的算子性能调优工具箱☆189Updated 2 years ago
- Inference framework for MoE layers based on TensorRT with Python binding☆41Updated 4 years ago
- ncnn和pnnx格式编辑器☆137Updated last year
- Standalone Flash Attention v2 kernel without libtorch dependency☆111Updated last year
- Code for ACM MobiCom 2024 paper "FlexNN: Efficient and Adaptive DNN Inference on Memory-Constrained Edge Devices"☆55Updated 8 months ago
- 方便扩展的Cuda算子理解和优化框架,仅用在学习使用☆17Updated last year
- ⚡️Write HGEMM from scratch using Tensor Cores with WMMA, MMA and CuTe API, Achieve Peak⚡️ Performance.☆119Updated 5 months ago
- Open deep learning compiler stack for cpu, gpu and specialized accelerators☆19Updated 2 weeks ago
- ☆33Updated last year
- Manually implemented quantization-aware training☆21Updated 2 years ago
- Serving Inside Pytorch☆163Updated 2 weeks ago