InfiniTensor / RefactorGraph
分层解耦的深度学习推理引擎
☆70Updated 2 months ago
Alternatives and similar repositories for RefactorGraph:
Users that are interested in RefactorGraph are comparing it to the libraries listed below
- ☆217Updated this week
- ☆70Updated last year
- We invite you to visit and follow our new repository at https://github.com/microsoft/TileFusion. TiledCUDA is a highly efficient kernel …☆175Updated 2 weeks ago
- 使用 CUDA C++ 实现的 llama 模型推理框架☆44Updated 3 months ago
- 先进编译实验室的个人主页☆39Updated 3 weeks ago
- ☆108Updated 10 months ago
- Machine Learning Compiler Road Map☆43Updated last year
- ☆108Updated 10 months ago
- 解读cudnn文档,掌握其用法☆16Updated 9 months ago
- play gemm with tvm☆86Updated last year
- ☆80Updated last year
- ☆35Updated 4 months ago
- Triton Compiler related materials.☆28Updated last month
- Examples of CUDA implementations by Cutlass CuTe☆137Updated last week
- 使用 cutlass 仓库在 ada 架构上实现 fp8 的 flash attention☆53Updated 6 months ago
- hands on model tuning with TVM and profile it on a Mac M1, x86 CPU, and GTX-1080 GPU.☆45Updated last year
- ⚡️Write HGEMM from scratch using Tensor Cores with WMMA, MMA and CuTe API, Achieve Peak⚡️ Performance.☆51Updated last week
- Tutorials for writing high-performance GPU operators in AI frameworks.☆128Updated last year
- A standalone GEMM kernel for fp16 activation and quantized weight, extracted from FasterTransformer☆88Updated 11 months ago
- A light llama-like llm inference framework based on the triton kernel.☆83Updated this week
- Implement Flash Attention using Cute.☆69Updated last month
- ☆142Updated last month
- CUDA 6大并行计算模式 代码与笔记☆60Updated 4 years ago
- A tutorial for CUDA&PyTorch☆126Updated 3 weeks ago
- ☆95Updated 3 years ago
- CUDA SGEMM optimization note☆13Updated last year
- b站上的课程☆71Updated last year
- My study note for mlsys☆14Updated 3 months ago
- 使用 cutlass 实现 flash-attention 精简版,具有教学意义☆35Updated 6 months ago
- Performance of the C++ interface of flash attention and flash attention v2 in large language model (LLM) inference scenarios.☆34Updated 5 months ago