ailzhang / EfficientPyTorch
Code release for book "Efficient Training in PyTorch"
☆60Updated 2 weeks ago
Alternatives and similar repositories for EfficientPyTorch:
Users that are interested in EfficientPyTorch are comparing it to the libraries listed below
- Implement Flash Attention using Cute.☆76Updated 4 months ago
- ☆82Updated last month
- ☆92Updated 7 months ago
- 📚FFPA(Split-D): Yet another Faster Flash Attention with O(1) GPU SRAM complexity large headdim, 1.8x~3x↑🎉 faster than SDPA EA.☆169Updated 2 weeks ago
- llm theoretical performance analysis tools and support params, flops, memory and latency analysis.☆85Updated 3 months ago
- Examples of CUDA implementations by Cutlass CuTe☆159Updated 2 months ago
- Compare different hardware platforms via the Roofline Model for LLM inference tasks.☆97Updated last year
- Puzzles for learning Triton, play it with minimal environment configuration!☆296Updated 4 months ago
- ☆60Updated this week
- ☆131Updated last month
- ⚡️Write HGEMM from scratch using Tensor Cores with WMMA, MMA and CuTe API, Achieve Peak⚡️ Performance.☆73Updated 3 weeks ago
- nnScaler: Compiling DNN models for Parallel Training☆107Updated last week
- Tutorials for writing high-performance GPU operators in AI frameworks.☆130Updated last year
- PyTorch bindings for CUTLASS grouped GEMM.☆120Updated 3 months ago
- ☆122Updated last year
- ☆55Updated 2 weeks ago
- ☆121Updated this week
- A collection of memory efficient attention operators implemented in the Triton language.☆262Updated 10 months ago
- ☆88Updated 3 weeks ago
- flash attention tutorial written in python, triton, cuda, cutlass☆334Updated 3 months ago
- ☆35Updated 8 months ago
- ☆148Updated 3 months ago
- PyTorch bindings for CUTLASS grouped GEMM.☆81Updated 5 months ago
- Summary of some awesome work for optimizing LLM inference☆69Updated last week
- Summary of the Specs of Commonly Used GPUs for Training and Inference of LLM☆40Updated last month
- Standalone Flash Attention v2 kernel without libtorch dependency☆108Updated 7 months ago
- ☆67Updated this week
- We invite you to visit and follow our new repository at https://github.com/microsoft/TileFusion. TiledCUDA is a highly efficient kernel …☆181Updated 2 months ago
- A Easy-to-understand TensorOp Matmul Tutorial☆342Updated 7 months ago
- 使用 cutlass 仓库在 ada 架构上实现 fp8 的 flash attention☆63Updated 8 months ago