AlibabaPAI / FlashModelsLinks
Fast and easy distributed model training examples.
☆12Updated last year
Alternatives and similar repositories for FlashModels
Users that are interested in FlashModels are comparing it to the libraries listed below
Sorting:
- PyTorch distributed training acceleration framework☆55Updated 5 months ago
- LLM training technologies developed by kwai☆70Updated 2 weeks ago
- ☆173Updated 8 months ago
- ☆159Updated last year
- TePDist (TEnsor Program DISTributed) is an HLO-level automatic distributed system for DL models.☆99Updated 2 years ago
- Zero Bubble Pipeline Parallelism☆449Updated 9 months ago
- ☆152Updated last year
- ☆259Updated last year
- A Easy-to-understand TensorOp Matmul Tutorial☆405Updated 3 weeks ago
- PyTorch bindings for CUTLASS grouped GEMM.☆184Updated last month
- Pipeline Parallelism Emulation and Visualization☆77Updated 3 weeks ago
- Shared Middle-Layer for Triton Compilation☆325Updated 2 months ago
- ☆105Updated last year
- ☆141Updated last year
- A collection of memory efficient attention operators implemented in the Triton language.☆287Updated last year
- ☆161Updated 2 months ago
- ☆113Updated 8 months ago
- A baseline repository of Auto-Parallelism in Training Neural Networks☆147Updated 3 years ago
- Development repository for the Triton-Linalg conversion☆216Updated 11 months ago
- Allow torch tensor memory to be released and resumed later☆213Updated 3 weeks ago
- GLake: optimizing GPU memory management and IO transmission.☆497Updated 10 months ago
- Examples of CUDA implementations by Cutlass CuTe☆270Updated 7 months ago
- optimized BERT transformer inference on NVIDIA GPU. https://arxiv.org/abs/2210.03052☆476Updated last year
- A model compilation solution for various hardware☆464Updated 5 months ago
- Yinghan's Code Sample☆364Updated 3 years ago
- Dynamic Memory Management for Serving LLMs without PagedAttention☆457Updated 8 months ago
- MSCCL++: A GPU-driven communication stack for scalable AI applications☆457Updated this week
- Perplexity GPU Kernels☆554Updated 3 months ago
- ☆130Updated last year
- ☆342Updated last week