AlibabaPAI / FlashModelsLinks
Fast and easy distributed model training examples.
☆12Updated last year
Alternatives and similar repositories for FlashModels
Users that are interested in FlashModels are comparing it to the libraries listed below
Sorting:
- PyTorch distributed training acceleration framework☆54Updated 4 months ago
- ☆163Updated 7 months ago
- ☆152Updated 11 months ago
- ☆151Updated 11 months ago
- Dynamic Memory Management for Serving LLMs without PagedAttention☆448Updated 6 months ago
- A Easy-to-understand TensorOp Matmul Tutorial☆397Updated 2 months ago
- A baseline repository of Auto-Parallelism in Training Neural Networks☆147Updated 3 years ago
- TePDist (TEnsor Program DISTributed) is an HLO-level automatic distributed system for DL models.☆98Updated 2 years ago
- LLM training technologies developed by kwai☆67Updated 3 weeks ago
- Zero Bubble Pipeline Parallelism☆442Updated 7 months ago
- Examples of CUDA implementations by Cutlass CuTe☆260Updated 5 months ago
- ☆155Updated last month
- HierarchicalKV is a part of NVIDIA Merlin and provides hierarchical key-value storage to meet RecSys requirements. The key capability of…☆183Updated last month
- Yinghan's Code Sample☆360Updated 3 years ago
- ☆253Updated last year
- optimized BERT transformer inference on NVIDIA GPU. https://arxiv.org/abs/2210.03052☆476Updated last year
- Shared Middle-Layer for Triton Compilation☆318Updated 2 weeks ago
- Allow torch tensor memory to be released and resumed later☆187Updated 2 weeks ago
- Development repository for the Triton-Linalg conversion☆206Updated 10 months ago
- ☆103Updated last year
- Several optimization methods of half-precision general matrix multiplication (HGEMM) using tensor core with WMMA API and MMA PTX instruct…☆507Updated last year
- MSCCL++: A GPU-driven communication stack for scalable AI applications☆444Updated this week
- Perplexity GPU Kernels☆539Updated last month
- ☆112Updated 7 months ago
- GLake: optimizing GPU memory management and IO transmission.☆491Updated 8 months ago
- ☆141Updated last year
- PyTorch bindings for CUTLASS grouped GEMM.☆174Updated this week
- Experimental projects related to TensorRT☆117Updated this week
- A simple high performance CUDA GEMM implementation.☆421Updated last year
- ☆76Updated last year