PyTorch distributed training acceleration framework
☆54Aug 13, 2025Updated 6 months ago
Alternatives and similar repositories for torchacc
Users that are interested in torchacc are comparing it to the libraries listed below
Sorting:
- Fast and easy distributed model training examples.☆12Nov 26, 2024Updated last year
- IREE C++ Template☆17Jul 30, 2024Updated last year
- TePDist (TEnsor Program DISTributed) is an HLO-level automatic distributed system for DL models.☆99Apr 22, 2023Updated 2 years ago
- High performance RDMA-based distributed feature collection component for training GNN model on EXTREMELY large graph☆56Jul 3, 2022Updated 3 years ago
- BladeDISC is an end-to-end DynamIc Shape Compiler project for machine learning workloads.☆917Dec 30, 2024Updated last year
- ☆13Jan 7, 2025Updated last year
- ☆12Sep 1, 2023Updated 2 years ago
- Example of applying CUDA graphs to LLaMA-v2☆12Aug 25, 2023Updated 2 years ago
- Shared Middle-Layer for Triton Compilation☆329Dec 5, 2025Updated 3 months ago
- MLIR-based partitioning system☆167Updated this week
- Easy Parallel Library (EPL) is a general and efficient deep learning framework for distributed model training.☆271Mar 31, 2023Updated 2 years ago
- Benchmark tests supporting the TiledCUDA library.☆18Nov 19, 2024Updated last year
- A standalone GEMM kernel for fp16 activation and quantized weight, extracted from FasterTransformer☆96Feb 20, 2026Updated 2 weeks ago
- Debug print operator for cudagraph debugging☆14Aug 2, 2024Updated last year
- An external memory allocator example for PyTorch.☆16Aug 10, 2025Updated 6 months ago
- CUDA Template Functions☆20Dec 16, 2025Updated 2 months ago
- A Triton JIT runtime and ffi provider in C++☆32Updated this week
- Triton kernels for Flux☆22Jul 7, 2025Updated 7 months ago
- ☆27Jan 7, 2025Updated last year
- An extension library of WMMA API (Tensor Core API)☆111Jul 12, 2024Updated last year
- A fast communication-overlapping library for tensor/expert parallelism on GPUs.☆1,264Aug 28, 2025Updated 6 months ago
- MSCCL++: A GPU-driven communication stack for scalable AI applications☆475Updated this week
- Multiple GEMM operators are constructed with cutlass to support LLM inference.☆21Aug 3, 2025Updated 7 months ago
- ☆71Mar 26, 2025Updated 11 months ago
- This is a cross-chip platform collection of operators and a unified neural network library.☆16Nov 3, 2023Updated 2 years ago
- Official resporitory for "IPDPS' 24 QSync: Quantization-Minimized Synchronous Distributed Training Across Hybrid Devices".☆20Feb 23, 2024Updated 2 years ago
- LLM Inference via Triton (Flexible & Modular): Focused on Kernel Optimization using CUBIN binaries, Starting from gpt-oss Model☆75Oct 18, 2025Updated 4 months ago
- A flexible and efficient training framework for large-scale alignment tasks☆451Oct 23, 2025Updated 4 months ago
- CUDA 12.2 HMM demos☆20Jul 26, 2024Updated last year
- A TensorFlow Extension: GPU performance tools for TensorFlow.☆26Jul 27, 2023Updated 2 years ago
- FractalTensor is a programming framework that introduces a novel approach to organizing data in deep neural networks (DNNs) as a list of …☆32Dec 21, 2024Updated last year
- A model compilation solution for various hardware☆464Aug 20, 2025Updated 6 months ago
- Distributed Compiler based on Triton for Parallel Systems☆1,371Feb 13, 2026Updated 3 weeks ago
- DashInfer is a native LLM inference engine aiming to deliver industry-leading performance atop various hardware architectures, including …☆273Aug 6, 2025Updated 7 months ago
- A practical way of learning Swizzle☆37Feb 3, 2025Updated last year
- A GPU performance profiling tool for PyTorch models☆22Jul 5, 2022Updated 3 years ago
- ☆49Mar 5, 2024Updated 2 years ago
- ☆23Apr 25, 2023Updated 2 years ago
- See details in https://github.com/pytorch/xla/blob/r1.12/torch_xla/distributed/fsdp/README.md☆25Dec 22, 2022Updated 3 years ago