PyTorch distributed training acceleration framework
☆56Aug 13, 2025Updated last year
Alternatives and similar repositories for torchacc
Users that are interested in torchacc are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Fast and easy distributed model training examples.☆12Nov 26, 2024Updated last year
- High performance RDMA-based distributed feature collection component for training GNN model on EXTREMELY large graph☆55Jul 3, 2022Updated 4 years ago
- An external memory allocator example for PyTorch.☆16Aug 10, 2025Updated last year
- IREE C++ Template☆17Jul 30, 2024Updated 2 years ago
- TePDist (TEnsor Program DISTributed) is an HLO-level automatic distributed system for DL models.☆96Apr 22, 2023Updated 3 years ago
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- See details in https://github.com/pytorch/xla/blob/r1.12/torch_xla/distributed/fsdp/README.md☆25Dec 22, 2022Updated 3 years ago
- BladeDISC is an end-to-end DynamIc Shape Compiler project for machine learning workloads.☆932Dec 30, 2024Updated last year
- ☆21Dec 15, 2023Updated 2 years ago
- ☆16Apr 10, 2022Updated 4 years ago
- ☆12Sep 1, 2023Updated 3 years ago
- Shared Middle-Layer for Triton Compilation☆348Dec 5, 2025Updated 9 months ago
- Development repository for the Triton-Linalg conversion☆225Feb 7, 2025Updated last year
- A flexible and efficient training framework for large-scale alignment tasks☆451Oct 23, 2025Updated 11 months ago
- CUDA Template Functions☆20Dec 16, 2025Updated 9 months ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- Example of applying CUDA graphs to LLaMA-v2☆11Aug 25, 2023Updated 3 years ago
- A fast communication-overlapping library for tensor/expert parallelism on GPUs.☆1,367Aug 28, 2025Updated last year
- ☆13Jan 7, 2025Updated last year
- A model compilation solution for various hardware☆475Aug 20, 2025Updated last year
- A simple cycle-accurate DaDianNao simulator☆13Mar 27, 2019Updated 7 years ago
- Distributed DataLoader For Pytorch Based On Ray☆25Nov 5, 2021Updated 4 years ago
- An extension library of WMMA API (Tensor Core API)☆115Jul 12, 2024Updated 2 years ago
- An IR for efficiently simulating distributed ML computation.☆33Jan 13, 2024Updated 2 years ago
- A standalone GEMM kernel for fp16 activation and quantized weight, extracted from FasterTransformer☆96Jun 21, 2026Updated 3 months ago
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- Benchmark tests supporting the TiledCUDA library.☆19Nov 19, 2024Updated last year
- MSCCL++: A GPU-driven communication stack for scalable AI applications☆560Updated this week
- This is a cross-chip platform collection of operators and a unified neural network library.☆17Nov 3, 2023Updated 2 years ago
- ☆26Jun 10, 2026Updated 3 months ago
- DashInfer is a native LLM inference engine aiming to deliver industry-leading performance atop various hardware architectures, including …☆273Aug 6, 2025Updated last year
- CUDA 12.2 HMM demos☆21Jul 26, 2024Updated 2 years ago
- CUDA Embedding Lookup Kernel Library☆50Jun 26, 2026Updated 3 months ago
- Debug print operator for cudagraph debugging☆18Aug 2, 2024Updated 2 years ago
- Distributed Compiler and Optimized Parallel Kernels☆1,552Sep 18, 2026Updated last week
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Artifacts of EVT ASPLOS'24☆29Mar 6, 2024Updated 2 years ago
- PyTorch centric eager mode debugger☆46Dec 16, 2024Updated last year
- An experimental communicating attention kernel based on DeepEP.☆34Jul 29, 2025Updated last year
- A GPU performance profiling tool for PyTorch models☆22Jul 5, 2022Updated 4 years ago
- Official resporitory for "IPDPS' 24 QSync: Quantization-Minimized Synchronous Distributed Training Across Hybrid Devices".☆20Feb 23, 2024Updated 2 years ago
- An auxiliary project analysis of the characteristics of KV in DiT Attention.☆34Nov 29, 2024Updated last year
- Efficient and easy multi-instance LLM serving☆561Mar 12, 2026Updated 6 months ago