BaguaSys / bagua-net
High performance NCCL plugin for Bagua.
☆15Updated 3 years ago
Alternatives and similar repositories for bagua-net:
Users that are interested in bagua-net are comparing it to the libraries listed below
- BytePS examples (Vision, NLP, GAN, etc)☆19Updated 2 years ago
- Machine Learning System☆14Updated 4 years ago
- PET: Optimizing Tensor Programs with Partially Equivalent Transformations and Automated Corrections☆117Updated 2 years ago
- ☆75Updated 2 years ago
- ☆72Updated 3 years ago
- ☆36Updated 2 months ago
- ☆16Updated 2 years ago
- ☆20Updated this week
- ☆32Updated last year
- ☆8Updated last year
- ☆44Updated last year
- Tacker: Tensor-CUDA Core Kernel Fusion for Improving the GPU Utilization while Ensuring QoS☆19Updated last week
- Supplemental materials for The ASPLOS 2025 / EuroSys 2025 Contest on Intra-Operator Parallelism for Distributed Deep Learning☆23Updated 2 months ago
- An extention of TVMScript to write simple and high performance GPU kernels with tensorcore.☆51Updated 6 months ago
- Official resporitory for "IPDPS' 24 QSync: Quantization-Minimized Synchronous Distributed Training Across Hybrid Devices".☆19Updated 11 months ago
- nnScaler: Compiling DNN models for Parallel Training☆93Updated last week
- Thunder Research Group's Collective Communication Library☆33Updated 9 months ago
- FlexFlow Serve: Low-Latency, High-Performance LLM Serving☆17Updated this week
- Paella: Low-latency Model Serving with Virtualized GPU Scheduling☆58Updated 9 months ago
- FTPipe and related pipeline model parallelism research.☆41Updated last year
- (NeurIPS 2022) Automatically finding good model-parallel strategies, especially for complex models and clusters.☆37Updated 2 years ago
- Distributed ML Training Benchmarks☆27Updated last year
- ThrillerFlow is a Dataflow Analysis and Codegen Framework written in Rust.☆14Updated 2 months ago
- A standalone GEMM kernel for fp16 activation and quantized weight, extracted from FasterTransformer☆88Updated 11 months ago
- An Efficient Pipelined Data Parallel Approach for Training Large Model☆73Updated 4 years ago
- An external memory allocator example for PyTorch.☆14Updated 3 years ago
- ASPLOS'24: Optimal Kernel Orchestration for Tensor Programs with Korch☆31Updated 6 months ago
- SOTA Learning-augmented Systems☆34Updated 2 years ago
- gossip: Efficient Communication Primitives for Multi-GPU Systems☆58Updated 2 years ago
- Microsoft Collective Communication Library☆62Updated 2 months ago