microsoft / arkLinks
A GPU-driven system framework for scalable AI applications
☆121Updated 9 months ago
Alternatives and similar repositories for ark
Users that are interested in ark are comparing it to the libraries listed below
Sorting:
- MSCCL++: A GPU-driven communication stack for scalable AI applications☆437Updated this week
- FlexFlow Serve: Low-Latency, High-Performance LLM Serving☆63Updated 2 months ago
- Aims to implement dual-port and multi-qp solutions in deepEP ibrc transport☆66Updated 6 months ago
- Microsoft Collective Communication Library☆66Updated last year
- ☆24Updated last year
- NVIDIA NVSHMEM is a parallel programming interface for NVIDIA GPUs based on OpenSHMEM. NVSHMEM can significantly reduce multi-process com…☆385Updated last week
- A lightweight design for computation-communication overlap.☆187Updated last month
- ☆15Updated last year
- An experimental parallel training platform☆56Updated last year
- Paella: Low-latency Model Serving with Virtualized GPU Scheduling☆65Updated last year
- Efficient Compute-Communication Overlap for Distributed LLM Inference☆62Updated 3 weeks ago
- ☆47Updated 11 months ago
- A memory profiler for NVIDIA GPUs to explore memory inefficiencies in GPU-accelerated applications.☆26Updated last year
- ☆26Updated 9 months ago
- NCCL Profiling Kit☆147Updated last year
- A prefill & decode disaggregated LLM serving framework with shared GPU memory and fine-grained compute isolation.☆115Updated 6 months ago
- ☆64Updated 5 months ago
- ☆93Updated last year
- NVSHMEM‑Tutorial: Build a DeepEP‑like GPU Buffer☆143Updated 2 months ago
- Thunder Research Group's Collective Communication Library☆42Updated 4 months ago
- ☆83Updated 2 years ago
- Synthesizer for optimal collective communication algorithms☆119Updated last year
- RCCL Performance Benchmark Tests☆79Updated last week
- Open ABI and FFI for Machine Learning Systems☆174Updated last week
- We invite you to visit and follow our new repository at https://github.com/microsoft/TileFusion. TiledCUDA is a highly efficient kernel …☆189Updated 9 months ago
- AI Accelerator Benchmark focuses on evaluating AI Accelerators from a practical production perspective, including the ease of use and ver…☆268Updated 3 months ago
- Automated Parallelization System and Infrastructure for Multiple Ecosystems☆80Updated last year
- rocSHMEM intra-kernel networking runtime for AMD dGPUs on the ROCm platform.☆127Updated this week
- An extension library of WMMA API (Tensor Core API)☆108Updated last year
- High performance Transformer implementation in C++.☆142Updated 10 months ago