microsoft / arkLinks
A GPU-driven system framework for scalable AI applications
☆118Updated 7 months ago
Alternatives and similar repositories for ark
Users that are interested in ark are comparing it to the libraries listed below
Sorting:
- ☆25Updated last year
- MSCCL++: A GPU-driven communication stack for scalable AI applications☆417Updated this week
- FlexFlow Serve: Low-Latency, High-Performance LLM Serving☆57Updated this week
- Microsoft Collective Communication Library☆66Updated 9 months ago
- An experimental parallel training platform☆54Updated last year
- Aims to implement dual-port and multi-qp solutions in deepEP ibrc transport☆62Updated 4 months ago
- A memory profiler for NVIDIA GPUs to explore memory inefficiencies in GPU-accelerated applications.☆25Updated 11 months ago
- RCCL Performance Benchmark Tests☆76Updated this week
- A lightweight design for computation-communication overlap.☆167Updated last week
- AI Accelerator Benchmark focuses on evaluating AI Accelerators from a practical production perspective, including the ease of use and ver…☆263Updated last month
- ☆27Updated 7 months ago
- [DEPRECATED] Moved to ROCm/rocm-systems repo☆84Updated this week
- Paella: Low-latency Model Serving with Virtualized GPU Scheduling☆62Updated last year
- PArametrized Recommendation and Ai Model benchmark is a repository for development of numerous uBenchmarks as well as end to end nets for…☆150Updated 2 weeks ago
- ☆88Updated 10 months ago
- Triton adapter for Ascend. Mirror of https://gitee.com/ascend/triton-ascend☆71Updated this week
- An experimental CPU backend for Triton (https//github.com/openai/triton)☆45Updated last month
- Unified Collective Communication Library☆275Updated last week
- ☆74Updated 5 months ago
- A language and compiler for irregular tensor programs.☆149Updated 9 months ago
- We invite you to visit and follow our new repository at https://github.com/microsoft/TileFusion. TiledCUDA is a highly efficient kernel …☆185Updated 7 months ago
- NVIDIA NVSHMEM is a parallel programming interface for NVIDIA GPUs based on OpenSHMEM. NVSHMEM can significantly reduce multi-process com…☆311Updated this week
- oneAPI Collective Communications Library (oneCCL)☆245Updated 2 weeks ago
- ☆150Updated this week
- Thunder Research Group's Collective Communication Library☆42Updated 2 months ago
- A prefill & decode disaggregated LLM serving framework with shared GPU memory and fine-grained compute isolation.☆108Updated 4 months ago
- ☆85Updated 5 months ago
- rocSHMEM intra-kernel networking runtime for AMD dGPUs on the ROCm platform.☆114Updated this week
- A Python library transfers PyTorch tensors between CPU and NVMe☆121Updated 9 months ago
- High performance Transformer implementation in C++.☆132Updated 8 months ago