abcdabcd987 / libfabric-efa-demoLinks
☆57Updated 8 months ago
Alternatives and similar repositories for libfabric-efa-demo
Users that are interested in libfabric-efa-demo are comparing it to the libraries listed below
Sorting:
- NVSHMEM‑Tutorial: Build a DeepEP‑like GPU Buffer☆128Updated this week
- A lightweight design for computation-communication overlap.☆167Updated last week
- ☆46Updated 9 months ago
- DeepXTrace is a lightweight tool for precisely diagnosing slow ranks in DeepEP-based environments.☆51Updated last week
- Microsoft Collective Communication Library☆66Updated 10 months ago
- ☆295Updated this week
- ☆71Updated last year
- A prefill & decode disaggregated LLM serving framework with shared GPU memory and fine-grained compute isolation.☆108Updated 4 months ago
- Stateful LLM Serving☆84Updated 6 months ago
- Automated Parallelization System and Infrastructure for Multiple Ecosystems☆79Updated 10 months ago
- ☆116Updated 8 months ago
- Thunder Research Group's Collective Communication Library☆42Updated 2 months ago
- DeeperGEMM: crazy optimized version☆70Updated 4 months ago
- DLSlime: Flexible & Efficient Heterogeneous Transfer Toolkit☆62Updated this week
- Aims to implement dual-port and multi-qp solutions in deepEP ibrc transport☆62Updated 4 months ago
- ☆85Updated 5 months ago
- High performance Transformer implementation in C++.☆132Updated 8 months ago
- FlexFlow Serve: Low-Latency, High-Performance LLM Serving☆58Updated last week
- kvcached: Elastic KV cache for dynamic GPU sharing and efficient multi-LLM inference.☆91Updated this week
- NVIDIA NVSHMEM is a parallel programming interface for NVIDIA GPUs based on OpenSHMEM. NVSHMEM can significantly reduce multi-process com…☆311Updated last week
- ☆57Updated 3 months ago
- ☆51Updated last week
- ☆82Updated 2 years ago
- Supplemental materials for The ASPLOS 2025 / EuroSys 2025 Contest on Intra-Operator Parallelism for Distributed Deep Learning☆23Updated 4 months ago
- Artifact of OSDI '24 paper, ”Llumnix: Dynamic Scheduling for Large Language Model Serving“☆62Updated last year
- Paella: Low-latency Model Serving with Virtualized GPU Scheduling☆62Updated last year
- NCCL Profiling Kit☆145Updated last year
- nnScaler: Compiling DNN models for Parallel Training☆118Updated 3 weeks ago
- ☆42Updated 4 months ago
- A framework for generating realistic LLM serving workloads☆58Updated 3 months ago