DeepLink-org / DLSlimeLinks
DLSlime RDMA Transfer Engine
☆48Updated this week
Alternatives and similar repositories for DLSlime
Users that are interested in DLSlime are comparing it to the libraries listed below
Sorting:
- gLLM: Global Balanced Pipeline Parallelism System for Distributed LLM Serving with Token Throttling☆39Updated this week
- NVSHMEM‑Tutorial: Build a DeepEP‑like GPU Buffer☆60Updated this week
- ☆84Updated 5 months ago
- A lightweight design for computation-communication overlap.☆165Updated this week
- TiledLower is a Dataflow Analysis and Codegen Framework written in Rust.☆14Updated 9 months ago
- Tile-based language built for AI computation across all scales☆51Updated this week
- ☆57Updated 3 months ago
- Supplemental materials for The ASPLOS 2025 / EuroSys 2025 Contest on Intra-Operator Parallelism for Distributed Deep Learning☆22Updated 4 months ago
- Aims to implement dual-port and multi-qp solutions in deepEP ibrc transport☆61Updated 4 months ago
- Artifact of OSDI '24 paper, ”Llumnix: Dynamic Scheduling for Large Language Model Serving“☆62Updated last year
- Canvas: End-to-End Kernel Architecture Search in Neural Networks☆27Updated 9 months ago
- Triton adapter for Ascend. Mirror of https://gitee.com/ascend/triton-ascend☆70Updated this week
- DeeperGEMM: crazy optimized version☆70Updated 4 months ago
- kvcached: Elastic KV cache for dynamic GPU sharing and efficient multi-LLM inference.☆86Updated this week
- A prefill & decode disaggregated LLM serving framework with shared GPU memory and fine-grained compute isolation.☆108Updated 3 months ago
- ☆39Updated last year
- High performance Transformer implementation in C++.☆132Updated 7 months ago
- ☆28Updated 5 months ago
- Stateful LLM Serving☆83Updated 6 months ago
- Debug print operator for cudagraph debugging☆13Updated last year
- ☆63Updated 4 months ago
- ☆69Updated last year
- Official repository for the paper DynaPipe: Optimizing Multi-task Training through Dynamic Pipelines☆20Updated last year
- MAGIS: Memory Optimization via Coordinated Graph Transformation and Scheduling for DNN (ASPLOS'24)☆54Updated last year
- ☆19Updated 11 months ago
- ASPLOS'24: Optimal Kernel Orchestration for Tensor Programs with Korch☆38Updated 5 months ago
- Automated Parallelization System and Infrastructure for Multiple Ecosystems☆79Updated 9 months ago
- A GPU-optimized system for efficient long-context LLMs decoding with low-bit KV cache.☆58Updated last week
- SpInfer: Leveraging Low-Level Sparsity for Efficient Large Language Model Inference on GPUs☆57Updated 5 months ago
- ☆23Updated last week