nex-agi / NexVenusCLLinks
Nex Venus Communication Library
☆50Updated this week
Alternatives and similar repositories for NexVenusCL
Users that are interested in NexVenusCL are comparing it to the libraries listed below
Sorting:
- ☆65Updated 6 months ago
- ☆50Updated 6 months ago
- ☆57Updated last week
- A Suite for Parallel Inference of Diffusion Transformers (DiTs) on multi-GPU Clusters☆52Updated last year
- ☆39Updated 3 months ago
- ☆109Updated 6 months ago
- A simple calculation for LLM MFU.☆50Updated 2 months ago
- ☆121Updated 3 months ago
- ☆81Updated 7 months ago
- Efficient Compute-Communication Overlap for Distributed LLM Inference☆62Updated 3 weeks ago
- Quantized Attention on GPU☆44Updated last year
- DeeperGEMM: crazy optimized version☆73Updated 6 months ago
- Estimate MFU for DeepSeekV3☆26Updated 10 months ago
- ☆33Updated last month
- Odysseus: Playground of LLM Sequence Parallelism☆78Updated last year
- ☆12Updated 10 months ago
- Sequence-level 1F1B schedule for LLMs.☆37Updated 2 months ago
- Transformers components but in Triton☆34Updated 6 months ago
- Sequence-level 1F1B schedule for LLMs.☆18Updated last year
- 16-fold memory access reduction with nearly no loss☆107Updated 7 months ago
- An experimental communicating attention kernel based on DeepEP.☆34Updated 3 months ago
- ☆58Updated last year
- Debug print operator for cudagraph debugging☆14Updated last year
- [ICLR 2025] TidalDecode: A Fast and Accurate LLM Decoding with Position Persistent Sparse Attention☆48Updated 3 months ago
- Tile-Based Runtime for Ultra-Low-Latency LLM Inference☆178Updated this week
- Utility scripts for PyTorch (e.g. Make Perfetto show some disappearing kernels, Memory profiler that understands more low-level allocatio…☆67Updated 2 months ago
- DLSlime: Flexible & Efficient Heterogeneous Transfer Toolkit☆82Updated this week
- Framework to reduce autotune overhead to zero for well known deployments.☆85Updated 2 months ago
- ☆97Updated 7 months ago
- [ICLR2025] Breaking Throughput-Latency Trade-off for Long Sequences with Speculative Decoding☆131Updated 11 months ago