Alternatives and similar repositories for nomad-dist:

Users that are interested in nomad-dist are comparing it to the libraries listed below

• DD-DuDa / BitDecoding
  A GPU-optimized system for efficient long-context LLMs decoding with low-bit KV cache.
  ☆25Updated last week
• hao-ai-lab / MuxServe
  ☆55Updated 9 months ago
• microsoft / TileFusion
  TileFusion is an experimental C++ macro kernel template library that elevates the abstraction level in CUDA C for tile processing.
  ☆74Updated this week
• flexflow / flexflow-serve
  FlexFlow Serve: Low-Latency, High-Performance LLM Serving
  ☆34Updated this week
• LeiWang1999 / Stream-k.tvm
  ☆19Updated 6 months ago
• abhibambhaniya / GenZ-LLM-Analyzer
  LLM Inference analyzer for different hardware platforms
  ☆55Updated last week
• sjtu-epcc / Tacker
  Tacker: Tensor-CUDA Core Kernel Fusion for Improving the GPU Utilization while Ensuring QoS
  ☆23Updated last month
• DerrickYLJ / TidalDecode
  [ICLR 2025] TidalDecode: A Fast and Accurate LLM Decoding with Position Persistent Sparse Attention
  ☆31Updated this week
• apuaaChen / EVT_AE
  Artifacts of EVT ASPLOS'24
  ☆23Updated last year
• ParCIS / Magicube
  Magicube is a high-performance library for quantized sparse matrix operations (SpMM and SDDMM) of deep learning on Tensor Cores.
  ☆85Updated 2 years ago
• xxyux / SpInfer
  SpInfer: Leveraging Low-Level Sparsity for Efficient Large Language Model Inference on GPUs
  ☆32Updated last week
• alibaba / easydist
  Automated Parallelization System and Infrastructure for Multiple Ecosystems
  ☆78Updated 4 months ago
• hgyhungry / alcop-artifact
  ☆22Updated 2 years ago
• pku-liang / MAGIS
  MAGIS: Memory Optimization via Coordinated Graph Transformation and Scheduling for DNN (ASPLOS'24)
  ☆49Updated 10 months ago
• TiledTensor / TiledLower
  ThrillerFlow is a Dataflow Analysis and Codegen Framework written in Rust.
  ☆14Updated 4 months ago
• nox-410 / tvm.tl
  An extention of TVMScript to write simple and high performance GPU kernels with tensorcore.
  ☆51Updated 8 months ago
• mlc-ai / mlc-python
  ☆26Updated 2 weeks ago
• hgyhungry / ShflBW_Sparse_NN
  ☆15Updated 2 years ago
• uwsampl / SparseTIR
  SparseTIR: Sparse Tensor Compiler for Deep Learning
  ☆134Updated 2 years ago
• tlc-pack / cutlass_fpA_intB_gemm
  A standalone GEMM kernel for fp16 activation and quantized weight, extracted from FasterTransformer
  ☆91Updated this week
• VITA-Group / Q-Hitter
  ☆12Updated 10 months ago
• Azure / msccl
  Microsoft Collective Communication Library
  ☆64Updated 4 months ago
• humuyan / Korch
  ASPLOS'24: Optimal Kernel Orchestration for Tensor Programs with Korch
  ☆33Updated last week
• UDC-GAC / venom
  A Vectorized N:M Format for Unleashing the Power of Sparse Tensor Cores
  ☆50Updated last year
• microsoft / SparTA
  ☆136Updated 8 months ago
• google / iopddl
  Supplemental materials for The ASPLOS 2025 / EuroSys 2025 Contest on Intra-Operator Parallelism for Distributed Deep Learning
  ☆23Updated 3 months ago
• lenLRX / AmpereSparseMatmul
  study of Ampere' Sparse Matmul
  ☆17Updated 4 years ago
• awslabs / optimizing-multitask-training-through-dynamic-pipelines
  Official repository for the paper DynaPipe: Optimizing Multi-task Training through Dynamic Pipelines
  ☆17Updated last year
• wangsiping97 / FastGEMV
  High-speed GEMV kernels, at most 2.7x speedup compared to pytorch baseline.
  ☆103Updated 8 months ago
• DachengLi1 / AMP
  (NeurIPS 2022) Automatically finding good model-parallel strategies, especially for complex models and clusters.
  ☆38Updated 2 years ago