Alternatives and similar repositories for torchcomms

Users that are interested in torchcomms are comparing it to the libraries listed below

• cchan / tccl
  extensible collectives library in triton
  ☆89Updated 6 months ago
• meta-pytorch / tritonbench
  Tritonbench is a collection of PyTorch custom operators with example inputs to measure their performance.
  ☆264Updated this week
• triton-lang / kernels
  ☆92Updated 11 months ago
• NVIDIA / nvshmem
  NVIDIA NVSHMEM is a parallel programming interface for NVIDIA GPUs based on OpenSHMEM. NVSHMEM can significantly reduce multi-process com…
  ☆351Updated last week
• meta-pytorch / BackendBench
  How to ensure correctness and ship LLM generated kernels in PyTorch
  ☆66Updated last week
• meta-pytorch / tritonparse
  TritonParse: A Compiler Tracer, Visualizer, and Reproducer for Triton Kernels
  ☆160Updated last week
• meta-pytorch / applied-ai
  Applied AI experiments and examples for PyTorch
  ☆299Updated 2 months ago
• tgale96 / grouped_gemm
  PyTorch bindings for CUTLASS grouped GEMM.
  ☆125Updated 4 months ago
• yifuwang / symm-mem-recipes
  ☆141Updated 9 months ago
• vllm-project / tpu-inference
  TPU inference for vLLM, with unified JAX and PyTorch support.
  ☆97Updated last week
• meta-pytorch / kraken
  Triton-based Symmetric Memory operators and examples
  ☆48Updated last week
• zinccat / Awesome-Triton-Kernels
  Collection of kernels written in Triton language
  ☆157Updated 6 months ago
• IBM / triton-dejavu
  Framework to reduce autotune overhead to zero for well known deployments.
  ☆84Updated last month
• ademeure / DeeperGEMM
  DeeperGEMM: crazy optimized version
  ☆72Updated 5 months ago
• gpu-mode / triton-index
  Cataloging released Triton kernels.
  ☆263Updated last month
• Deep-Learning-Profiling-Tools / triton-viz
  ☆240Updated last week
• perplexityai / pplx-kernels
  Perplexity GPU Kernels
  ☆497Updated last month
• infinigence / FlashOverlap
  A lightweight design for computation-communication overlap.
  ☆181Updated 2 weeks ago
• IST-DASLab / qutlass
  QuTLASS: CUTLASS-Powered Quantized BLAS for Deep Learning
  ☆119Updated 3 weeks ago
• mobiusml / gemlite
  Fast low-bit matmul kernels in Triton
  ☆381Updated 3 weeks ago
• NVIDIA / jaxpp
  JaxPP is a library for JAX that enables flexible MPMD pipeline parallelism for large-scale LLM training
  ☆55Updated last week
• microsoft / AttentionEngine
  ☆101Updated 5 months ago
• sgl-project / sglang-jax
  JAX backend for SGL
  ☆78Updated this week
• gpu-mode / ring-attention
  ring-attention experiments
  ☆154Updated last year
• flashinfer-ai / cutlass-viz
  ☆65Updated 5 months ago
• Dao-AILab / quack
  A Quirky Assortment of CuTe Kernels
  ☆637Updated 2 weeks ago
• fzyzcjy / torch_memory_saver
  Allow torch tensor memory to be released and resumed later
  ☆150Updated last week
• facebookexperimental / triton
  Github mirror of trition-lang/triton repo.
  ☆86Updated this week
• KuangjuX / NVSHMEM-Tutorial
  NVSHMEM‑Tutorial: Build a DeepEP‑like GPU Buffer
  ☆138Updated last month
• microsoft / tokenweave
  Efficient Compute-Communication Overlap for Distributed LLM Inference
  ☆59Updated 3 weeks ago