Alternatives and similar repositories for pytorch-communication-benchmarks:

Users that are interested in pytorch-communication-benchmarks are comparing it to the libraries listed below

• pytorch-labs / tritonbench
  Tritonbench is a collection of PyTorch custom operators with example inputs to measure their performance.
  ☆116Updated this week
• MDK8888 / vllmini
  A minimal implementation of vllm.
  ☆39Updated 9 months ago
• cchan / tccl
  extensible collectives library in triton
  ☆85Updated 3 weeks ago
• mayank31398 / cute-kernels
  A bunch of kernels that might make stuff slower 😉
  ☆34Updated this week
• tspeterkim / paged-attention-minimal
  a minimal cache manager for PagedAttention, on top of llama3.
  ☆83Updated 8 months ago
• wangsiping97 / FastGEMV
  High-speed GEMV kernels, at most 2.7x speedup compared to pytorch baseline.
  ☆106Updated 9 months ago
• ROCm / aotriton
  Ahead of Time (AOT) Triton Math Library
  ☆57Updated last week
• deepspeedai / DeepSpeed-Kernels
  ☆68Updated last month
• triton-lang / kernels
  ☆78Updated 5 months ago
• alibaba / easydist
  Automated Parallelization System and Infrastructure for Multiple Ecosystems
  ☆78Updated 5 months ago
• microsoft / sarathi-serve
  A low-latency & high-throughput serving engine for LLMs
  ☆346Updated last week
• gpu-mode / discord-cluster-manager
  Write a fast kernel and run it on Discord. See how you compare against the best!
  ☆41Updated this week
• HabanaAI / Megatron-DeepSpeed
  Intel Gaudi's Megatron DeepSpeed Large Language Models for training
  ☆13Updated 4 months ago
• lessw2020 / triton_kernels_for_fun_and_profit
  Custom kernels in Triton language for accelerating LLMs
  ☆18Updated last year
• ROCm / TransformerEngine
  ☆29Updated this week
• InternLM / turbomind
  ☆82Updated last month
• pytorch-labs / applied-ai
  Applied AI experiments and examples for PyTorch
  ☆262Updated last month
• zinccat / Awesome-Triton-Kernels
  Collection of kernels written in Triton language
  ☆120Updated 3 weeks ago
• microsoft / TileFusion
  TileFusion is an experimental C++ macro kernel template library that elevates the abstraction level in CUDA C for tile processing.
  ☆82Updated last week
• tgale96 / grouped_gemm
  PyTorch bindings for CUTLASS grouped GEMM.
  ☆81Updated 5 months ago
• xlite-dev / hgemm-tensorcores-mma
  ⚡️Write HGEMM from scratch using Tensor Cores with WMMA, MMA and CuTe API, Achieve Peak⚡️ Performance.
  ☆73Updated 3 weeks ago
• ColfaxResearch / cutlass-kernels
  ☆198Updated 9 months ago
• mlcommons / logging
  MLPerf™ logging library
  ☆34Updated last week
• neuralmagic / compressed-tensors
  A safetensors extension to efficiently store sparse quantized tensors on disk
  ☆102Updated this week
• ademeure / DeeperGEMM
  DeeperGEMM: crazy optimized version
  ☆67Updated 3 weeks ago
• stanford-futuredata / stk
  ☆103Updated 8 months ago
• usyd-fsalab / fp6_llm
  An efficient GPU support for LLM inference with x-bit quantization (e.g. FP6,FP5).
  ☆248Updated 5 months ago
• facebookresearch / MODel_opt
  Memory Optimizations for Deep Learning (ICML 2023)
  ☆64Updated last year
• hpcaitech / TensorNVMe
  A Python library transfers PyTorch tensors between CPU and NVMe
  ☆113Updated 5 months ago
• mlc-ai / mlc-python
  ☆31Updated this week