Alternatives and similar repositories for pytorch_distributed:

Users that are interested in pytorch_distributed are comparing it to the libraries listed below

• L1aoXingyu / llm-infer-bench
  ☆11Updated last year
• TiledTensor / TiledBench
  Benchmark tests supporting the TiledCUDA library.
  ☆16Updated 5 months ago
• bojone / softtopk
  differentiable top-k operator
  ☆21Updated 3 months ago
• BBuf / flash-rwkv
  ☆30Updated 11 months ago
• Ascend / AscendSpeed
  ☆78Updated last year
• BBuf / megatron-lm-parallel-group-playground
  ☆16Updated last year
• megvii-research / basedet
  An object detection codebase based on MegEngine.
  ☆28Updated 2 years ago
• CalvinXKY / mfu_calculation
  A simple calculation for LLM MFU.
  ☆36Updated last month
• sgl-project / DeepGEMM
  DeepGEMM: clean and efficient FP8 GEMM kernels with fine-grained scaling
  ☆15Updated this week
• Oneflow-Inc / vision
  Datasets, Transforms and Models specific to Computer Vision
  ☆85Updated last year
• Oneflow-Inc / serving
  OneFlow Serving
  ☆20Updated 2 weeks ago
• yester31 / Cutlass_EX
  study of cutlass
  ☆21Updated 5 months ago
• tile-ai / tvm
  Open deep learning compiler stack for cpu, gpu and specialized accelerators
  ☆18Updated this week
• microsoft / AttentionEngine
  ☆67Updated this week
• Ascend / torchair
  ☆11Updated this week
• Oneflow-Inc / conda-env
  ☆12Updated 2 years ago
• zhuzilin / pytorch-malloc
  An external memory allocator example for PyTorch.
  ☆14Updated 3 years ago
• ModelTC / rank_dataset
  PyTorch Dataset Rank Dataset
  ☆42Updated 4 years ago
• megvii-research / IntLLaMA
  IntLLaMA: A fast and light quantization solution for LLaMA
  ☆18Updated last year
• GeeeekExplorer / cupytorch
  A small framework mimics PyTorch using CuPy or NumPy
  ☆27Updated 3 years ago
• Aleph-Alpha / NeurIPS-WANT-submission-efficient-parallelization-layouts
  ☆22Updated last year
• HFAiLab / BEVFormer
  ☆19Updated 2 years ago
• sgl-project / tensorrt-demo
  TensorRT LLM Benchmark Configuration
  ☆13Updated 9 months ago
• Harry-Chen / InfMoE
  Inference framework for MoE layers based on TensorRT with Python binding
  ☆41Updated 3 years ago
• feifeibear / Odysseus-Transformer
  Odysseus: Playground of LLM Sequence Parallelism
  ☆68Updated 10 months ago
• LeiWang1999 / AutoGPTQ.tvm
  GPTQ inference TVM kernel
  ☆38Updated last year
• li199603 / sgemm_with_cuda
  SGEMM optimization with cuda step by step
  ☆18Updated last year
• ironartisan / awesome-compression1
  模型压缩的小白入门教程
  ☆22Updated 9 months ago
• zms1999 / SmartMoE
  A MoE impl for PyTorch, [ATC'23] SmartMoE
  ☆62Updated last year
• Oneflow-Inc / OneFlow-Pruning
  [CVPR-2023] Towards Any Structural Pruning
  ☆16Updated 2 years ago