Alternatives and similar repositories for pytorch_distributed

Users that are interested in pytorch_distributed are comparing it to the libraries listed below

• Azure-Vision / SuperDebug
  SuperDebug，debug如此简单！
  ☆17Updated 3 years ago
• Oneflow-Inc / vision
  Datasets, Transforms and Models specific to Computer Vision
  ☆89Updated last year
• yester31 / Cutlass_EX
  study of cutlass
  ☆22Updated 10 months ago
• DeepLink-org / CVFusion
  CVFusion is an open-source deep learning compiler to fuse the OpenCV operators.
  ☆31Updated 3 years ago
• lvyufeng / easy_mindspore_bk
  ☆18Updated 3 years ago
• TencentARC / BEBR
  Official code for "Binary embedding based retrieval at Tencent"
  ☆43Updated last year
• L1aoXingyu / llm-infer-bench
  ☆12Updated 2 years ago
• li199603 / sgemm_with_cuda
  SGEMM optimization with cuda step by step
  ☆20Updated last year
• xlite-dev / HGEMM
  ⚡️Write HGEMM from scratch using Tensor Cores with WMMA, MMA and CuTe API, Achieve Peak⚡️ Performance.
  ☆118Updated 4 months ago
• HFAiLab / ffrecord
  FireFlyer Record file format, writer and reader for DL training samples.
  ☆234Updated 2 years ago
• ModelTC / awesome-lm-system
  Summary of system papers/frameworks/codes/tools on training or serving large model
  ☆57Updated last year
• HFAiLab / hfai-models
  HFAI deep learning models
  ☆152Updated 2 years ago
• TiledTensor / TiledBench
  Benchmark tests supporting the TiledCUDA library.
  ☆17Updated 10 months ago
• attention-survey / Efficient_Attention_Survey
  A Survey of Efficient Attention Methods: Hardware-efficient, Sparse, Compact, and Linear Attention
  ☆186Updated last month
• Syencil / Programming_Massively_Parallel_Processors
  CUDA 6大并行计算模式 代码与笔记
  ☆60Updated 5 years ago
• HolyChen / cuda-tutorial
  CUDA 编程指南学习
  ☆31Updated 7 years ago
• ifromeast / AI_analysis
  analyse problems of AI with Math and Code
  ☆25Updated 2 months ago
• sii-research / siiRL
  siiRL: Shanghai Innovation Institute RL Framework for Advanced LLMs and Multi-Agent Systems
  ☆217Updated this week
• suquark / llm4phd
  Examples and instructions about use LLMs (especially ChatGPT) for PhD
  ☆107Updated 2 years ago
• JerryYin777 / Cross-Layer-Attention
  Self Reproduction Code of Paper "Reducing Transformer Key-Value Cache Size with Cross-Layer Attention (MIT CSAIL)
  ☆18Updated last year
• simveit / persistent_dense_gemm
  Persistent dense gemm for Hopper in `CuTeDSL`
  ☆15Updated last month
• caibucai22 / awesome-cuda
  Awesome code, projects, books, etc. related to CUDA
  ☆24Updated last month
• HFAiLab / BEVFormer
  ☆19Updated 3 years ago
• Hsword / Hetu
  A high-performance distributed deep learning system targeting large-scale and automated distributed training. If you have any interests, …
  ☆121Updated last year
• feifeibear / ChituAttention
  Quantized Attention on GPU
  ☆44Updated 10 months ago
• DeepVAC / TorchPod
  跨平台的容器化Linux桌面环境
  ☆73Updated 7 months ago
• Oneflow-Inc / serving
  OneFlow Serving
  ☆20Updated 5 months ago
• sgl-project / DeepGEMM
  DeepGEMM: clean and efficient FP8 GEMM kernels with fine-grained scaling
  ☆18Updated last month
• Crisescode / distributed-training-dl
  各种深度学习（DL）框架分布式训练，包括：Tensorflow、Tensorflow2、Pytorch、Chainer、Caffe、Mxnet ...
  ☆21Updated 5 years ago
• li-plus / flash-preference
  Accelerate LLM preference tuning via prefix sharing with a single line of code
  ☆43Updated 2 months ago