HFAiLab / pytorch_distributed

Related projects ⓘ

Alternatives and complementary repositories for pytorch_distributed

• HFAiLab / ffrecord
  FireFlyer Record file format, writer and reader for DL training samples.
  ☆116Updated last year
• HFAiLab / hfai-models
  HFAI deep learning models
  ☆87Updated last year
• L1aoXingyu / llm-infer-bench
  ☆11Updated last year
• yester31 / Cutlass_EX
  study of cutlass
  ☆19Updated this week
• DeepLink-org / CVFusion
  CVFusion is an open-source deep learning compiler to fuse the OpenCV operators.
  ☆26Updated 2 years ago
• Oneflow-Inc / vision
  Datasets, Transforms and Models specific to Computer Vision
  ☆82Updated 11 months ago
• HolyChen / cuda-tutorial
  CUDA 编程指南学习
  ☆27Updated 6 years ago
• uwsampl / dtr-prototype
  Dynamic Tensor Rematerialization prototype (modified PyTorch) and simulator. Paper: https://arxiv.org/abs/2006.09616
  ☆129Updated last year
• megvii-research / basedet
  An object detection codebase based on MegEngine.
  ☆28Updated last year
• yuandong-tian / scheduler2
  ☆99Updated 2 years ago
• sharonzhou / ICLR2021-Stats
  ICLR 2021 Stats & Graphs
  ☆31Updated 2 years ago
• megvii-research / IntLLaMA
  IntLLaMA: A fast and light quantization solution for LLaMA
  ☆18Updated last year
• ModelTC / rank_dataset
  PyTorch Dataset Rank Dataset
  ☆40Updated 3 years ago
• Hsword / Hetu
  A high-performance distributed deep learning system targeting large-scale and automated distributed training. If you have any interests, …
  ☆105Updated 10 months ago
• octoml / deformable-attention-kernel
  TVMScript kernel for deformable attention
  ☆24Updated 2 years ago
• hpcaitech / TensorNVMe
  A Python library transfers PyTorch tensors between CPU and NVMe
  ☆96Updated this week
• megvii-research / megvii-tsinghua-dl-course
  Slides with modifications for a course at Tsinghua University.
  ☆57Updated 2 years ago
• Oneflow-Inc / oneflow_convert
  OneFlow->ONNX
  ☆42Updated last year
• lartpang / RunIt
  A simple program scheduler for your code on different devices.
  ☆11Updated 2 months ago
• HKUNLP / efficient-attention
  [EVA ICLR'23; LARA ICML'22] Efficient attention mechanisms via control variates, random features, and importance sampling
  ☆79Updated last year
• ModelTC / QLLM
  [ICLR 2024] This is the official PyTorch implementation of "QLLM: Accurate and Efficient Low-Bitwidth Quantization for Large Language Mod…
  ☆35Updated 8 months ago
• feifeibear / Odysseus-Transformer
  Odysseus: Playground of LLM Sequence Parallelism
  ☆55Updated 4 months ago
• li199603 / sgemm_with_cuda
  ☆15Updated 7 months ago
• NUS-HPC-AI-Lab / oh-my-server
  ☆30Updated last year
• hpcaitech / ColossalAI-Benchmark
  Performance benchmarking with ColossalAI
  ☆39Updated 2 years ago
• ModelTC / awesome-lm-system
  Summary of system papers/frameworks/codes/tools on training or serving large model
  ☆56Updated 10 months ago
• facebookresearch / fairring
  Fairring (FAIR + Herring) is a plug-in for PyTorch that provides a process group for distributed training that outperforms NCCL at large …
  ☆63Updated 2 years ago
• zms1999 / SmartMoE
  A MoE impl for PyTorch, [ATC'23] SmartMoE
  ☆57Updated last year