BaguaSys / bagua

Related projects ⓘ

Alternatives and complementary repositories for bagua

• PersiaML / PERSIA
  High performance distributed framework for training deep learning recommendation models based on PyTorch.
  ☆396Updated this week
• bytedance / effective_transformer
  Running BERT without Padding
  ☆460Updated 2 years ago
• pytorch / kineto
  A CPU+GPU Profiling library that provides access to timeline traces and hardware performance counters.
  ☆727Updated this week
• pytorch / torchdynamo
  A Python-level JIT compiler designed to make unmodified PyTorch programs faster.
  ☆1,010Updated 6 months ago
• alibaba / EasyParallelLibrary
  Easy Parallel Library (EPL) is a general and efficient deep learning framework for distributed model training.
  ☆264Updated last year
• kaiyuyue / torchshard
  Slicing a PyTorch Tensor Into Parallel Shards
  ☆296Updated 3 years ago
• volcengine / veGiantModel
  ☆208Updated last year
• NVIDIA-Merlin / HugeCTR
  HugeCTR is a high efficiency GPU framework designed for Click-Through-Rate (CTR) estimating training
  ☆948Updated last month
• Tencent / PatrickStar
  PatrickStar enables Larger, Faster, Greener Pretrained Models for NLP and democratizes AI for everyone.
  ☆747Updated last year
• microsoft / nnfusion
  A flexible and efficient deep neural network (DNN) compiler that generates high-performance executable from a DNN model description.
  ☆959Updated last month
• Oneflow-Inc / DLPerf
  DeepLearning Framework Performance Profiling Toolkit
  ☆278Updated 2 years ago
• d2l-ai / d2l-tvm
  Dive into Deep Learning Compiler
  ☆641Updated 2 years ago
• microsoft / Tutel
  Tutel MoE: An Optimized Mixture-of-Experts Implementation
  ☆728Updated last week
• Tencent / TurboTransformers
  a fast and user-friendly runtime for transformer inference (Bert, Albert, GPT2, Decoders, etc) on CPU and GPU.
  ☆1,483Updated last year
• petuum / adaptdl
  Resource-adaptive cluster scheduler for deep learning training.
  ☆425Updated last year
• alibaba / BladeDISC
  BladeDISC is an end-to-end DynamIc Shape Compiler project for machine learning workloads.
  ☆815Updated 2 months ago
• kakaobrain / torchgpipe
  A GPipe implementation in PyTorch
  ☆814Updated 3 months ago
• dmlc / dlpack
  common in-memory tensor structure
  ☆905Updated last month
• msr-fiddle / pipedream
  ☆376Updated 2 years ago
• NVIDIA / PyProf
  A GPU performance profiling tool for PyTorch models
  ☆493Updated 3 years ago
• DeepRec-AI / HybridBackend
  A high-performance framework for training wide-and-deep recommender systems on heterogeneous cluster
  ☆156Updated 6 months ago
• pytorch / PiPPy
  Pipeline Parallelism for PyTorch
  ☆725Updated 2 months ago
• pytorch / FBGEMM
  FB (Facebook) + GEMM (General Matrix-Matrix Multiplication) - https://code.fb.com/ml-applications/fbgemm/
  ☆1,202Updated this week
• pytorch / tensorpipe
  A tensor-aware point-to-point communication primitive for machine learning
  ☆247Updated last year
• lsds / KungFu
  Fast and Adaptive Distributed Machine Learning for TensorFlow, PyTorch and MindSpore.
  ☆293Updated 8 months ago
• Oneflow-Inc / libai
  LiBai(李白): A Toolbox for Large-Scale Distributed Parallel Training
  ☆391Updated this week
• laekov / fastmoe
  A fast MoE impl for PyTorch
  ☆1,558Updated 4 months ago
• pytorch / elastic
  PyTorch elastic training
  ☆730Updated 2 years ago
• jiazhihao / TASO
  The Tensor Algebra SuperOptimizer for Deep Learning
  ☆691Updated last year
• pytorch / torcharrow
  High performance model preprocessing library on PyTorch
  ☆648Updated 7 months ago