Alternatives and similar repositories for mlbench-benchmarks:

Users that are interested in mlbench-benchmarks are comparing it to the libraries listed below

• Distributed-AI / PipeTransformer
  PipeTransformer: Automated Elastic Pipelining for Distributed Training of Large-scale Models. ICML 2021
  ☆56Updated 3 years ago
• HKBU-HPML / ddl-benchmarks
  ddl-benchmarks: Benchmarks for Distributed Deep Learning
  ☆37Updated 4 years ago
• ceruleangu / Block-Sparse-Benchmark
  Benchmark for matrix multiplications between dense and block sparse (BSR) matrix in TVM, blocksparse (Gray et al.) and cuSparse.
  ☆24Updated 4 years ago
• AlibabaPAI / DAPPLE
  An Efficient Pipelined Data Parallel Approach for Training Large Model
  ☆74Updated 4 years ago
• sjtu-epcc / DVABatch
  ☆19Updated 2 years ago
• xldrx / tictac
  ☆22Updated 5 years ago
• netx-repo / training-bottleneck
  Analyze network performance in distributed training
  ☆18Updated 4 years ago
• hwang595 / PyTorch-parameter-server
  Implementation of Parameter Server using PyTorch communication lib
  ☆43Updated 5 years ago
• netx-repo / PipeSwitch
  PipeSwitch: Fast Pipelined Context Switching for Deep Learning Applications
  ☆127Updated 2 years ago
• uwsampl / nexus
  ☆83Updated 2 years ago
• SJTU-IPADS / disb
  DISB is a new DNN inference serving benchmark with diverse workloads and models, as well as real-world traces.
  ☆53Updated 7 months ago
• awslabs / lorien
  ☆44Updated last year
• zhuzilin / pytorch-malloc
  An external memory allocator example for PyTorch.
  ☆14Updated 3 years ago
• stanford-mast / INFaaS
  Model-less Inference Serving
  ☆85Updated last year
• bytedance / QSync
  Official resporitory for "IPDPS' 24 QSync: Quantization-Minimized Synchronous Distributed Training Across Hybrid Devices".
  ☆19Updated last year
• anandj91 / p3
  ☆21Updated 2 years ago
• shriramsb / vDNN
  ☆21Updated 6 years ago
• pengyanghua / optimus
  A Deep Learning Cluster Scheduler
  ☆37Updated 4 years ago
• Youhe-Jiang / IJCAI2023-OptimalShardedDataParallel
  [IJCAI2023] An automated parallel training system that combines the advantages from both data and model parallelism. If you have any inte…
  ☆51Updated last year
• lzhangbv / dear_pytorch
  [ICDCS 2023] DeAR: Accelerating Distributed Deep Learning with Fine-Grained All-Reduce Pipelining
  ☆12Updated last year
• uwsampl / dtr-prototype
  Dynamic Tensor Rematerialization prototype (modified PyTorch) and simulator. Paper: https://arxiv.org/abs/2006.09616
  ☆133Updated last year
• ParCIS / Chimera
  Chimera: bidirectional pipeline parallelism for efficiently training large-scale models.
  ☆60Updated this week
• sjtu-epcc / Tacker
  Tacker: Tensor-CUDA Core Kernel Fusion for Improving the GPU Utilization while Ensuring QoS
  ☆20Updated last month
• SymbioticLab / Salus
  Fine-grained GPU sharing primitives
  ☆141Updated 5 years ago
• msr-fiddle / harmony
  ☆16Updated 2 years ago
• hku-systems / naspipe
  ☆14Updated 3 years ago
• SymbioticLab / ModelKeeper
  A Cluster-Wide Model Manager to Accelerate DNN Training via Automated Training Warmup
  ☆34Updated 2 years ago
• byteps / examples
  BytePS examples (Vision, NLP, GAN, etc)
  ☆19Updated 2 years ago
• DachengLi1 / AMP
  (NeurIPS 2022) Automatically finding good model-parallel strategies, especially for complex models and clusters.
  ☆38Updated 2 years ago
• microsoft / msccl-tools
  Synthesizer for optimal collective communication algorithms
  ☆106Updated 11 months ago