Alternatives and similar repositories for torchshard:

Users that are interested in torchshard are comparing it to the libraries listed below

• PhilJd / contiguous_pytorch_params
  Accelerate training by storing parameters in one contiguous chunk of memory.
  ☆292Updated 4 years ago
• ppwwyyxx / RAM-multiprocess-dataloader
  Demystify RAM Usage in Multi-Process Data Loaders
  ☆189Updated last year
• lucidrains / triton-transformer
  Implementation of a Transformer, but completely in Triton
  ☆260Updated 2 years ago
• NVIDIA / PyProf
  A GPU performance profiling tool for PyTorch models
  ☆505Updated 3 years ago
• ucbrise / actnn
  ActNN: Reducing Training Memory Footprint via 2-Bit Activation Compressed Training
  ☆201Updated 2 years ago
• ptillet / torch-blocksparse
  Block-sparse primitives for PyTorch
  ☆154Updated 3 years ago
• awwong1 / torchprof
  PyTorch layer-by-layer model profiler
  ☆606Updated 3 years ago
• zhijian-liu / torchprofile
  A general and accurate MACs / FLOPs profiler for PyTorch models
  ☆601Updated 10 months ago
• prigoyal / pytorch_memonger
  Experimental ground for optimizing memory of pytorch models
  ☆366Updated 6 years ago
• pytorch / nestedtensor
  [Prototype] Tools for the concurrent manipulation of variably sized Tensors.
  ☆253Updated 2 years ago
• yaysummeriscoming / DALI_pytorch_demo
  Example code showing how to use Nvidia DALI in pytorch, with fallback to torchvision. Contains a few differences to the official Nvidia …
  ☆197Updated 5 years ago
• pytorch / ort
  Accelerate PyTorch models with ONNX Runtime
  ☆358Updated 3 weeks ago
• facebookresearch / bitsandbytes
  Library for 8-bit optimizers and quantization routines.
  ☆718Updated 2 years ago
• utsaslab / MONeT
  MONeT framework for reducing memory consumption of DNN training
  ☆174Updated 3 years ago
• cybertronai / pytorch-lamb
  Implementation of https://arxiv.org/abs/1904.00962
  ☆372Updated 4 years ago
• pytorch / torchdistx
  Torch Distributed Experimental
  ☆115Updated 7 months ago
• 1adrianb / pytorch-estimate-flops
  Estimate/count FLOPS for a given neural network using pytorch
  ☆303Updated 2 years ago
• kakaobrain / torchlars
  A LARS implementation in PyTorch
  ☆342Updated 5 years ago
• TezRomacH / layer-to-layer-pytorch
  PyTorch implementation of L2L execution algorithm
  ☆107Updated 2 years ago
• chrischoy / pytorch-custom-cuda-tutorial
  Tutorial for building a custom CUDA function for Pytorch
  ☆512Updated 6 years ago
• mit-han-lab / hardware-aware-transformers
  [ACL'20] HAT: Hardware-Aware Transformers for Efficient Natural Language Processing
  ☆331Updated 8 months ago
• NVIDIA / transformer-ls
  Official PyTorch Implementation of Long-Short Transformer (NeurIPS 2021).
  ☆225Updated 2 years ago
• bytedance / effective_transformer
  Running BERT without Padding
  ☆472Updated 3 years ago
• NVlabs / tensorcom
  ☆109Updated 3 years ago
• huggingface / pytorch_block_sparse
  Fast Block Sparse Matrices for Pytorch
  ☆546Updated 4 years ago
• sIncerass / powernorm
  [ICML 2020] code for "PowerNorm: Rethinking Batch Normalization in Transformers" https://arxiv.org/abs/2003.07845
  ☆119Updated 3 years ago
• ray-project / ray_lightning
  Pytorch Lightning Distributed Accelerators using Ray
  ☆211Updated last year
• seba-1511 / dist_tuto.pth
  Official code for "Writing Distributed Applications with PyTorch", PyTorch Tutorial
  ☆260Updated 2 years ago
• pytorch / tvm
  TVM integration into PyTorch
  ☆452Updated 5 years ago
• microsoft / Tutel
  Tutel MoE: An Optimized Mixture-of-Experts Implementation
  ☆784Updated this week