kaiyuyue / torchshard

Related projects ⓘ

Alternatives and complementary repositories for torchshard

• PhilJd / contiguous_pytorch_params
  Accelerate training by storing parameters in one contiguous chunk of memory.
  ☆291Updated 4 years ago
• NVIDIA / PyProf
  A GPU performance profiling tool for PyTorch models
  ☆495Updated 3 years ago
• ppwwyyxx / RAM-multiprocess-dataloader
  Demystify RAM Usage in Multi-Process Data Loaders
  ☆180Updated last year
• lucidrains / triton-transformer
  Implementation of a Transformer, but completely in Triton
  ☆249Updated 2 years ago
• cybertronai / pytorch-lamb
  Implementation of https://arxiv.org/abs/1904.00962
  ☆369Updated 3 years ago
• facebookresearch / bitsandbytes
  Library for 8-bit optimizers and quantization routines.
  ☆714Updated 2 years ago
• ucbrise / actnn
  ActNN: Reducing Training Memory Footprint via 2-Bit Activation Compressed Training
  ☆201Updated last year
• kakaobrain / torchlars
  A LARS implementation in PyTorch
  ☆335Updated 4 years ago
• awwong1 / torchprof
  PyTorch layer-by-layer model profiler
  ☆608Updated 3 years ago
• zhijian-liu / torchprofile
  A general and accurate MACs / FLOPs profiler for PyTorch models
  ☆571Updated 6 months ago
• pytorch / nestedtensor
  [Prototype] Tools for the concurrent manipulation of variably sized Tensors.
  ☆253Updated 2 years ago
• bytedance / effective_transformer
  Running BERT without Padding
  ☆460Updated 2 years ago
• seba-1511 / dist_tuto.pth
  Official code for "Writing Distributed Applications with PyTorch", PyTorch Tutorial
  ☆255Updated last year
• NVlabs / tensorcom
  ☆107Updated 3 years ago
• pytorch / ort
  Accelerate PyTorch models with ONNX Runtime
  ☆356Updated 2 months ago
• ptillet / torch-blocksparse
  Block-sparse primitives for PyTorch
  ☆148Updated 3 years ago
• utsaslab / MONeT
  MONeT framework for reducing memory consumption of DNN training
  ☆173Updated 3 years ago
• pytorch / tvm
  TVM integration into PyTorch
  ☆452Updated 4 years ago
• kakaobrain / torchgpipe
  A GPipe implementation in PyTorch
  ☆818Updated 3 months ago
• pytorch / torchdistx
  Torch Distributed Experimental
  ☆116Updated 3 months ago
• huggingface / pytorch_block_sparse
  Fast Block Sparse Matrices for Pytorch
  ☆545Updated 3 years ago
• microsoft / infinibatch
  Efficient, check-pointed data loading for deep learning with massive data sets.
  ☆205Updated last year
• AminRezaei0x443 / memory-efficient-attention
  Memory Efficient Attention (O(sqrt(n)) for Jax and PyTorch
  ☆179Updated last year
• facebookresearch / HolisticTraceAnalysis
  A library to analyze PyTorch traces.
  ☆307Updated this week
• pytorch / tensorpipe
  A tensor-aware point-to-point communication primitive for machine learning
  ☆249Updated last year
• pytorch / multipy
  torch::deploy (multipy for non-torch uses) is a system that lets you get around the GIL problem by running multiple Python interpreters i…
  ☆175Updated last week
• microsoft / Tutel
  Tutel MoE: An Optimized Mixture-of-Experts Implementation
  ☆735Updated this week
• facebookresearch / FBTT-Embedding
  This is a Tensor Train based compression library to compress sparse embedding tables used in large-scale machine learning models such as …
  ☆193Updated 2 years ago
• pytorch / torchx
  TorchX is a universal job launcher for PyTorch applications. TorchX is designed to have fast iteration time for training/research and sup…
  ☆332Updated this week
• pytorch / PiPPy
  Pipeline Parallelism for PyTorch
  ☆726Updated 2 months ago