Alternatives and similar repositories for contiguous_pytorch_params:

Users that are interested in contiguous_pytorch_params are comparing it to the libraries listed below

• kaiyuyue / torchshard
  Slicing a PyTorch Tensor Into Parallel Shards
  ☆298Updated 3 years ago
• cybertronai / pytorch-lamb
  Implementation of https://arxiv.org/abs/1904.00962
  ☆373Updated 4 years ago
• alphadl / lookahead.pytorch
  lookahead optimizer (Lookahead Optimizer: k steps forward, 1 step back) for pytorch
  ☆334Updated 5 years ago
• prigoyal / pytorch_memonger
  Experimental ground for optimizing memory of pytorch models
  ☆366Updated 6 years ago
• majumderb / rezero
  Official PyTorch Repo for "ReZero is All You Need: Fast Convergence at Large Depth"
  ☆407Updated 8 months ago
• pabloppp / pytorch-tools
  Useful PyTorch functions and modules that are not implemented in PyTorch by default
  ☆187Updated 11 months ago
• awwong1 / torchprof
  PyTorch layer-by-layer model profiler
  ☆606Updated 3 years ago
• NVIDIA / runx
  Deep Learning Experiment Management
  ☆640Updated 2 years ago
• PistonY / torch-toolbox
  🛠 Toolbox to extend PyTorch functionalities
  ☆418Updated 10 months ago
• yaysummeriscoming / DALI_pytorch_demo
  Example code showing how to use Nvidia DALI in pytorch, with fallback to torchvision. Contains a few differences to the official Nvidia …
  ☆197Updated 5 years ago
• XuezheMax / apollo
  Apollo: An Adaptive Parameter-wise Diagonal Quasi-Newton Method for Nonconvex Stochastic Optimization
  ☆182Updated 3 years ago
• sacmehta / delight
  DeLighT: Very Deep and Light-Weight Transformers
  ☆468Updated 4 years ago
• mgrankin / over9000
  Over9000 optimizer
  ☆427Updated 2 years ago
• Lyken17 / pytorch-memonger
  Sublinear memory optimization for deep learning. https://arxiv.org/abs/1604.06174
  ☆597Updated 5 years ago
• justheuristic / prefetch_generator
  Simple package that makes your generator work in background thread
  ☆279Updated 2 years ago
• ppwwyyxx / RAM-multiprocess-dataloader
  Demystify RAM Usage in Multi-Process Data Loaders
  ☆191Updated last year
• Yonghongwei / Gradient-Centralization
  A New Optimization Technique for Deep Neural Networks
  ☆535Updated 3 years ago
• idstcv / GPU-Efficient-Networks
  ☆191Updated 8 months ago
• richardkxu / distributed-pytorch
  Distributed, mixed-precision training with PyTorch
  ☆89Updated 4 years ago
• lonePatient / lookahead_pytorch
  pytorch implement of Lookahead Optimizer
  ☆189Updated 2 years ago
• yangkky / distributed_tutorial
  ☆261Updated 5 years ago
• csrhddlam / pytorch-checkpoint
  ☆165Updated 6 years ago
• Tony-Y / pytorch_warmup
  Learning Rate Warmup in PyTorch
  ☆404Updated 3 weeks ago
• zhijian-liu / torchprofile
  A general and accurate MACs / FLOPs profiler for PyTorch models
  ☆602Updated 10 months ago
• narumiruna / pytorch-distributed-example
  ☆169Updated 4 years ago
• Alibaba-MIIL / TResNet
  Official Pytorch Implementation of "TResNet: High-Performance GPU-Dedicated Architecture" (WACV 2021)
  ☆473Updated 3 months ago
• lucidrains / hamburger-pytorch
  Pytorch implementation of the hamburger module from the ICLR 2021 paper "Is Attention Better Than Matrix Decomposition"
  ☆98Updated 4 years ago
• lucidrains / halonet-pytorch
  Implementation of the 😇 Attention layer from the paper, Scaling Local Self-Attention For Parameter Efficient Visual Backbones
  ☆198Updated 4 years ago
• signatrix / regnet
  Pytorch implementation of network design paradigm described in the paper "Designing Network Design Spaces"
  ☆185Updated 8 months ago
• ucbrise / actnn
  ActNN: Reducing Training Memory Footprint via 2-Bit Activation Compressed Training
  ☆201Updated 2 years ago