Alternatives and similar repositories for gradient-checkpointing

Users that are interested in gradient-checkpointing are comparing it to the libraries listed below

• facebookresearch / fairscale
  PyTorch extensions for high performance and large scale training.
  ☆3,376Updated 5 months ago
• meta-pytorch / tnt
  A lightweight library for PyTorch training tools and utilities
  ☆1,713Updated this week
• tensorflow / mesh
  Mesh TensorFlow: Model Parallelism Made Easier
  ☆1,615Updated last year
• pytorch / xla
  Enabling PyTorch on XLA Devices (e.g. Google TPU)
  ☆2,688Updated this week
• openai / sparse_attention
  Examples of using sparse attention, as in "Generating Long Sequences with Sparse Transformers"
  ☆1,588Updated 5 years ago
• prigoyal / pytorch_memonger
  Experimental ground for optimizing memory of pytorch models
  ☆367Updated 7 years ago
• williamFalcon / test-tube
  Python library to easily log experiments and parallelize hyperparameter search for neural networks
  ☆736Updated 3 years ago
• openai / blocksparse
  Efficient GPU kernels for block-sparse matrix multiplication and convolution
  ☆1,053Updated 2 years ago
• Stonesjtu / pytorch_memlab
  Profiling and inspecting memory in pytorch
  ☆1,071Updated last month
• Santosh-Gupta / SpeedTorch
  Library for faster pinned CPU <-> GPU transfer in Pytorch
  ☆685Updated 5 years ago
• nitrain / nitrain
  Train AI models efficiently on medical images using any framework
  ☆1,874Updated last year
• bckenstler / CLR
  ☆1,207Updated 5 years ago
• carpedm20 / ENAS-pytorch
  PyTorch implementation of "Efficient Neural Architecture Search via Parameters Sharing"
  ☆2,724Updated 2 years ago
• kakaobrain / torchgpipe
  A GPipe implementation in PyTorch
  ☆855Updated last year
• pytorchbearer / torchbearer
  torchbearer: A model fitting library for PyTorch
  ☆642Updated last year
• facebookresearch / TensorComprehensions
  A domain specific language to express machine learning workloads.
  ☆1,760Updated 2 years ago
• pytorch / ignite
  High-level library to help with training and evaluating neural networks in PyTorch flexibly and transparently.
  ☆4,701Updated last week
• waleedka / hiddenlayer
  Neural network graphs and training metrics for PyTorch, Tensorflow, and Keras.
  ☆1,852Updated last year
• pytorch / benchmark
  TorchBench is a collection of open source benchmarks used to evaluate PyTorch performance.
  ☆989Updated last week
• google-research / morph-net
  Fast & Simple Resource-Constrained Learning of Deep Network Structure
  ☆1,033Updated 3 months ago
• ilkarman / DeepLearningFrameworks
  Demo of running NNs across different frameworks
  ☆1,655Updated 2 years ago
• jettify / pytorch-optimizer
  torch-optimizer -- collection of optimizers for Pytorch
  ☆3,141Updated last year
• pytorch / elastic
  PyTorch elastic training
  ☆730Updated 3 years ago
• NVIDIA / framework-reproducibility
  Providing reproducibility in deep learning frameworks
  ☆428Updated last year
• google / gin-config
  Gin provides a lightweight configuration framework for Python
  ☆2,126Updated last week
• harvardnlp / pytorch-struct
  Fast, general, and tested differentiable structured prediction in PyTorch
  ☆1,115Updated 3 years ago
• LiyuanLucasLiu / RAdam
  On the Variance of the Adaptive Learning Rate and Beyond
  ☆2,550Updated 4 years ago
• IDSIA / sacred
  Sacred is a tool to help you configure, organize, log and reproduce experiments developed at IDSIA.
  ☆4,336Updated 3 weeks ago
• sksq96 / pytorch-summary
  Model summary in PyTorch similar to `model.summary()` in Keras
  ☆4,061Updated last year
• melodyguan / enas
  TensorFlow Code for paper "Efficient Neural Architecture Search via Parameter Sharing"
  ☆1,581Updated 6 years ago