Alternatives and similar repositories for gradient-checkpointing:

Users that are interested in gradient-checkpointing are comparing it to the libraries listed below

• nitrain / nitrain
  Train AI models efficiently on medical images using any framework
  ☆1,870Updated 8 months ago
• pytorch / ignite
  High-level library to help with training and evaluating neural networks in PyTorch flexibly and transparently.
  ☆4,586Updated this week
• facebookresearch / fairscale
  PyTorch extensions for high performance and large scale training.
  ☆3,260Updated last month
• Stonesjtu / pytorch_memlab
  Profiling and inspecting memory in pytorch
  ☆1,042Updated 6 months ago
• pytorch / tnt
  A lightweight library for PyTorch training tools and utilities
  ☆1,685Updated this week
• facebookresearch / TensorComprehensions
  A domain specific language to express machine learning workloads.
  ☆1,758Updated last year
• tensorflow / mesh
  Mesh TensorFlow: Model Parallelism Made Easier
  ☆1,604Updated last year
• IDSIA / sacred
  Sacred is a tool to help you configure, organize, log and reproduce experiments developed at IDSIA.
  ☆4,279Updated 2 months ago
• williamFalcon / test-tube
  Python library to easily log experiments and parallelize hyperparameter search for neural networks
  ☆735Updated 2 years ago
• NVIDIA / apex
  A PyTorch Extension: Tools for easy mixed precision and distributed training in Pytorch
  ☆8,537Updated 2 weeks ago
• LiyuanLucasLiu / RAdam
  On the Variance of the Adaptive Learning Rate and Beyond
  ☆2,541Updated 3 years ago
• pytorch / xla
  Enabling PyTorch on XLA Devices (e.g. Google TPU)
  ☆2,529Updated this week
• sksq96 / pytorch-summary
  Model summary in PyTorch similar to `model.summary()` in Keras
  ☆4,027Updated 11 months ago
• google-research / morph-net
  Fast & Simple Resource-Constrained Learning of Deep Network Structure
  ☆1,025Updated 3 weeks ago
• szagoruyko / pytorchviz
  A small package to create visualizations of PyTorch execution graphs
  ☆3,299Updated last month
• carpedm20 / ENAS-pytorch
  PyTorch implementation of "Efficient Neural Architecture Search via Parameters Sharing"
  ☆2,708Updated last year
• openai / blocksparse
  Efficient GPU kernels for block-sparse matrix multiplication and convolution
  ☆1,035Updated last year
• bckenstler / CLR
  ☆1,206Updated 4 years ago
• NVIDIA / DALI
  A GPU-accelerated library containing highly optimized building blocks and an execution engine for data processing to accelerate deep lear…
  ☆5,278Updated this week
• mlcommons / training
  Reference implementations of MLPerf™ training benchmarks
  ☆1,646Updated last week
• openai / sparse_attention
  Examples of using sparse attention, as in "Generating Long Sequences with Sparse Transformers"
  ☆1,549Updated 4 years ago
• kakaobrain / torchgpipe
  A GPipe implementation in PyTorch
  ☆828Updated 6 months ago
• tomgoldstein / loss-landscape
  Code for visualizing the loss landscape of neural nets
  ☆2,913Updated 2 years ago
• tensorflow / benchmarks
  A benchmark framework for Tensorflow
  ☆1,149Updated last year
• lanpa / tensorboardX
  tensorboard for pytorch (and chainer, mxnet, numpy, ...)
  ☆7,913Updated last month
• waleedka / hiddenlayer
  Neural network graphs and training metrics for PyTorch, Tensorflow, and Keras.
  ☆1,810Updated last year
• jettify / pytorch-optimizer
  torch-optimizer -- collection of optimizers for Pytorch
  ☆3,081Updated 10 months ago
• pytorch / elastic
  PyTorch elastic training
  ☆730Updated 2 years ago
• prigoyal / pytorch_memonger
  Experimental ground for optimizing memory of pytorch models
  ☆364Updated 6 years ago
• asappresearch / sru
  Training RNNs as Fast as CNNs (https://arxiv.org/abs/1709.02755)
  ☆2,102Updated 3 years ago