Alternatives and similar repositories for gradient-checkpointing:

Users that are interested in gradient-checkpointing are comparing it to the libraries listed below

• LiyuanLucasLiu / RAdam
  On the Variance of the Adaptive Learning Rate and Beyond
  ☆2,539Updated 3 years ago
• nitrain / nitrain
  Train AI models efficiently on medical images using any framework
  ☆1,870Updated 7 months ago
• Stonesjtu / pytorch_memlab
  Profiling and inspecting memory in pytorch
  ☆1,038Updated 5 months ago
• openai / sparse_attention
  Examples of using sparse attention, as in "Generating Long Sequences with Sparse Transformers"
  ☆1,539Updated 4 years ago
• facebookresearch / fairscale
  PyTorch extensions for high performance and large scale training.
  ☆3,232Updated this week
• williamFalcon / test-tube
  Python library to easily log experiments and parallelize hyperparameter search for neural networks
  ☆734Updated 2 years ago
• pytorch / tnt
  A lightweight library for PyTorch training tools and utilities
  ☆1,678Updated last week
• tensorflow / mesh
  Mesh TensorFlow: Model Parallelism Made Easier
  ☆1,598Updated last year
• NVIDIA / DALI
  A GPU-accelerated library containing highly optimized building blocks and an execution engine for data processing to accelerate deep lear…
  ☆5,244Updated this week
• prigoyal / pytorch_memonger
  Experimental ground for optimizing memory of pytorch models
  ☆361Updated 6 years ago
• pytorch / ignite
  High-level library to help with training and evaluating neural networks in PyTorch flexibly and transparently.
  ☆4,569Updated last week
• huggingface / knockknock
  🚪✊Knock Knock: Get notified when your training ends with only two additional lines of code
  ☆2,798Updated last year
• waleedka / hiddenlayer
  Neural network graphs and training metrics for PyTorch, Tensorflow, and Keras.
  ☆1,803Updated 11 months ago
• kakaobrain / torchgpipe
  A GPipe implementation in PyTorch
  ☆821Updated 5 months ago
• asappresearch / sru
  Training RNNs as Fast as CNNs (https://arxiv.org/abs/1709.02755)
  ☆2,103Updated 3 years ago
• Santosh-Gupta / SpeedTorch
  Library for faster pinned CPU <-> GPU transfer in Pytorch
  ☆684Updated 4 years ago
• carpedm20 / ENAS-pytorch
  PyTorch implementation of "Efficient Neural Architecture Search via Parameters Sharing"
  ☆2,709Updated last year
• szagoruyko / pytorchviz
  A small package to create visualizations of PyTorch execution graphs
  ☆3,271Updated 2 weeks ago
• Luolc / AdaBound
  An optimizer that trains as fast as Adam and as good as SGD.
  ☆2,909Updated last year
• pytorch / elastic
  PyTorch elastic training
  ☆730Updated 2 years ago
• openai / blocksparse
  Efficient GPU kernels for block-sparse matrix multiplication and convolution
  ☆1,030Updated last year
• bckenstler / CLR
  ☆1,207Updated 4 years ago
• jettify / pytorch-optimizer
  torch-optimizer -- collection of optimizers for Pytorch
  ☆3,067Updated 9 months ago
• horovod / horovod
  Distributed training framework for TensorFlow, Keras, PyTorch, and Apache MXNet.
  ☆14,337Updated last month
• IntelLabs / distiller
  Neural Network Distiller by Intel AI Lab: a Python package for neural network compression research. https://intellabs.github.io/distille…
  ☆4,364Updated last year
• NVIDIA / apex
  A PyTorch Extension: Tools for easy mixed precision and distributed training in Pytorch
  ☆8,502Updated last month
• google / neural-tangents
  Fast and Easy Infinite Neural Networks in Python
  ☆2,306Updated 10 months ago
• IDSIA / sacred
  Sacred is a tool to help you configure, organize, log and reproduce experiments developed at IDSIA.
  ☆4,275Updated last month
• tensorflow / addons
  Useful extra functionality for TensorFlow 2.x maintained by SIG-addons
  ☆1,693Updated 4 months ago
• microsoft / MMdnn
  MMdnn is a set of tools to help users inter-operate among different deep learning frameworks. E.g. model conversion and visualization. Co…
  ☆5,809Updated 7 months ago