Alternatives and similar repositories for gradient-checkpointing:

Users that are interested in gradient-checkpointing are comparing it to the libraries listed below

• facebookresearch / fairscale
  PyTorch extensions for high performance and large scale training.
  ☆3,306Updated 2 weeks ago
• carpedm20 / ENAS-pytorch
  PyTorch implementation of "Efficient Neural Architecture Search via Parameters Sharing"
  ☆2,716Updated last year
• pytorch / ignite
  High-level library to help with training and evaluating neural networks in PyTorch flexibly and transparently.
  ☆4,650Updated last week
• LiyuanLucasLiu / RAdam
  On the Variance of the Adaptive Learning Rate and Beyond
  ☆2,548Updated 3 years ago
• bckenstler / CLR
  ☆1,208Updated 4 years ago
• Santosh-Gupta / SpeedTorch
  Library for faster pinned CPU <-> GPU transfer in Pytorch
  ☆685Updated 5 years ago
• pytorch / tnt
  A lightweight library for PyTorch training tools and utilities
  ☆1,691Updated 2 weeks ago
• Luolc / AdaBound
  An optimizer that trains as fast as Adam and as good as SGD.
  ☆2,914Updated last year
• jettify / pytorch-optimizer
  torch-optimizer -- collection of optimizers for Pytorch
  ☆3,103Updated last year
• waleedka / hiddenlayer
  Neural network graphs and training metrics for PyTorch, Tensorflow, and Keras.
  ☆1,825Updated last year
• melodyguan / enas
  TensorFlow Code for paper "Efficient Neural Architecture Search via Parameter Sharing"
  ☆1,580Updated 5 years ago
• IntelLabs / distiller
  Neural Network Distiller by Intel AI Lab: a Python package for neural network compression research. https://intellabs.github.io/distille…
  ☆4,389Updated 2 years ago
• Stonesjtu / pytorch_memlab
  Profiling and inspecting memory in pytorch
  ☆1,057Updated 8 months ago
• openai / sparse_attention
  Examples of using sparse attention, as in "Generating Long Sequences with Sparse Transformers"
  ☆1,569Updated 4 years ago
• google-research / morph-net
  Fast & Simple Resource-Constrained Learning of Deep Network Structure
  ☆1,029Updated 2 months ago
• kakaobrain / torchgpipe
  A GPipe implementation in PyTorch
  ☆836Updated 9 months ago
• williamFalcon / test-tube
  Python library to easily log experiments and parallelize hyperparameter search for neural networks
  ☆735Updated 2 years ago
• ysh329 / deep-learning-model-convertor
  The convertor/conversion of deep learning models for different deep learning frameworks/softwares.
  ☆3,249Updated last year
• tensorflow / mesh
  Mesh TensorFlow: Model Parallelism Made Easier
  ☆1,604Updated last year
• NVIDIA / apex
  A PyTorch Extension: Tools for easy mixed precision and distributed training in Pytorch
  ☆8,630Updated 2 weeks ago
• webdataset / webdataset
  A high-performance Python-based I/O system for large (and small) deep learning problems, with strong support for PyTorch.
  ☆2,564Updated 2 months ago
• nitrain / nitrain
  Train AI models efficiently on medical images using any framework
  ☆1,874Updated 10 months ago
• catalyst-team / catalyst
  Accelerated deep learning R&D
  ☆3,347Updated last year
• prigoyal / pytorch_memonger
  Experimental ground for optimizing memory of pytorch models
  ☆365Updated 7 years ago
• chrischoy / pytorch-custom-cuda-tutorial
  Tutorial for building a custom CUDA function for Pytorch
  ☆511Updated 6 years ago
• microsoft / MMdnn
  MMdnn is a set of tools to help users inter-operate among different deep learning frameworks. E.g. model conversion and visualization. Co…
  ☆5,811Updated 10 months ago
• IDSIA / sacred
  Sacred is a tool to help you configure, organize, log and reproduce experiments developed at IDSIA.
  ☆4,295Updated 4 months ago
• chiphuyen / sotawhat
  Returns latest research results by crawling arxiv papers and summarizing abstracts. Helps you stay afloat with so many new papers everyda…
  ☆1,362Updated last year
• harvardnlp / pytorch-struct
  Fast, general, and tested differentiable structured prediction in PyTorch
  ☆1,112Updated 3 years ago
• quark0 / darts
  Differentiable architecture search for convolutional and recurrent networks
  ☆3,950Updated 4 years ago