cybertronai / gradient-checkpointing

Related projects ⓘ

Alternatives and complementary repositories for gradient-checkpointing

• pytorch / xla
  Enabling PyTorch on XLA Devices (e.g. Google TPU)
  ☆2,489Updated this week
• tensorflow / mesh
  Mesh TensorFlow: Model Parallelism Made Easier
  ☆1,591Updated last year
• carpedm20 / ENAS-pytorch
  PyTorch implementation of "Efficient Neural Architecture Search via Parameters Sharing"
  ☆2,707Updated last year
• openai / sparse_attention
  Examples of using sparse attention, as in "Generating Long Sequences with Sparse Transformers"
  ☆1,524Updated 4 years ago
• Stonesjtu / pytorch_memlab
  Profiling and inspecting memory in pytorch
  ☆1,020Updated 3 months ago
• pytorch / tnt
  A lightweight library for PyTorch training tools and utilities
  ☆1,665Updated this week
• nitrain / nitrain
  Train AI models efficiently on medical images using any framework
  ☆1,866Updated 5 months ago
• openai / blocksparse
  Efficient GPU kernels for block-sparse matrix multiplication and convolution
  ☆1,027Updated last year
• facebookresearch / fairscale
  PyTorch extensions for high performance and large scale training.
  ☆3,195Updated last week
• williamFalcon / test-tube
  Python library to easily log experiments and parallelize hyperparameter search for neural networks
  ☆736Updated 2 years ago
• pytorch / ignite
  High-level library to help with training and evaluating neural networks in PyTorch flexibly and transparently.
  ☆4,528Updated last week
• Luolc / AdaBound
  An optimizer that trains as fast as Adam and as good as SGD.
  ☆2,907Updated last year
• facebookresearch / TensorComprehensions
  A domain specific language to express machine learning workloads.
  ☆1,761Updated last year
• LiyuanLucasLiu / RAdam
  On the Variance of the Adaptive Learning Rate and Beyond
  ☆2,535Updated 3 years ago
• NVIDIA / apex
  A PyTorch Extension: Tools for easy mixed precision and distributed training in Pytorch
  ☆8,415Updated 2 weeks ago
• jettify / pytorch-optimizer
  torch-optimizer -- collection of optimizers for Pytorch
  ☆3,043Updated 7 months ago
• facebookincubator / gloo
  Collective communications library with various primitives for multi-machine training.
  ☆1,227Updated this week
• kakaobrain / torchgpipe
  A GPipe implementation in PyTorch
  ☆818Updated 3 months ago
• IntelLabs / distiller
  Neural Network Distiller by Intel AI Lab: a Python package for neural network compression research. https://intellabs.github.io/distille…
  ☆4,351Updated last year
• melodyguan / enas
  TensorFlow Code for paper "Efficient Neural Architecture Search via Parameter Sharing"
  ☆1,582Updated 5 years ago
• waleedka / hiddenlayer
  Neural network graphs and training metrics for PyTorch, Tensorflow, and Keras.
  ☆1,800Updated 9 months ago
• pytorch / captum
  Model interpretability and understanding for PyTorch
  ☆4,935Updated this week
• Lightning-Universe / lightning-bolts
  Toolbox of models, callbacks, and datasets for AI/ML researchers.
  ☆1,695Updated 2 weeks ago
• webdataset / webdataset
  A high-performance Python-based I/O system for large (and small) deep learning problems, with strong support for PyTorch.
  ☆2,328Updated last month
• tensorflow / lingvo
  Lingvo
  ☆2,816Updated this week
• raghakot / keras-vis
  Neural network visualization toolkit for keras
  ☆2,982Updated 2 years ago
• pytorch / elastic
  PyTorch elastic training
  ☆730Updated 2 years ago
• arogozhnikov / einops
  Flexible and powerful tensor operations for readable and reliable code (for pytorch, jax, TF and others)
  ☆8,524Updated this week
• Santosh-Gupta / SpeedTorch
  Library for faster pinned CPU <-> GPU transfer in Pytorch
  ☆683Updated 4 years ago
• sekwiatkowski / awesome-capsule-networks
  A curated list of awesome resources related to capsule networks
  ☆974Updated 4 years ago