cybertronai / gradient-checkpointingLinks
Make huge neural nets fit in memory
☆2,814Updated 5 years ago
Alternatives and similar repositories for gradient-checkpointing
Users that are interested in gradient-checkpointing are comparing it to the libraries listed below
Sorting:
- PyTorch extensions for high performance and large scale training.☆3,384Updated 5 months ago
- A lightweight library for PyTorch training tools and utilities☆1,714Updated 2 weeks ago
- Examples of using sparse attention, as in "Generating Long Sequences with Sparse Transformers"☆1,590Updated 5 years ago
- Mesh TensorFlow: Model Parallelism Made Easier☆1,620Updated last year
- Profiling and inspecting memory in pytorch☆1,073Updated last month
- Enabling PyTorch on XLA Devices (e.g. Google TPU)☆2,688Updated this week
- Efficient GPU kernels for block-sparse matrix multiplication and convolution☆1,062Updated 2 years ago
- Neural network graphs and training metrics for PyTorch, Tensorflow, and Keras.☆1,851Updated last year
- Fast & Simple Resource-Constrained Learning of Deep Network Structure☆1,032Updated 4 months ago
- Python library to easily log experiments and parallelize hyperparameter search for neural networks☆735Updated 3 years ago
- Train AI models efficiently on medical images using any framework☆1,874Updated last year
- High-level library to help with training and evaluating neural networks in PyTorch flexibly and transparently.☆4,706Updated last week
- On the Variance of the Adaptive Learning Rate and Beyond☆2,550Updated 4 years ago
- A small package to create visualizations of PyTorch execution graphs☆3,439Updated 9 months ago
- Library for faster pinned CPU <-> GPU transfer in Pytorch☆685Updated 5 years ago
- Reference implementations of MLPerf® training benchmarks☆1,719Updated this week
- A Python module for getting the GPU status from NVIDA GPUs using nvidia-smi programmically in Python☆1,205Updated last year
- Standalone TFRecord reader/writer with PyTorch data loaders☆893Updated 5 months ago
- A GPipe implementation in PyTorch☆857Updated last year
- torch-optimizer -- collection of optimizers for Pytorch☆3,144Updated last year
- ☆1,208Updated 5 years ago
- PyTorch implementation of "Efficient Neural Architecture Search via Parameters Sharing"☆2,724Updated 2 years ago
- Code for visualizing the loss landscape of neural nets☆3,080Updated 3 years ago
- PyTorch elastic training☆729Updated 3 years ago
- TorchBench is a collection of open source benchmarks used to evaluate PyTorch performance.☆988Updated this week
- Toolbox of models, callbacks, and datasets for AI/ML researchers.☆1,741Updated 2 weeks ago
- Model summary in PyTorch similar to `model.summary()` in Keras☆4,061Updated last year
- Experimental ground for optimizing memory of pytorch models☆367Updated 7 years ago
- Providing reproducibility in deep learning frameworks☆428Updated last year
- A high-performance Python-based I/O system for large (and small) deep learning problems, with strong support for PyTorch.☆2,851Updated 4 months ago