cybertronai / gradient-checkpointingLinks
Make huge neural nets fit in memory
☆2,809Updated 5 years ago
Alternatives and similar repositories for gradient-checkpointing
Users that are interested in gradient-checkpointing are comparing it to the libraries listed below
Sorting:
- PyTorch extensions for high performance and large scale training.☆3,361Updated 3 months ago
- ☆1,207Updated 5 years ago
- A lightweight library for PyTorch training tools and utilities☆1,706Updated this week
- Mesh TensorFlow: Model Parallelism Made Easier☆1,615Updated last year
- Examples of using sparse attention, as in "Generating Long Sequences with Sparse Transformers"☆1,584Updated 5 years ago
- Python library to easily log experiments and parallelize hyperparameter search for neural networks☆736Updated 3 years ago
- Profiling and inspecting memory in pytorch☆1,064Updated last year
- Efficient GPU kernels for block-sparse matrix multiplication and convolution☆1,045Updated 2 years ago
- Enabling PyTorch on XLA Devices (e.g. Google TPU)☆2,653Updated this week
- Fast & Simple Resource-Constrained Learning of Deep Network Structure☆1,031Updated 2 months ago
- Providing reproducibility in deep learning frameworks☆428Updated last year
- Library for faster pinned CPU <-> GPU transfer in Pytorch☆685Updated 5 years ago
- Experimental ground for optimizing memory of pytorch models☆366Updated 7 years ago
- Train AI models efficiently on medical images using any framework☆1,872Updated last year
- Neural network graphs and training metrics for PyTorch, Tensorflow, and Keras.☆1,841Updated last year
- Gin provides a lightweight configuration framework for Python☆2,120Updated 3 months ago
- High-level library to help with training and evaluating neural networks in PyTorch flexibly and transparently.☆4,688Updated last month
- A GPipe implementation in PyTorch☆849Updated last year
- A high-performance Python-based I/O system for large (and small) deep learning problems, with strong support for PyTorch.☆2,766Updated 2 months ago
- On the Variance of the Adaptive Learning Rate and Beyond☆2,554Updated 4 years ago
- PyTorch elastic training☆729Updated 3 years ago
- TorchBench is a collection of open source benchmarks used to evaluate PyTorch performance.☆976Updated this week
- Fast, general, and tested differentiable structured prediction in PyTorch☆1,113Updated 3 years ago
- PyTorch implementation of "Efficient Neural Architecture Search via Parameters Sharing"☆2,724Updated 2 years ago
- torchbearer: A model fitting library for PyTorch☆642Updated last year
- A GPU-accelerated library containing highly optimized building blocks and an execution engine for data processing to accelerate deep lear…☆5,484Updated last week
- A Python module for getting the GPU status from NVIDA GPUs using nvidia-smi programmically in Python☆1,198Updated last year
- Useful extra functionality for TensorFlow 2.x maintained by SIG-addons☆1,701Updated 4 months ago
- Reference implementations of MLPerf™ training benchmarks☆1,702Updated this week
- Toolbox of models, callbacks, and datasets for AI/ML researchers.☆1,736Updated 2 weeks ago