quentinf00 / article-memory-logLinks
Implémentation of the article **Deep Learning CUDA Memory Usage and Pytorch optimization tricks**
☆43Updated 5 years ago
Alternatives and similar repositories for article-memory-log
Users that are interested in article-memory-log are comparing it to the libraries listed below
Sorting:
- ☆144Updated 2 years ago
- 🧀 Pytorch code for the Fromage optimiser.☆124Updated 10 months ago
- ☆70Updated 5 years ago
- [JMLR'20] NeurIPS 2019 MicroNet Challenge Efficient Language Modeling, Champion☆40Updated 4 years ago
- Block Sparse movement pruning☆79Updated 4 years ago
- Block-sparse primitives for PyTorch☆155Updated 4 years ago
- Pytorch library for factorized L0-based pruning.☆45Updated last year
- Code accompanying the NeurIPS 2020 paper: WoodFisher (Singh & Alistarh, 2020)☆52Updated 4 years ago
- SNIP: SINGLE-SHOT NETWORK PRUNING☆31Updated 2 months ago
- Code for paper "SWALP: Stochastic Weight Averaging forLow-Precision Training".☆62Updated 6 years ago
- PyTorch implementation of HashedNets☆36Updated 2 years ago
- Context Manager to profile the forward and backward times of PyTorch's nn.Module☆83Updated last year
- PyTorch implementation of L2L execution algorithm☆107Updated 2 years ago
- ☆22Updated 7 years ago
- A pytorch implementation for the LSTM experiments in the paper: Why Gradient Clipping Accelerates Training: A Theoretical Justification f…☆46Updated 5 years ago
- Easy-to-use AdaHessian optimizer (PyTorch)☆78Updated 4 years ago
- Structured matrices for compressing neural networks☆66Updated last year
- ☆74Updated 5 years ago
- [NeurIPS 2022] DataMUX: Data Multiplexing for Neural Networks☆60Updated 2 years ago
- PyTorch Examples repo for "ReZero is All You Need: Fast Convergence at Large Depth"☆62Updated 10 months ago
- Code for "Training Neural Networks with Fixed Sparse Masks" (NeurIPS 2021).☆58Updated 3 years ago
- A collection of metrics to profile a single deep learning model or compare two different deep learning models☆26Updated last year
- Practical low-rank gradient compression for distributed optimization: https://arxiv.org/abs/1905.13727☆146Updated 7 months ago
- Official Pytorch Implementation of Length-Adaptive Transformer (ACL 2021)☆101Updated 4 years ago
- Code for "Supermasks in Superposition"☆124Updated last year
- ☆190Updated 4 years ago
- Customized matrix multiplication kernels☆54Updated 3 years ago
- A custom PyTorch layer that is capable of implementing extremely wide and sparse linear layers efficiently☆49Updated last year
- Soft Threshold Weight Reparameterization for Learnable Sparsity☆90Updated 2 years ago
- a lightweight transformer library for PyTorch☆71Updated 3 years ago