uw-mad-dash / AutoFreezeLinks
☆14Updated 5 years ago
Alternatives and similar repositories for AutoFreeze
Users that are interested in AutoFreeze are comparing it to the libraries listed below
Sorting:
- "Moshpit SGD: Communication-Efficient Decentralized Training on Heterogeneous Unreliable Devices", official implementation☆30Updated last year
- PyTorch implementation of L2L execution algorithm☆109Updated 3 years ago
- MONeT framework for reducing memory consumption of DNN training☆174Updated 4 years ago
- PipeTransformer: Automated Elastic Pipelining for Distributed Training of Large-scale Models. ICML 2021☆55Updated 4 years ago
- Fairring (FAIR + Herring) is a plug-in for PyTorch that provides a process group for distributed training that outperforms NCCL at large …☆65Updated 3 years ago
- ☆22Updated 5 years ago
- Research and development for optimizing transformers☆131Updated 4 years ago
- DL Dataloader Benchmarks☆20Updated last year
- Context Manager to profile the forward and backward times of PyTorch's nn.Module☆83Updated 2 years ago
- Torch Distributed Experimental☆117Updated last year
- ☆14Updated 3 years ago
- [JMLR'20] NeurIPS 2019 MicroNet Challenge Efficient Language Modeling, Champion☆41Updated 4 years ago
- Implementation of a Transformer using ReLA (Rectified Linear Attention) from https://arxiv.org/abs/2104.07012☆49Updated 3 years ago
- ☆32Updated 3 years ago
- Code for paper 'Minimizing FLOPs to Learn Efficient Sparse Representations' published at ICLR 2020☆20Updated 5 years ago
- A study of the downstream instability of word embeddings☆12Updated 3 years ago
- [ICLR 2020] Drawing Early-Bird Tickets: Toward More Efficient Training of Deep Networks☆140Updated 5 years ago
- SelectiveBackprop accelerates training by dynamically prioritizing useful examples with high loss☆32Updated 5 years ago
- sensAI: ConvNets Decomposition via Class Parallelism for Fast Inference on Live Data☆66Updated last year
- Code for BlockSwap (ICLR 2020).☆33Updated 4 years ago
- ☆22Updated 7 years ago
- Simple Distributed Deep Learning on TensorFlow☆134Updated last week
- DAM Data Acquisition for ML Benchmark, as part of the DataPerf benchmark suite, https://dataperf.org/☆25Updated 2 years ago
- Code for paper "SWALP: Stochastic Weight Averaging forLow-Precision Training".☆62Updated 6 years ago
- Repository to go along with the paper "Plumber: Diagnosing and Removing Performance Bottlenecks in Machine Learning Data Pipelines"☆10Updated 3 years ago
- Code release to reproduce ASHA experiments from "Random Search and Reproducibility for NAS."☆22Updated 6 years ago
- ☆41Updated 4 years ago
- ☆107Updated 4 years ago
- Implementation of the Remixer Block from the Remixer paper, in Pytorch☆36Updated 4 years ago
- A library for syntactically rewriting Python programs, pronounced (sinner).☆67Updated 3 years ago