uw-mad-dash / AutoFreeze
☆14Updated 4 years ago
Alternatives and similar repositories for AutoFreeze
Users that are interested in AutoFreeze are comparing it to the libraries listed below
Sorting:
- ☆22Updated 4 years ago
- Fairring (FAIR + Herring) is a plug-in for PyTorch that provides a process group for distributed training that outperforms NCCL at large …☆65Updated 3 years ago
- Repository to go along with the paper "Plumber: Diagnosing and Removing Performance Bottlenecks in Machine Learning Data Pipelines"☆10Updated 3 years ago
- SelectiveBackprop accelerates training by dynamically prioritizing useful examples with high loss☆32Updated 5 years ago
- PipeTransformer: Automated Elastic Pipelining for Distributed Training of Large-scale Models. ICML 2021☆56Updated 3 years ago
- Light-weight GPU kernel interface for graph operations☆15Updated 4 years ago
- "Moshpit SGD: Communication-Efficient Decentralized Training on Heterogeneous Unreliable Devices", official implementation☆29Updated 3 months ago
- ☆22Updated 6 years ago
- A Ray-based data loader with per-epoch shuffling and configurable pipelining, for shuffling and loading training data for distributed tra…☆18Updated 2 years ago
- A collection of reproducible inference engine benchmarks☆30Updated 3 weeks ago
- A Learnable LSH Framework for Efficient NN Training☆31Updated 3 years ago
- DL Dataloader Benchmarks☆18Updated 3 months ago
- ☆32Updated 2 years ago
- Memory Optimizations for Deep Learning (ICML 2023)☆64Updated last year
- ☆43Updated last year
- [ICDCS 2023] DeAR: Accelerating Distributed Deep Learning with Fine-Grained All-Reduce Pipelining☆12Updated last year
- ☆71Updated 3 years ago
- sensAI: ConvNets Decomposition via Class Parallelism for Fast Inference on Live Data☆64Updated 9 months ago
- ☆15Updated 3 years ago
- [JMLR'20] NeurIPS 2019 MicroNet Challenge Efficient Language Modeling, Champion☆40Updated 4 years ago
- Torch Distributed Experimental☆115Updated 9 months ago
- ☆29Updated 2 years ago
- Code for BlockSwap (ICLR 2020).☆33Updated 4 years ago
- Research and development for optimizing transformers☆126Updated 4 years ago
- Deadline-based hyperparameter tuning on RayTune.☆31Updated 5 years ago
- PyTorch-Direct code on top of PyTorch-1.8.0nightly (e152ca5) for Large Graph Convolutional Network Training with GPU-Oriented Data Commun…☆44Updated last year
- Simple Distributed Deep Learning on TensorFlow☆134Updated 2 years ago
- A "gym" style toolkit for building lightweight NAS systems.☆13Updated 2 years ago
- MONeT framework for reducing memory consumption of DNN training☆173Updated 4 years ago
- PyTorch implementation of L2L execution algorithm☆107Updated 2 years ago