uw-mad-dash / AutoFreezeLinks
☆14Updated 4 years ago
Alternatives and similar repositories for AutoFreeze
Users that are interested in AutoFreeze are comparing it to the libraries listed below
Sorting:
- "Moshpit SGD: Communication-Efficient Decentralized Training on Heterogeneous Unreliable Devices", official implementation☆30Updated 10 months ago
- PyTorch implementation of L2L execution algorithm☆109Updated 2 years ago
- DL Dataloader Benchmarks☆20Updated 10 months ago
- MONeT framework for reducing memory consumption of DNN training☆174Updated 4 years ago
- Torch Distributed Experimental☆117Updated last year
- Fairring (FAIR + Herring) is a plug-in for PyTorch that provides a process group for distributed training that outperforms NCCL at large …☆65Updated 3 years ago
- PipeTransformer: Automated Elastic Pipelining for Distributed Training of Large-scale Models. ICML 2021☆55Updated 4 years ago
- ☆22Updated 5 years ago
- "Towards Crowdsourced Training of Large Neural Networks using Decentralized Mixture-of-Experts" (NeurIPS 2020), original PyTorch implemen…☆56Updated 5 years ago
- [JMLR'20] NeurIPS 2019 MicroNet Challenge Efficient Language Modeling, Champion☆41Updated 4 years ago
- ☆12Updated 3 years ago
- Context Manager to profile the forward and backward times of PyTorch's nn.Module☆83Updated 2 years ago
- A collection of Models, Datasets, DataModules, Callbacks, Metrics, Losses and Loggers to better integrate pytorch-lightning with transfor…☆47Updated 2 years ago
- a lightweight transformer library for PyTorch☆72Updated 4 years ago
- This repository contains example code to build models on TPUs☆30Updated 2 years ago
- Distributed preprocessing and data loading for language datasets☆40Updated last year
- ☆108Updated 4 years ago
- SelectiveBackprop accelerates training by dynamically prioritizing useful examples with high loss☆32Updated 5 years ago
- Research and development for optimizing transformers☆131Updated 4 years ago
- Examples for the WebDataset PyTorch Dataset Library☆51Updated 4 years ago
- ☆32Updated 3 years ago
- Repository to go along with the paper "Plumber: Diagnosing and Removing Performance Bottlenecks in Machine Learning Data Pipelines"☆10Updated 3 years ago
- PyTorch reimplementation of the paper "HyperMixer: An MLP-based Green AI Alternative to Transformers" [arXiv 2022].☆18Updated 3 years ago
- ☆25Updated 4 years ago
- Implementation of a Transformer using ReLA (Rectified Linear Attention) from https://arxiv.org/abs/2104.07012☆49Updated 3 years ago
- [ICLR 2020] Drawing Early-Bird Tickets: Toward More Efficient Training of Deep Networks☆140Updated 5 years ago
- ☆22Updated 7 years ago
- Simple Distributed Deep Learning on TensorFlow☆134Updated 6 months ago
- ☆57Updated 3 years ago
- A performant, memory-efficient checkpointing library for PyTorch applications, designed with large, complex distributed workloads in mind…☆162Updated this week