siddharth9820 / MoDNNLinks
Implementation of algorithms for memory optimized deep neural network training
☆10Updated 5 years ago
Alternatives and similar repositories for MoDNN
Users that are interested in MoDNN are comparing it to the libraries listed below
Sorting:
- ☆41Updated 5 years ago
- Code for reproducing experiments performed for Accoridon☆13Updated 4 years ago
- GRACE - GRAdient ComprEssion for distributed deep learning☆140Updated last year
- A Cluster-Wide Model Manager to Accelerate DNN Training via Automated Training Warmup☆35Updated 2 years ago
- Boost hardware utilization for ML training workloads via Inter-model Horizontal Fusion☆32Updated last year
- Layer-wise Sparsification of Distributed Deep Learning☆10Updated 5 years ago
- [ICDCS 2023] DeAR: Accelerating Distributed Deep Learning with Fine-Grained All-Reduce Pipelining☆11Updated last year
- Hi-Speed DNN Training with Espresso: Unleashing the Full Potential of Gradient Compression with Near-Optimal Usage Strategies (EuroSys '2…☆15Updated 2 years ago
- Source code for the paper: "A Latency-Predictable Multi-Dimensional Optimization Framework forDNN-driven Autonomous Systems"☆22Updated 4 years ago
- We present a set of all-reduce compatible gradient compression algorithms which significantly reduce the communication overhead while mai…☆10Updated 3 years ago
- Dual-way gradient sparsification approach for async DNN training, based on PyTorch.☆11Updated 2 years ago
- A Portable C Library for Distributed CNN Inference on IoT Edge Clusters☆85Updated 5 years ago
- RL-Scope: Cross-Stack Profiling for Deep Reinforcement Learning Workloads☆45Updated 4 years ago
- Ok-Topk is a scheme for distributed training with sparse gradients. Ok-Topk integrates a novel sparse allreduce algorithm (less than 6k c…☆27Updated 2 years ago
- 🔮 Execution time predictions for deep neural network training iterations across different GPUs.☆62Updated 2 years ago
- ☆21Updated 3 years ago
- Simple PyTorch graph capturing.☆21Updated 2 years ago
- ddl-benchmarks: Benchmarks for Distributed Deep Learning☆36Updated 5 years ago
- This is the proof-of-concept CPU implementation of ASPEN used for the NeurIPS'23 paper ASPEN: Breaking Operator Barriers for Efficient Pa…☆13Updated last year
- Artifact for "Shockwave: Fair and Efficient Cluster Scheduling for Dynamic Adaptation in Machine Learning" [NSDI '23]☆45Updated 2 years ago
- FTPipe and related pipeline model parallelism research.☆43Updated 2 years ago
- ☆10Updated 4 years ago
- ☆68Updated 2 years ago
- ☆25Updated 2 years ago
- ☆38Updated 4 months ago
- ☆14Updated 3 years ago
- [ICDCS 2023] Evaluation and Optimization of Gradient Compression for Distributed Deep Learning☆10Updated 2 years ago
- A computation-parallel deep learning architecture.☆13Updated 6 years ago
- [ACM SIGCOMM 2024] "m3: Accurate Flow-Level Performance Estimation using Machine Learning" by Chenning Li, Arash Nasr-Esfahany, Kevin Zha…☆24Updated last year
- Implementation of vDNN++; an improvement over vDNN☆18Updated 6 years ago