siddharth9820 / MoDNN
Implementation of algorithms for memory optimized deep neural network training
☆9Updated 4 years ago
Alternatives and similar repositories for MoDNN:
Users that are interested in MoDNN are comparing it to the libraries listed below
- A Cluster-Wide Model Manager to Accelerate DNN Training via Automated Training Warmup☆34Updated 2 years ago
- Code for reproducing experiments performed for Accoridon☆13Updated 3 years ago
- ☆39Updated 4 years ago
- Source code for the paper: "A Latency-Predictable Multi-Dimensional Optimization Framework forDNN-driven Autonomous Systems"☆20Updated 4 years ago
- ☆24Updated last year
- a deep learning-driven scheduler for elastic training in deep learning clusters☆28Updated 4 years ago
- [ICDCS 2023] DeAR: Accelerating Distributed Deep Learning with Fine-Grained All-Reduce Pipelining☆12Updated last year
- ☆18Updated 2 years ago
- A Portable C Library for Distributed CNN Inference on IoT Edge Clusters☆81Updated 4 years ago
- ☆20Updated 3 years ago
- RL-Scope: Cross-Stack Profiling for Deep Reinforcement Learning Workloads☆42Updated 3 years ago
- Ok-Topk is a scheme for distributed training with sparse gradients. Ok-Topk integrates a novel sparse allreduce algorithm (less than 6k c…☆24Updated 2 years ago
- ☆14Updated 2 years ago
- PipeTransformer: Automated Elastic Pipelining for Distributed Training of Large-scale Models. ICML 2021☆55Updated 3 years ago
- ☆14Updated 3 years ago
- Machine Learning System☆14Updated 4 years ago
- Dual-way gradient sparsification approach for async DNN training, based on PyTorch.☆11Updated 2 years ago
- Hi-Speed DNN Training with Espresso: Unleashing the Full Potential of Gradient Compression with Near-Optimal Usage Strategies (EuroSys '2…☆15Updated last year
- ☆16Updated 2 years ago
- Distributed ML Training Benchmarks☆27Updated last year
- ☆43Updated 3 years ago
- ddl-benchmarks: Benchmarks for Distributed Deep Learning☆37Updated 4 years ago
- ☆69Updated last year
- ☆21Updated 6 years ago
- Metis: Learning to Schedule Long-Running Applications in Shared Container Clusters with at Scale☆17Updated 4 years ago
- A Deep Learning Cluster Scheduler☆37Updated 4 years ago
- [IJCAI2023] An automated parallel training system that combines the advantages from both data and model parallelism. If you have any inte…☆51Updated last year
- Efficient Interactive LLM Serving with Proxy Model-based Sequence Length Prediction | A tiny BERT model can tell you the verbosity of an …☆27Updated 7 months ago
- [ACM SIGCOMM 2024] "m3: Accurate Flow-Level Performance Estimation using Machine Learning" by Chenning Li*, Arash Nasr-Esfahany*, Kevin Z…☆22Updated 3 months ago
- ☆22Updated 4 years ago