guanh01 / CS692-mlsys
This is the (evolving) reading list for the seminar.
☆57Updated 4 years ago
Alternatives and similar repositories for CS692-mlsys:
Users that are interested in CS692-mlsys are comparing it to the libraries listed below
- Research and development for optimizing transformers☆125Updated 3 years ago
- FTPipe and related pipeline model parallelism research.☆41Updated last year
- nnScaler: Compiling DNN models for Parallel Training☆87Updated last week
- ☆44Updated last year
- Set of datasets for the deep learning recommendation model (DLRM).☆41Updated 2 years ago
- A high-performance distributed deep learning system targeting large-scale and automated distributed training. If you have any interests, …☆106Updated last year
- Training neural networks in TensorFlow 2.0 with 5x less memory☆130Updated 2 years ago
- PET: Optimizing Tensor Programs with Partially Equivalent Transformations and Automated Corrections☆117Updated 2 years ago
- Inference framework for MoE layers based on TensorRT with Python binding☆41Updated 3 years ago
- (NeurIPS 2022) Automatically finding good model-parallel strategies, especially for complex models and clusters.☆37Updated 2 years ago
- ☆23Updated last month
- ☆70Updated 3 years ago
- The quantitative performance comparison among DL compilers on CNN models.☆75Updated 4 years ago
- http://vlsiarch.eecs.harvard.edu/research/recommendation/☆132Updated 2 years ago
- Machine Learning System☆14Updated 4 years ago
- PipeSwitch: Fast Pipelined Context Switching for Deep Learning Applications☆126Updated 2 years ago
- Dynamic Tensor Rematerialization prototype (modified PyTorch) and simulator. Paper: https://arxiv.org/abs/2006.09616☆132Updated last year
- A baseline repository of Auto-Parallelism in Training Neural Networks☆141Updated 2 years ago
- Distributed DataLoader For Pytorch Based On Ray☆24Updated 3 years ago
- System for automated integration of deep learning backends.☆48Updated 2 years ago
- 🔮 Execution time predictions for deep neural network training iterations across different GPUs.☆56Updated 2 years ago
- Python package for rematerialization-aware gradient checkpointing☆24Updated last year
- ☆79Updated last month
- Curated collection of papers in MoE model inference☆35Updated this week
- Fairring (FAIR + Herring) is a plug-in for PyTorch that provides a process group for distributed training that outperforms NCCL at large …☆63Updated 2 years ago
- ☆141Updated last week
- ☆151Updated last year
- Memory Optimizations for Deep Learning (ICML 2023)☆62Updated 10 months ago
- ☆22Updated 4 years ago
- A curated list of awesome projects and papers for distributed training or inference☆207Updated 3 months ago