lkp411 / cDLRM
Enabling pure data parallel training of DLRM via caching and prefetching
☆18Updated 2 years ago
Related projects: ⓘ
- http://vlsiarch.eecs.harvard.edu/research/recommendation/☆127Updated 2 years ago
- Set of datasets for the deep learning recommendation model (DLRM).☆39Updated last year
- Accelerating Recommender model training by leveraging popular choices -- VLDB 2022☆29Updated last week
- ☆10Updated 2 years ago
- distributed-embeddings is a library for building large embedding based models in Tensorflow 2.☆41Updated 11 months ago
- [KDD 2022] AutoShard: Automated Embedding Table Sharding for Recommender Systems☆21Updated last year
- ☆29Updated 7 months ago
- Research and development for optimizing transformers☆121Updated 3 years ago
- A Generic Resource-Aware Hyperparameter Tuning Execution Engine☆15Updated 2 years ago
- This is a Tensor Train based compression library to compress sparse embedding tables used in large-scale machine learning models such as …☆192Updated 2 years ago
- ☆21Updated last year
- TF2 implementation of DLRM (inherited and modified from openrec's initial implementation)☆16Updated 4 years ago
- FTPipe and related pipeline model parallelism research.☆41Updated last year
- Ginex: SSD-enabled Billion-scale Graph Neural Network Training on a Single Machine via Provably Optimal In-memory Caching☆34Updated 2 months ago
- The official SALIENT system described in the paper "Accelerating Training and Inference of Graph Neural Networks with Fast Sampling and P…☆38Updated last year
- [ICLR 2022] "PipeGCN: Efficient Full-Graph Training of Graph Convolutional Networks with Pipelined Feature Communication" by Cheng Wan, Y…☆27Updated last year
- ☆14Updated 2 years ago
- ☆19Updated last year
- PyTorch-Direct code on top of PyTorch-1.8.0nightly (e152ca5) for Large Graph Convolutional Network Training with GPU-Oriented Data Commun…☆45Updated last year
- ☆23Updated last year
- [ICML 2024] Serving LLMs on heterogeneous decentralized clusters.☆14Updated 4 months ago
- Graphiler is a compiler stack built on top of DGL and TorchScript which compiles GNNs defined using user-defined functions (UDFs) into ef…☆58Updated last year
- Distributed Multi-GPU GNN Framework☆35Updated 4 years ago
- SoCC'20 and TPDS'21: Scaling GNN Training on Large Graphs via Computation-aware Caching and Partitioning.☆47Updated last year
- PipeTransformer: Automated Elastic Pipelining for Distributed Training of Large-scale Models. ICML 2021☆54Updated 3 years ago
- ☆42Updated 2 weeks ago
- ☆31Updated last year
- Thinking is hard - automate it☆18Updated 2 years ago
- ☆48Updated 3 years ago
- Cavs: An Efficient Runtime System for Dynamic Neural Networks☆13Updated 4 years ago