lkp411 / cDLRM
Enabling pure data parallel training of DLRM via caching and prefetching
☆17Updated 3 years ago
Alternatives and similar repositories for cDLRM:
Users that are interested in cDLRM are comparing it to the libraries listed below
- http://vlsiarch.eecs.harvard.edu/research/recommendation/☆133Updated 2 years ago
- Set of datasets for the deep learning recommendation model (DLRM).☆41Updated 2 years ago
- Accelerating Recommender model training by leveraging popular choices -- VLDB 2022☆30Updated 5 months ago
- ☆10Updated 3 years ago
- [KDD 2022] AutoShard: Automated Embedding Table Sharding for Recommender Systems☆21Updated last year
- TF2 implementation of DLRM (inherited and modified from openrec's initial implementation)☆16Updated 4 years ago
- Time-based Sequence Model for Personalization and Recommendation Systems☆49Updated 3 years ago
- This is a Tensor Train based compression library to compress sparse embedding tables used in large-scale machine learning models such as …☆193Updated 2 years ago
- FTPipe and related pipeline model parallelism research.☆41Updated last year
- distributed-embeddings is a library for building large embedding based models in Tensorflow 2.☆43Updated last year
- ☆15Updated 2 years ago
- ☆30Updated last year
- Ginex: SSD-enabled Billion-scale Graph Neural Network Training on a Single Machine via Provably Optimal In-memory Caching☆36Updated 7 months ago
- Graphiler is a compiler stack built on top of DGL and TorchScript which compiles GNNs defined using user-defined functions (UDFs) into ef…☆61Updated 2 years ago
- A Generic Resource-Aware Hyperparameter Tuning Execution Engine☆15Updated 3 years ago
- Research and development for optimizing transformers☆125Updated 4 years ago
- ☆43Updated 3 weeks ago
- Differentiable Product Quantization for End-to-End Embedding Compression.☆59Updated 2 years ago
- ☆24Updated last year
- LLMServingSim: A HW/SW Co-Simulation Infrastructure for LLM Inference Serving at Scale☆85Updated last month
- The official SALIENT system described in the paper "Accelerating Training and Inference of Graph Neural Networks with Fast Sampling and P…☆38Updated last year
- Large scale graph learning on a single machine.☆161Updated 5 months ago
- [ NeurIPS '22 ] ∞-AE model's implementation in JAX. Kernel-only method outperforms complicated SoTA models with a closed-form solution an…☆55Updated last year
- ☆73Updated 3 years ago
- ☆25Updated 2 years ago
- PArametrized Recommendation and Ai Model benchmark is a repository for development of numerous uBenchmarks as well as end to end nets for…☆128Updated this week
- PipeTransformer: Automated Elastic Pipelining for Distributed Training of Large-scale Models. ICML 2021☆55Updated 3 years ago
- DE-RRD: A Knowledge Distillation Framework for Recommender System (CIKM'20)☆29Updated 2 years ago
- A Framework for Graph Sampling and Random Walk on GPUs.☆39Updated 2 weeks ago
- Distributed Multi-GPU GNN Framework☆36Updated 4 years ago