daochenzha / autoshard
[KDD 2022] AutoShard: Automated Embedding Table Sharding for Recommender Systems
☆21Updated last year
Alternatives and similar repositories for autoshard:
Users that are interested in autoshard are comparing it to the libraries listed below
- [MLSys 2023] Pre-train and Search: Efficient Embedding Table Sharding with Pre-trained Neural Cost Models☆16Updated last year
- [NeurIPS 2022] DreamShard: Generalizable Embedding Table Placement for Recommender Systems☆29Updated last year
- Set of datasets for the deep learning recommendation model (DLRM).☆41Updated 2 years ago
- Accelerating Recommender model training by leveraging popular choices -- VLDB 2022☆29Updated 4 months ago
- ☆19Updated 2 years ago
- Distributed Deep Graph Learning Framework for Dynamic Graphs☆11Updated 9 months ago
- Codes for SIGIR'22 Paper 'On-Device Next-Item Recommendation with Self-Supervised Knowledge Distillation'☆12Updated last year
- Graphiler is a compiler stack built on top of DGL and TorchScript which compiles GNNs defined using user-defined functions (UDFs) into ef…☆61Updated 2 years ago
- Largest realworld open-source graph dataset - Worked done under IBM-Illinois Discovery Accelerator Institute and Amazon Research Awards a…☆76Updated last month
- ☆15Updated 2 years ago
- ☆12Updated 3 years ago
- [ NeurIPS '22 ] Data distillation for recommender systems. Shows equivalent performance with 2-3 orders less data.☆22Updated last year
- ☆47Updated 2 years ago
- Surrogate-based Hyperparameter Tuning System☆28Updated last year
- ☆13Updated last year
- Enabling pure data parallel training of DLRM via caching and prefetching☆17Updated 3 years ago
- [ WSDM '22 ] On Sampling Collaborative Filtering Datasets☆20Updated 3 years ago
- ICLR 2021☆46Updated 3 years ago
- The official SALIENT system described in the paper "Accelerating Training and Inference of Graph Neural Networks with Fast Sampling and P…☆38Updated last year
- ☆73Updated 3 years ago
- [ICLR 2022] "PipeGCN: Efficient Full-Graph Training of Graph Convolutional Networks with Pipelined Feature Communication" by Cheng Wan, Y…☆31Updated last year
- Official implementation of our VQ-GNN paper (NeurIPS2021)☆37Updated 3 years ago
- [MLSys 2022] "BNS-GCN: Efficient Full-Graph Training of Graph Convolutional Networks with Partition-Parallelism and Random Boundary Node …☆53Updated last year
- Time-based Sequence Model for Personalization and Recommendation Systems☆49Updated 3 years ago
- [ICML 2021] "A Unified Lottery Tickets Hypothesis for Graph Neural Networks", Tianlong Chen*, Yongduo Sui*, Xuxi Chen, Aston Zhang, Zhang…☆64Updated last year
- This is an authors' implementation of the NIPS 2022 dataset and Benchmark Track Paper "A Comprehensive Study on Large Scale Graph Trainin…☆65Updated last year
- PyTorch-Direct code on top of PyTorch-1.8.0nightly (e152ca5) for Large Graph Convolutional Network Training with GPU-Oriented Data Commun…☆45Updated last year
- ☆42Updated this week
- Artifact for PPoPP20 "Understanding and Bridging the Gaps in Current GNN Performance Optimizations"☆39Updated 3 years ago
- http://vlsiarch.eecs.harvard.edu/research/recommendation/☆132Updated 2 years ago