daochenzha / autoshardLinks
[KDD 2022] AutoShard: Automated Embedding Table Sharding for Recommender Systems
☆22Updated 2 years ago
Alternatives and similar repositories for autoshard
Users that are interested in autoshard are comparing it to the libraries listed below
Sorting:
- Set of datasets for the deep learning recommendation model (DLRM).☆47Updated 2 years ago
- Distributed Deep Graph Learning Framework for Dynamic Graphs☆17Updated last year
- [NeurIPS 2022] DreamShard: Generalizable Embedding Table Placement for Recommender Systems☆29Updated 2 years ago
- [ICML 2021] "A Unified Lottery Tickets Hypothesis for Graph Neural Networks", Tianlong Chen*, Yongduo Sui*, Xuxi Chen, Aston Zhang, Zhang…☆66Updated last year
- [MLSys 2022] "BNS-GCN: Efficient Full-Graph Training of Graph Convolutional Networks with Partition-Parallelism and Random Boundary Node …☆56Updated last year
- ☆21Updated 3 years ago
- Largest realworld open-source graph dataset - Worked done under IBM-Illinois Discovery Accelerator Institute and Amazon Research Awards a…☆84Updated 2 months ago
- A GPU-accelerated graph learning library for PyTorch, facilitating the scaling of GNN training and inference.☆141Updated 4 months ago
- Large Graph Convolutional Network Training with GPU-Oriented Data Communication Architecture (accepted by PVLDB)☆44Updated 2 years ago
- ICLR 2021☆48Updated 4 years ago
- Graphiler is a compiler stack built on top of DGL and TorchScript which compiles GNNs defined using user-defined functions (UDFs) into ef…☆59Updated 2 years ago
- ☆70Updated 4 years ago
- The official SALIENT system described in the paper "Accelerating Training and Inference of Graph Neural Networks with Fast Sampling and P…☆40Updated 2 years ago
- PyTorch Library for Low-Latency, High-Throughput Graph Learning on GPUs.☆301Updated 2 years ago
- [ICLR 2022] "PipeGCN: Efficient Full-Graph Training of Graph Convolutional Networks with Pipelined Feature Communication" by Cheng Wan, Y…☆33Updated 2 years ago
- Accelerating Recommender model training by leveraging popular choices -- VLDB 2022☆31Updated 11 months ago
- http://vlsiarch.eecs.harvard.edu/research/recommendation/☆136Updated 2 years ago
- Large scale graph learning on a single machine.☆164Updated 6 months ago
- ☆46Updated 2 years ago
- Enabling pure data parallel training of DLRM via caching and prefetching☆17Updated 3 years ago
- ☆13Updated 4 years ago
- Codes for SIGIR'22 Paper 'On-Device Next-Item Recommendation with Self-Supervised Knowledge Distillation'☆14Updated 2 years ago
- ☆12Updated 2 years ago
- [MLSys 2023] Pre-train and Search: Efficient Embedding Table Sharding with Pre-trained Neural Cost Models☆16Updated 2 years ago
- ☆213Updated last year
- An efficient open-source AutoML system for automating machine learning lifecycle, including feature engineering, neural architecture sear…☆58Updated 3 years ago
- Source code for Learn Locally Correct Globally☆14Updated 3 years ago
- [NeurIPS 2021]: Improve the GNN expressivity and scalability by decoupling the depth and receptive field of state-of-the-art GNN architec…☆135Updated 3 years ago
- A scalable graph learning toolkit for extremely large graph datasets. (WWW'22, 🏆 Best Student Paper Award)☆155Updated last year
- [IJCAI2023] An automated parallel training system that combines the advantages from both data and model parallelism. If you have any inte…☆52Updated 2 years ago