daochenzha / neuroshard
[MLSys 2023] Pre-train and Search: Efficient Embedding Table Sharding with Pre-trained Neural Cost Models
☆16Updated 2 years ago
Alternatives and similar repositories for neuroshard
Users that are interested in neuroshard are comparing it to the libraries listed below
Sorting:
- [NeurIPS 2022] DreamShard: Generalizable Embedding Table Placement for Recommender Systems☆29Updated 2 years ago
- [KDD 2022] AutoShard: Automated Embedding Table Sharding for Recommender Systems☆22Updated 2 years ago
- ☆71Updated 3 years ago
- PipeInfer: Accelerating LLM Inference using Asynchronous Pipelined Speculation☆28Updated 6 months ago
- ☆46Updated 2 years ago
- PyTorch-Direct code on top of PyTorch-1.8.0nightly (e152ca5) for Large Graph Convolutional Network Training with GPU-Oriented Data Commun…☆44Updated last year
- [ICLR 2025] TidalDecode: A Fast and Accurate LLM Decoding with Position Persistent Sparse Attention☆36Updated 3 weeks ago
- PipeRAG: Fast Retrieval-Augmented Generation via Algorithm-System Co-design (KDD 2025)☆20Updated 11 months ago
- Distributed Deep Graph Learning Framework for Dynamic Graphs☆13Updated last year
- ☆21Updated 3 years ago
- Graphiler is a compiler stack built on top of DGL and TorchScript which compiles GNNs defined using user-defined functions (UDFs) into ef…☆61Updated 2 years ago
- ☆13Updated last year
- The official SALIENT system described in the paper "Accelerating Training and Inference of Graph Neural Networks with Fast Sampling and P…☆40Updated last year
- Largest realworld open-source graph dataset - Worked done under IBM-Illinois Discovery Accelerator Institute and Amazon Research Awards a…☆82Updated 5 months ago
- ☆20Updated last year
- An Attention Superoptimizer☆21Updated 3 months ago
- Official resporitory for "IPDPS' 24 QSync: Quantization-Minimized Synchronous Distributed Training Across Hybrid Devices".☆20Updated last year
- A curated list for Efficient Large Language Models☆11Updated last year
- A Framework for Graph Sampling and Random Walk on GPUs.☆39Updated 3 months ago
- Fast Parallel Probabilistic Graphical Model Learning and Inference [IPDPS'22, PPoPP'23, USENIX ATC'24]☆44Updated 3 months ago
- Accelerating Recommender model training by leveraging popular choices -- VLDB 2022☆30Updated 8 months ago
- PyTorch implementation of paper "Response Length Perception and Sequence Scheduling: An LLM-Empowered LLM Inference Pipeline".☆85Updated last year
- An experimentation platform for LLM inference optimisation☆30Updated 7 months ago
- Set of datasets for the deep learning recommendation model (DLRM).☆45Updated 2 years ago
- ☆62Updated 11 months ago
- Modular and structured prompt caching for low-latency LLM inference☆92Updated 6 months ago
- [MLSys 2022] "BNS-GCN: Efficient Full-Graph Training of Graph Convolutional Networks with Partition-Parallelism and Random Boundary Node …☆56Updated last year
- ☆25Updated 3 months ago
- ☆45Updated last month
- [ICLR 2022] "PipeGCN: Efficient Full-Graph Training of Graph Convolutional Networks with Pipelined Feature Communication" by Cheng Wan, Y…☆32Updated 2 years ago