daochenzha / neuroshard
[MLSys 2023] Pre-train and Search: Efficient Embedding Table Sharding with Pre-trained Neural Cost Models
☆16Updated last year
Alternatives and similar repositories for neuroshard:
Users that are interested in neuroshard are comparing it to the libraries listed below
- [KDD 2022] AutoShard: Automated Embedding Table Sharding for Recommender Systems☆21Updated last year
- [NeurIPS 2022] DreamShard: Generalizable Embedding Table Placement for Recommender Systems☆29Updated last year
- ☆73Updated 3 years ago
- ☆50Updated 8 months ago
- PipeInfer: Accelerating LLM Inference using Asynchronous Pipelined Speculation☆25Updated 3 months ago
- Largest realworld open-source graph dataset - Worked done under IBM-Illinois Discovery Accelerator Institute and Amazon Research Awards a…☆79Updated 2 months ago
- [ICLR 2025] TidalDecode: A Fast and Accurate LLM Decoding with Position Persistent Sparse Attention☆26Updated this week
- Fast and memory-efficient exact attention☆59Updated this week
- Distributed Deep Graph Learning Framework for Dynamic Graphs☆11Updated 10 months ago
- Fast Parallel Probabilistic Graphical Model Learning and Inference [IPDPS'22, PPoPP'23, USENIX ATC'24]☆43Updated 2 weeks ago
- Graphiler is a compiler stack built on top of DGL and TorchScript which compiles GNNs defined using user-defined functions (UDFs) into ef…☆61Updated 2 years ago
- PyTorch implementation of paper "Response Length Perception and Sequence Scheduling: An LLM-Empowered LLM Inference Pipeline".☆81Updated last year
- ☆19Updated 2 years ago
- PyTorch-Direct code on top of PyTorch-1.8.0nightly (e152ca5) for Large Graph Convolutional Network Training with GPU-Oriented Data Commun…☆45Updated last year
- Set of datasets for the deep learning recommendation model (DLRM).☆41Updated 2 years ago
- ☆43Updated 7 months ago
- LLM Serving Performance Evaluation Harness☆67Updated 5 months ago
- Official implementation for Yuan & Liu & Zhong et al., KV Cache Compression, But What Must We Give in Return? A Comprehensive Benchmark o…☆65Updated last month
- ☆20Updated last year
- Accelerating Recommender model training by leveraging popular choices -- VLDB 2022☆30Updated 5 months ago
- Official resporitory for "IPDPS' 24 QSync: Quantization-Minimized Synchronous Distributed Training Across Hybrid Devices".☆19Updated 11 months ago
- ICLR 2021☆46Updated 3 years ago
- ☆46Updated 2 years ago
- Modular and structured prompt caching for low-latency LLM inference☆87Updated 3 months ago
- Boosting 4-bit inference kernels with 2:4 Sparsity☆64Updated 5 months ago
- A resilient distributed training framework☆88Updated 10 months ago
- An Attention Superoptimizer☆21Updated 3 weeks ago
- ☆32Updated 6 months ago
- Artifact for PPoPP20 "Understanding and Bridging the Gaps in Current GNN Performance Optimizations"☆39Updated 3 years ago
- A GPU-accelerated graph learning library for PyTorch, facilitating the scaling of GNN training and inference.☆125Updated 3 months ago