daochenzha / neuroshard
[MLSys 2023] Pre-train and Search: Efficient Embedding Table Sharding with Pre-trained Neural Cost Models
☆16Updated last year
Alternatives and similar repositories for neuroshard:
Users that are interested in neuroshard are comparing it to the libraries listed below
- [KDD 2022] AutoShard: Automated Embedding Table Sharding for Recommender Systems☆21Updated last year
- [NeurIPS 2022] DreamShard: Generalizable Embedding Table Placement for Recommender Systems☆29Updated last year
- ☆19Updated 2 years ago
- Graphiler is a compiler stack built on top of DGL and TorchScript which compiles GNNs defined using user-defined functions (UDFs) into ef…☆61Updated 2 years ago
- ☆73Updated 3 years ago
- Set of datasets for the deep learning recommendation model (DLRM).☆41Updated 2 years ago
- PyTorch-Direct code on top of PyTorch-1.8.0nightly (e152ca5) for Large Graph Convolutional Network Training with GPU-Oriented Data Commun…☆45Updated last year
- ☆11Updated 4 months ago
- Accelerating Recommender model training by leveraging popular choices -- VLDB 2022☆29Updated 4 months ago
- Modyn is a research-platform for training ML models on growing datasets.☆38Updated this week
- ☆47Updated 2 years ago
- Modular and structured prompt caching for low-latency LLM inference☆83Updated 2 months ago
- ☆19Updated last year
- A resilient distributed training framework☆88Updated 9 months ago
- ☆43Updated 6 months ago
- ☆20Updated last year
- PipeInfer: Accelerating LLM Inference using Asynchronous Pipelined Speculation☆23Updated 2 months ago
- LLM Serving Performance Evaluation Harness☆65Updated 4 months ago
- PyTorch implementation of paper "Response Length Perception and Sequence Scheduling: An LLM-Empowered LLM Inference Pipeline".☆81Updated last year
- TidalDecode: A Fast and Accurate LLM Decoding with Position Persistent Sparse Attention☆26Updated last month
- Repository for "GIST: Distributed training for large-scale graph convolutional networks"☆14Updated 2 years ago
- The official SALIENT system described in the paper "Accelerating Training and Inference of Graph Neural Networks with Fast Sampling and P…☆38Updated last year
- Light-weight GPU kernel interface for graph operations☆15Updated 4 years ago
- PipeRAG: Fast Retrieval-Augmented Generation via Algorithm-System Co-design (KDD 2025)☆16Updated 7 months ago
- LLM-Inference-Bench☆26Updated last week
- Cascade Speculative Drafting☆28Updated 9 months ago
- An Attention Superoptimizer☆20Updated 8 months ago
- Largest realworld open-source graph dataset - Worked done under IBM-Illinois Discovery Accelerator Institute and Amazon Research Awards a…☆76Updated last month
- ☆48Updated 7 months ago
- Artifact for PPoPP20 "Understanding and Bridging the Gaps in Current GNN Performance Optimizations"☆39Updated 3 years ago