PanZaifeng / G-SLIDELinks
☆15Updated 4 years ago
Alternatives and similar repositories for G-SLIDE
Users that are interested in G-SLIDE are comparing it to the libraries listed below
Sorting:
- A Learnable LSH Framework for Efficient NN Training☆34Updated 4 years ago
- ☆15Updated 3 years ago
- Inference framework for MoE layers based on TensorRT with Python binding☆41Updated 4 years ago
- Differentiable Product Quantization for End-to-End Embedding Compression.☆64Updated 3 years ago
- A Python library transfers PyTorch tensors between CPU and NVMe☆125Updated last year
- A memory efficient DLRM training solution using ColossalAI☆105Updated 3 years ago
- PipeTransformer: Automated Elastic Pipelining for Distributed Training of Large-scale Models. ICML 2021☆55Updated 4 years ago
- Simple Distributed Deep Learning on TensorFlow☆134Updated 7 months ago
- ☆115Updated last year
- Research and development for optimizing transformers☆131Updated 4 years ago
- Distributed ML Optimizer☆35Updated 4 years ago
- This is a Tensor Train based compression library to compress sparse embedding tables used in large-scale machine learning models such as …☆194Updated 3 years ago
- Practical low-rank gradient compression for distributed optimization: https://arxiv.org/abs/1905.13727☆149Updated last year
- Fast sparse deep learning on CPUs☆56Updated 3 years ago
- ☆28Updated 6 years ago
- Set of datasets for the deep learning recommendation model (DLRM).☆48Updated 3 years ago
- This is the (evolving) reading list for the seminar.☆61Updated 5 years ago
- ☆45Updated 2 years ago
- Fairring (FAIR + Herring) is a plug-in for PyTorch that provides a process group for distributed training that outperforms NCCL at large …☆65Updated 3 years ago
- ☆94Updated 3 years ago
- Training neural networks in TensorFlow 2.0 with 5x less memory☆137Updated 3 years ago
- Summary of system papers/frameworks/codes/tools on training or serving large model☆57Updated 2 years ago
- [ICDCS 2023] DeAR: Accelerating Distributed Deep Learning with Fine-Grained All-Reduce Pipelining☆12Updated 2 years ago
- [IJCAI2023] An automated parallel training system that combines the advantages from both data and model parallelism. If you have any inte…☆52Updated 2 years ago
- ☆70Updated 4 years ago
- Large Graph Convolutional Network Training with GPU-Oriented Data Communication Architecture (accepted by PVLDB)☆44Updated 2 years ago
- pytorch-profiler☆50Updated 2 years ago
- Large Scale Search Index☆32Updated 2 years ago
- Code for ICML2019 paper: Learning to Route in Similarity Graphs☆61Updated last year
- Odysseus: Playground of LLM Sequence Parallelism☆79Updated last year