PanZaifeng / G-SLIDELinks
☆15Updated 3 years ago
Alternatives and similar repositories for G-SLIDE
Users that are interested in G-SLIDE are comparing it to the libraries listed below
Sorting:
- A Learnable LSH Framework for Efficient NN Training☆32Updated 4 years ago
- Inference framework for MoE layers based on TensorRT with Python binding☆41Updated 4 years ago
- ☆15Updated 3 years ago
- PipeTransformer: Automated Elastic Pipelining for Distributed Training of Large-scale Models. ICML 2021☆56Updated 4 years ago
- Set of datasets for the deep learning recommendation model (DLRM).☆47Updated 2 years ago
- ☆94Updated 3 years ago
- Research and development for optimizing transformers☆130Updated 4 years ago
- A Python library transfers PyTorch tensors between CPU and NVMe☆121Updated 9 months ago
- Simple Distributed Deep Learning on TensorFlow☆133Updated 3 months ago
- A curated list for Efficient Large Language Models☆11Updated last year
- ☆70Updated 4 years ago
- Training neural networks in TensorFlow 2.0 with 5x less memory☆134Updated 3 years ago
- Graphiler is a compiler stack built on top of DGL and TorchScript which compiles GNNs defined using user-defined functions (UDFs) into ef…☆59Updated 2 years ago
- Summary of system papers/frameworks/codes/tools on training or serving large model☆57Updated last year
- ☆41Updated last year
- This is the (evolving) reading list for the seminar.☆59Updated 4 years ago
- ☆112Updated last year
- Practical low-rank gradient compression for distributed optimization: https://arxiv.org/abs/1905.13727☆148Updated 10 months ago
- Differentiable Product Quantization for End-to-End Embedding Compression.☆63Updated 2 years ago
- ☆50Updated this week
- Odysseus: Playground of LLM Sequence Parallelism☆77Updated last year
- [ICDCS 2023] DeAR: Accelerating Distributed Deep Learning with Fine-Grained All-Reduce Pipelining☆12Updated last year
- [ICLR 2025] TidalDecode: A Fast and Accurate LLM Decoding with Position Persistent Sparse Attention☆47Updated last month
- A recommendation model kernel optimizing system☆10Updated 3 months ago
- ☆27Updated 5 years ago
- pytorch-profiler☆51Updated 2 years ago
- Large Graph Convolutional Network Training with GPU-Oriented Data Communication Architecture (accepted by PVLDB)☆44Updated 2 years ago
- sensAI: ConvNets Decomposition via Class Parallelism for Fast Inference on Live Data☆64Updated last year
- FTPipe and related pipeline model parallelism research.☆42Updated 2 years ago
- This is a Tensor Train based compression library to compress sparse embedding tables used in large-scale machine learning models such as …☆194Updated 3 years ago