PanZaifeng / G-SLIDE
☆14Updated 3 years ago
Alternatives and similar repositories for G-SLIDE:
Users that are interested in G-SLIDE are comparing it to the libraries listed below
- ☆15Updated 2 years ago
- A Learnable LSH Framework for Efficient NN Training☆31Updated 3 years ago
- [ICLR 2022] Code for paper "Exploring Extreme Parameter Compression for Pre-trained Language Models"(https://arxiv.org/abs/2205.10036)☆22Updated last year
- ☆27Updated 5 years ago
- Light-weight GPU kernel interface for graph operations☆15Updated 4 years ago
- Execution framework for multi-task model parallelism. Enables the training of arbitrarily large models with a single GPU, with linear spe…☆20Updated last year
- Distributed IO-aware Attention algorithm☆19Updated 7 months ago
- Distributed DataLoader For Pytorch Based On Ray☆24Updated 3 years ago
- [KDD 2022] AutoShard: Automated Embedding Table Sharding for Recommender Systems☆21Updated 2 years ago
- Codes of the paper Deformable Butterfly: A Highly Structured and Sparse Linear Transform.☆12Updated 3 years ago
- Efficient LDA solution on GPUs.☆24Updated 6 years ago
- Repository for CPU Kernel Generation for LLM Inference☆25Updated last year
- A "gym" style toolkit for building lightweight NAS systems.☆13Updated 2 years ago
- ☆14Updated 3 years ago
- Code for paper 'Minimizing FLOPs to Learn Efficient Sparse Representations' published at ICLR 2020☆20Updated 5 years ago
- DL Dataloader Benchmarks☆18Updated 2 months ago
- Graphiler is a compiler stack built on top of DGL and TorchScript which compiles GNNs defined using user-defined functions (UDFs) into ef…☆61Updated 2 years ago
- Set of datasets for the deep learning recommendation model (DLRM).☆45Updated 2 years ago
- Some microbenchmarks and design docs before commencement☆12Updated 4 years ago
- Accelerating Recommender model training by leveraging popular choices -- VLDB 2022☆30Updated 7 months ago
- Memory Optimizations for Deep Learning (ICML 2023)☆64Updated last year
- PipeTransformer: Automated Elastic Pipelining for Distributed Training of Large-scale Models. ICML 2021☆56Updated 3 years ago
- Differentiable Product Quantization for End-to-End Embedding Compression.☆61Updated 2 years ago
- Inference framework for MoE layers based on TensorRT with Python binding☆41Updated 3 years ago
- ☆71Updated 3 years ago
- [ICLR 2025] TidalDecode: A Fast and Accurate LLM Decoding with Position Persistent Sparse Attention☆33Updated 2 weeks ago
- [ICDCS 2023] DeAR: Accelerating Distributed Deep Learning with Fine-Grained All-Reduce Pipelining☆12Updated last year
- APPy (Annotated Parallelism for Python) enables users to annotate loops and tensor expressions in Python with compiler directives akin to…☆23Updated this week
- GPU operators for sparse tensor operations☆32Updated last year
- image to column☆30Updated 10 years ago