PanZaifeng / RecFlexLinks
A recommendation model kernel optimizing system
☆10Updated 2 months ago
Alternatives and similar repositories for RecFlex
Users that are interested in RecFlex are comparing it to the libraries listed below
Sorting:
- ☆21Updated 4 months ago
- Artifact for OSDI'23: MGG: Accelerating Graph Neural Networks with Fine-grained intra-kernel Communication-Computation Pipelining on Mult…☆40Updated last year
- An Optimizing Compiler for Recommendation Model Inference☆25Updated 2 months ago
- (NeurIPS 2022) Automatically finding good model-parallel strategies, especially for complex models and clusters.☆40Updated 2 years ago
- Artifacts of EVT ASPLOS'24☆26Updated last year
- ☆67Updated last year
- ☆80Updated 2 years ago
- Graphiler is a compiler stack built on top of DGL and TorchScript which compiles GNNs defined using user-defined functions (UDFs) into ef…☆59Updated 2 years ago
- Flash-LLM: Enabling Cost-Effective and Highly-Efficient Large Generative Model Inference with Unstructured Sparsity☆216Updated last year
- Magicube is a high-performance library for quantized sparse matrix operations (SpMM and SDDMM) of deep learning on Tensor Cores.☆89Updated 2 years ago
- A lightweight design for computation-communication overlap.☆155Updated last month
- ☆150Updated last year
- GPU TopK Benchmark☆15Updated 7 months ago
- Microsoft Collective Communication Library☆65Updated 8 months ago
- Compiler for Dynamic Neural Networks☆46Updated last year
- Automated Parallelization System and Infrastructure for Multiple Ecosystems☆79Updated 8 months ago
- A Vectorized N:M Format for Unleashing the Power of Sparse Tensor Cores☆52Updated last year
- Artifact of OSDI '24 paper, ”Llumnix: Dynamic Scheduling for Large Language Model Serving“☆62Updated last year
- ☆75Updated 4 years ago
- DISB is a new DNN inference serving benchmark with diverse workloads and models, as well as real-world traces.☆53Updated 11 months ago
- ☆41Updated last year
- ☆109Updated 4 years ago
- Thunder Research Group's Collective Communication Library☆39Updated last month
- FlexFlow Serve: Low-Latency, High-Performance LLM Serving☆48Updated last week
- Stateful LLM Serving☆79Updated 4 months ago
- PerFlow-AI is a programmable performance analysis, modeling, prediction tool for AI system.☆21Updated 3 months ago
- An experimental parallel training platform☆54Updated last year
- Chimera: bidirectional pipeline parallelism for efficiently training large-scale models.☆66Updated 4 months ago
- SparseTIR: Sparse Tensor Compiler for Deep Learning☆137Updated 2 years ago
- ☆70Updated 4 years ago