MLSysU / TD-PipeLinks
A Throughput-Optimized Pipeline Parallel Inference System for Large Language Models
☆40Updated 2 months ago
Alternatives and similar repositories for TD-Pipe
Users that are interested in TD-Pipe are comparing it to the libraries listed below
Sorting:
- ☆129Updated this week
- Spack package repository maintained by Student Cluster Competition Team @ Sun Yat-sen University.☆16Updated last month
- A Easy-to-understand TensorOp Matmul Tutorial☆378Updated last year
- This repository is established to store personal notes and annotated papers during daily research.☆154Updated this week
- Artifact from "Hardware Compute Partitioning on NVIDIA GPUs". THIS IS A FORK OF BAKITAS REPO☆34Updated last year
- Since the emergence of chatGPT in 2022, the acceleration of Large Language Model has become increasingly important. Here is a list of pap…☆274Updated 7 months ago
- Solution of Programming Massively Parallel Processors☆50Updated last year
- ☆43Updated last year
- GoPTX: Fine-grained GPU Kernel Fusion by PTX-level Instruction Flow Weaving☆18Updated 2 months ago
- A baseline repository of Auto-Parallelism in Training Neural Networks☆146Updated 3 years ago
- ☆33Updated last year
- ☆144Updated 4 months ago
- paper and its code for AI System☆333Updated last month
- ☆153Updated 9 months ago
- Examples of CUDA implementations by Cutlass CuTe☆236Updated 3 months ago
- Optimizing SGEMM kernel functions on NVIDIA GPUs to a close-to-cuBLAS performance.☆384Updated 9 months ago
- Curated collection of papers in machine learning systems☆417Updated last month
- ☆13Updated last year
- An Optimizing Compiler for Recommendation Model Inference☆26Updated 4 months ago
- ☆135Updated 10 months ago
- Codes & examples for "CUDA - From Correctness to Performance"☆114Updated 11 months ago
- Yinghan's Code Sample☆350Updated 3 years ago
- Here are my personal paper reading notes (including cloud computing, resource management, systems, machine learning, deep learning, and o…☆123Updated this week
- Several optimization methods of half-precision general matrix multiplication (HGEMM) using tensor core with WMMA API and MMA PTX instruct…☆480Updated last year
- ☆257Updated this week
- Summary of the Specs of Commonly Used GPUs for Training and Inference of LLM☆63Updated last month
- An interference-aware scheduler for fine-grained GPU sharing☆147Updated 8 months ago
- DeepSeek-V3/R1 inference performance simulator☆170Updated 6 months ago
- A direct convolution library targeting ARM multi-core CPUs.☆12Updated 10 months ago
- ☆190Updated 2 months ago