PKU-DAIR / Hetu
A high-performance distributed deep learning system targeting large-scale and automated distributed training.
☆284Updated last month
Alternatives and similar repositories for Hetu:
Users that are interested in Hetu are comparing it to the libraries listed below
- A high-performance distributed deep learning system targeting large-scale and automated distributed training. If you have any interests, …☆107Updated last year
- A baseline repository of Auto-Parallelism in Training Neural Networks☆142Updated 2 years ago
- Since the emergence of chatGPT in 2022, the acceleration of Large Language Model has become increasingly important. Here is a list of pap…☆220Updated last month
- paper and its code for AI System☆272Updated 3 weeks ago
- A ChatGPT(GPT-3.5) & GPT-4 Workload Trace to Optimize LLM Serving Systems☆145Updated 4 months ago
- AlpaServe: Statistical Multiplexing with Model Parallelism for Deep Learning Serving (OSDI 23)☆81Updated last year
- nnScaler: Compiling DNN models for Parallel Training☆93Updated last week
- Disaggregated serving system for Large Language Models (LLMs).☆466Updated 6 months ago
- Easy Parallel Library (EPL) is a general and efficient deep learning framework for distributed model training.☆266Updated last year
- ATC23 AE☆45Updated last year
- [USENIX ATC '24] Accelerating the Training of Large Language Models using Efficient Activation Rematerialization and Optimal Hybrid Paral…☆51Updated 6 months ago
- ☆76Updated 2 years ago
- Curated collection of papers in MoE model inference☆64Updated this week
- A curated list of awesome projects and papers for distributed training or inference☆214Updated 4 months ago
- Zero Bubble Pipeline Parallelism☆336Updated last week
- ☆64Updated 2 years ago
- ☆79Updated 2 months ago
- Dynamic Memory Management for Serving LLMs without PagedAttention☆290Updated this week
- This repository is established to store personal notes and annotated papers during daily research.☆109Updated this week
- A fast communication-overlapping library for tensor parallelism on GPUs.☆296Updated 3 months ago
- ☆83Updated 3 months ago
- Galvatron is an automatic distributed training system designed for Transformer models, including Large Language Models (LLMs). If you hav…☆17Updated this week
- A large-scale simulation framework for LLM inference☆325Updated 3 months ago
- A low-latency & high-throughput serving engine for LLMs☆312Updated 3 weeks ago
- An Efficient Pipelined Data Parallel Approach for Training Large Model☆73Updated 4 years ago
- ☆538Updated 5 months ago
- GLake: optimizing GPU memory management and IO transmission.☆431Updated 2 months ago
- ☆99Updated last year
- Here are my personal paper reading notes (including cloud computing, resource management, systems, machine learning, deep learning, and o…☆70Updated 3 weeks ago
- ☆72Updated 3 years ago