alibaba / hap
☆9Updated 7 months ago
Related projects ⓘ
Alternatives and complementary repositories for hap
- A Deep Learning Cluster Scheduler☆37Updated 3 years ago
- Official resporitory for "IPDPS' 24 QSync: Quantization-Minimized Synchronous Distributed Training Across Hybrid Devices".☆19Updated 8 months ago
- Artifact of OSDI '24 paper, ”Llumnix: Dynamic Scheduling for Large Language Model Serving“☆56Updated 5 months ago
- SOTA Learning-augmented Systems☆32Updated 2 years ago
- DISB is a new DNN inference serving benchmark with diverse workloads and models, as well as real-world traces.☆54Updated 2 months ago
- Stateful LLM Serving☆37Updated 3 months ago
- A Cluster-Wide Model Manager to Accelerate DNN Training via Automated Training Warmup☆33Updated last year
- [ICDCS 2023] DeAR: Accelerating Distributed Deep Learning with Fine-Grained All-Reduce Pipelining☆12Updated 11 months ago
- ☆22Updated last year
- An Attention Superoptimizer☆20Updated 6 months ago
- Tacker: Tensor-CUDA Core Kernel Fusion for Improving the GPU Utilization while Ensuring QoS☆17Updated 2 years ago
- An external memory allocator example for PyTorch.☆13Updated 3 years ago
- PyTorch compilation tutorial covering TorchScript, torch.fx, and Slapo☆19Updated last year
- ☆16Updated 6 months ago
- A resilient distributed training framework☆85Updated 7 months ago
- ☆19Updated 2 years ago
- ☆16Updated last year
- An interference-aware scheduler for fine-grained GPU sharing☆108Updated 6 months ago
- Model-less Inference Serving☆82Updated last year
- Code associated with the paper **Fine-tuning Language Models over Slow Networks using Activation Compression with Guarantees**.☆25Updated last year
- Official Repo for "LLM-PQ: Serving LLM on Heterogeneous Clusters with Phase-Aware Partition and Adaptive Quantization"☆26Updated 8 months ago
- My paper/code reading notes in Chinese☆45Updated 5 months ago
- A GPU-accelerated DNN inference serving system that supports instant kernel preemption and biased concurrent execution in GPU scheduling.☆39Updated 2 years ago
- Multi-Instance-GPU profiling tool☆53Updated last year
- ☆69Updated last year
- Paella: Low-latency Model Serving with Virtualized GPU Scheduling☆57Updated 6 months ago
- a deep learning-driven scheduler for elastic training in deep learning clusters☆27Updated 3 years ago
- ☆36Updated 4 months ago
- An Efficient Dynamic Resource Scheduler for Deep Learning Clusters☆41Updated 7 years ago
- Official repository for the paper DynaPipe: Optimizing Multi-task Training through Dynamic Pipelines☆14Updated 11 months ago