TheCoreTeam / core_scheduler
CoreScheduler: A High-Performance Scheduler for Large Model Training
☆21Updated 7 months ago
Alternatives and similar repositories for core_scheduler:
Users that are interested in core_scheduler are comparing it to the libraries listed below
- Tacker: Tensor-CUDA Core Kernel Fusion for Improving the GPU Utilization while Ensuring QoS☆19Updated last month
- Official resporitory for "IPDPS' 24 QSync: Quantization-Minimized Synchronous Distributed Training Across Hybrid Devices".☆19Updated last year
- An Attention Superoptimizer☆21Updated 2 months ago
- ThrillerFlow is a Dataflow Analysis and Codegen Framework written in Rust.☆14Updated 3 months ago
- Supplemental materials for The ASPLOS 2025 / EuroSys 2025 Contest on Intra-Operator Parallelism for Distributed Deep Learning☆23Updated 3 months ago
- Artifact for "Apparate: Rethinking Early Exits to Tame Latency-Throughput Tensions in ML Serving" [SOSP '24]☆22Updated 4 months ago
- A Cluster-Wide Model Manager to Accelerate DNN Training via Automated Training Warmup☆34Updated 2 years ago
- An external memory allocator example for PyTorch.☆14Updated 3 years ago
- ☆8Updated last year
- ArkVale: Efficient Generative LLM Inference with Recallable Key-Value Eviction (NIPS'24)☆31Updated 3 months ago
- Code associated with the paper **Fine-tuning Language Models over Slow Networks using Activation Compression with Guarantees**.☆28Updated last year
- PyTorch compilation tutorial covering TorchScript, torch.fx, and Slapo☆18Updated 2 years ago
- ☆12Updated 2 years ago
- A memory profiler for NVIDIA GPUs to explore memory inefficiencies in GPU-accelerated applications.☆25Updated 5 months ago
- ☆24Updated 3 months ago
- ☆19Updated 2 years ago
- Stateful LLM Serving☆48Updated last week
- [ICDCS 2023] Evaluation and Optimization of Gradient Compression for Distributed Deep Learning☆10Updated last year
- Canvas: End-to-End Kernel Architecture Search in Neural Networks☆26Updated 4 months ago
- TileFusion is an experimental C++ macro kernel template library that elevates the abstraction level in CUDA C for tile processing. By pro…☆68Updated this week
- [ICML 2024] Serving LLMs on heterogeneous decentralized clusters.☆22Updated 10 months ago
- Summary of system papers/frameworks/codes/tools on training or serving large model☆56Updated last year
- ☆14Updated 2 years ago
- MAGIS: Memory Optimization via Coordinated Graph Transformation and Scheduling for DNN (ASPLOS'24)☆49Updated 9 months ago
- ☆53Updated 9 months ago